Apr 12 06:17:47 user cinder-volume[73692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:17:47 user cinder-volume[73692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:17:47 user cinder-volume[73692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:17:48 user cinder-volume[73692]: INFO dbcounter [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Registered counter for database cinder
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_db.sqlalchemy.engines [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73692) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG dbcounter [-] [73692] Writer thread running {{(pid=73692) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}}
Apr 12 06:17:48 user cinder-volume[73692]: INFO cinder.rpc [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 12 06:17:48 user cinder-volume[73692]: INFO cinder.rpc [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_db.sqlalchemy.engines [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73692) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}}
Apr 12 06:17:48 user cinder-volume[73692]: INFO cinder.volume.manager [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Determined volume DB was empty at startup.
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG cinder.volume.manager [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73692) __init__ /opt/stack/cinder/cinder/volume/manager.py:291}}
Apr 12 06:17:48 user cinder-volume[73692]: INFO cinder.volume.manager [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 12 06:17:48 user cinder-volume[73692]: WARNING stevedore.named [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 12 06:17:48 user cinder-volume[73692]: WARNING castellan.key_manager [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 12 06:17:48 user cinder-volume[73692]: WARNING cinder.keymgr.conf_key_mgr [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_db.sqlalchemy.engines [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73692) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}}
Apr 12 06:17:48 user cinder-volume[73692]: INFO cinder.rpc [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 12 06:17:48 user cinder-volume[73692]: INFO cinder.rpc [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version.
Apr 12 06:17:48 user cinder-volume[73692]: WARNING stevedore.named [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 12 06:17:48 user cinder-volume[73692]: WARNING castellan.key_manager [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 12 06:17:48 user cinder-volume[73692]: INFO cinder.volume.manager [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Image-volume cache enabled for host user@joviandss-2.
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_db.sqlalchemy.engines [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73692) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}}
Apr 12 06:17:48 user cinder-volume[73692]: INFO oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Starting 1 workers
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Started child 73792 {{(pid=73692) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Full set of CONF: {{(pid=73692) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] ******************************************************************************** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] Configuration options gathered from: {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] ================================================================================ {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] allow_availability_zone_fallback = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] allow_compression_on_image_upload = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] allowed_direct_url_schemes     = [] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] api_rate_limit                 = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] auth_strategy                  = keystone {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] az_cache_duration              = 3600 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_availability_zone      = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_host                   = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_name                   = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_stats_polling_interval = 60 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73792]: INFO cinder.service [-] Starting cinder-volume node (version 22.1.0)
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backup_api_class               = cinder.backup.api.API {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backup_name_template           = backup-%s {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backup_use_same_host           = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backup_use_temp_snapshot       = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] chap_password                  = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] chap_password_len              = 12 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] chap_username                  =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cinder_internal_tenant_project_id = 47ae5d35908f49c5b6139fe1fea0ac76 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cinder_internal_tenant_user_id = 8e1852ceee3e4ceb958952f3a4beb59d {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cloned_volume_same_az          = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cluster                        = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] compression_format             = gzip {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] compute_api_class              = cinder.compute.nova.API {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] config_dir                     = [] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] config_source                  = [] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] control_exchange               = openstack {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] debug                          = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] default_availability_zone      = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] default_group_type             = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] default_volume_type            = joviandss-2 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] driver_client_cert             = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] driver_client_cert_key         = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] driver_data_namespace          = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] driver_ssl_cert_path           = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] driver_ssl_cert_verify         = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] driver_use_ssl                 = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] enable_force_upload            = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] enable_new_services            = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] enable_unsupported_driver      = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] enabled_backends               = ['joviandss-2'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] enforce_multipath_for_image_xfer = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] filter_function                = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] glance_api_insecure            = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] glance_api_servers             = ['http://10.0.0.210/image'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] glance_api_ssl_compression     = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] glance_ca_certificates_file    = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] glance_catalog_info            = image:glance:publicURL {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] glance_certfile                = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] glance_keyfile                 = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] glance_num_retries             = 3 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] glance_request_timeout         = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] goodness_function              = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] graceful_shutdown_timeout      = 5 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] group_api_class                = cinder.group.api.API {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] host                           = user {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] iet_conf                       = /etc/iet/ietd.conf {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] image_compress_on_upload       = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] image_conversion_address_space_limit = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] image_conversion_cpu_limit     = 60 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] image_conversion_disable       = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] image_upload_use_cinder_backend = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] image_upload_use_internal_tenant = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] image_volume_cache_enabled     = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] image_volume_cache_max_count   = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] image_volume_cache_max_size_gb = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] init_host_max_objects_retrieval = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] iscsi_iotype                   = fileio {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] iscsi_target_flags             =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] iscsi_write_cache              = on {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] iser_helper                    = tgtadm {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] iser_ip_address                = 10.0.0.210 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] iser_port                      = 3260 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] jovian_block_size              = 64K {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] jovian_ignore_tpath            = [] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] jovian_pool                    = Pool-0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] jovian_recovery_delay          = 60 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] log_config_append              = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] log_dir                        = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] log_file                       = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] log_options                    = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] log_rotate_interval            = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] log_rotate_interval_type       = days {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] log_rotation_type              = none {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] max_age                        = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] max_logfile_count              = 30 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] max_logfile_size_mb            = 200 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] max_over_subscription_ratio    = 20.0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] message_reap_interval          = 86400 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] message_ttl                    = 2592000 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] migration_create_volume_timeout_secs = 300 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] monkey_patch                   = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] monkey_patch_modules           = [] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] my_ip                          = 10.0.0.210 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] no_snapshot_gb_quota           = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] num_iser_scan_tries            = 3 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] num_shell_tries                = 3 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] num_volume_device_scan_tries   = 3 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] nvmeof_conn_info_version       = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] nvmet_ns_id                    = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] nvmet_port_id                  = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] osapi_max_limit                = 1000 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] osapi_volume_ext_list          = [] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] osapi_volume_listen_port       = 8776 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] osapi_volume_use_ssl           = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] osapi_volume_workers           = 3 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] per_volume_size_limit          = -1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] periodic_fuzzy_delay           = 60 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73792]: INFO cinder.volume.manager [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Starting volume driver JovianISCSIDriver (1.0.2)
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] periodic_interval              = 60 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] public_endpoint                = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] publish_errors                 = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] quota_backup_gigabytes         = 1000 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] quota_backups                  = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] quota_consistencygroups        = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] check pool {{(pid=73792) is_pool_exists /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:71}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] quota_gigabytes                = 1000 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:17:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] quota_groups                   = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] quota_snapshots                = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] quota_volumes                  = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] rate_limit_burst               = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] rate_limit_except_level        = CRITICAL {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] rate_limit_interval            = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] reinit_driver_count            = 3 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] replication_device             = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] report_discard_supported       = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] report_interval                = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] reservation_clean_interval     = 86400 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] reservation_expire             = 86400 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] reserved_image_namespaces      = [] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] reserved_percentage            = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] rpc_response_timeout           = 120 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] run_external_periodic_tasks    = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] san_hosts                      = [] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] scst_target_driver             = iscsi {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] scst_target_iqn_name           = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] service_down_time              = 60 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] snapshot_name_template         = snapshot-%s {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] snapshot_same_host             = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] split_loggers                  = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] ssh_hosts_key_file             = /opt/stack/data/cinder/ssh_known_hosts {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] state_path                     = /opt/stack/data/cinder {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] storage_availability_zone      = nova {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] storage_protocol               = iSCSI {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] strict_ssh_host_key_policy     = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] syslog_log_facility            = LOG_USER {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] target_helper                  = lioadm {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] target_ip_address              = 10.0.0.210 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] target_port                    = 3260 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] target_protocol                = iscsi {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] target_secondary_ip_addresses  = [] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] trace_flags                    = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] transport_url                  = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] until_refresh                  = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] use_chap_auth                  = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] use_default_quota_class        = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] use_eventlog                   = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] use_journal                    = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] use_json                       = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] use_multipath_for_image_xfer   = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] use_stderr                     = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] use_syslog                     = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] verify_glance_signatures       = enabled {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volume_api_class               = cinder.volume.api.API {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volume_backend_name            = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volume_clear                   = zero {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volume_clear_ionice            = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volume_clear_size              = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volume_copy_bps_limit          = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volume_dd_blocksize            = 1M {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volume_name_template           = volume-%s {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volume_service_inithost_offload = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volume_usage_audit_period      = month {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] watch_log_file                 = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] zoning_mode                    = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_concurrency.disable_process_locking = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.admin_password = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.admin_token = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.admin_user  = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.auth_port   = 35357 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.auth_protocol = https {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.auth_section = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.auth_type   = password {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.auth_uri    = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.auth_version = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.cache       = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.certfile    = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.identity_uri = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.include_service_catalog = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.insecure    = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.interface   = public {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.keyfile     = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.region_name = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.service_type = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.backend                  = dogpile.cache.null {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.backend_argument         = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.config_prefix            = cache.oslo {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.dead_timeout             = 60.0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.debug_cache_backend      = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.enable_retry_client      = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.enable_socket_keepalive  = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.enabled                  = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.expiration_time          = 600 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.hashclient_retry_attempts = 2 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.memcache_dead_retry      = 300 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.memcache_password        =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.memcache_sasl_enabled    = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.memcache_username        =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.proxies                  = [] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.retry_attempts           = 2 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.retry_delay              = 0.0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.socket_keepalive_count   = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.socket_keepalive_idle    = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.socket_keepalive_interval = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.tls_allowed_ciphers      = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.tls_cafile               = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.tls_certfile             = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.tls_enabled              = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cache.tls_keyfile              = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] coordination.backend_url       = etcd3+http://10.0.0.210:2379 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.backend               = sqlalchemy {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.connection            = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.connection_debug      = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.connection_parameters =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.connection_recycle_time = 3600 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.connection_trace      = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.db_inc_retry_interval = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.db_max_retries        = 20 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.db_max_retry_interval = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.db_retry_interval     = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.max_overflow          = 50 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.max_pool_size         = 5 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.max_retries           = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.mysql_enable_ndb      = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.mysql_wsrep_sync_wait = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.pool_timeout          = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.retry_interval        = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.slave_connection      = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.sqlite_synchronous    = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] database.use_db_reconnect      = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_policy.enforce_new_defaults = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_policy.enforce_scope      = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_policy.policy_default_rule = default {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] profiler.connection_string     = messaging:// {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] profiler.enabled               = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] profiler.es_doc_type           = notification {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] profiler.es_scroll_size        = 10000 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] profiler.es_scroll_time        = 2m {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] profiler.filter_error_trace    = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] profiler.sentinel_service_name = mymaster {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] profiler.socket_timeout        = 0.1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] profiler.trace_sqlalchemy      = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] privsep_osbrick.capabilities   = [21] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] privsep_osbrick.group          = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] privsep_osbrick.helper_command = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] privsep_osbrick.user           = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cinder_sys_admin.group         = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cinder_sys_admin.helper_command = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cinder_sys_admin.thread_pool_size = 12 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] cinder_sys_admin.user          = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] service_user.auth_section      = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] service_user.auth_type         = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] service_user.cafile            = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] service_user.certfile          = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] service_user.collect_timing    = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] service_user.insecure          = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] service_user.keyfile           = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] service_user.send_service_user_token = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] service_user.split_loggers     = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] service_user.timeout           = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.backend_availability_zone = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.chap_password = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.chap_username =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.driver_client_cert = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.driver_client_cert_key = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.driver_data_namespace = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.driver_use_ssl = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.extra_capabilities = {} {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.filter_function = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.goodness_function = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.iet_conf      = /etc/iet/ietd.conf {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.iscsi_target_flags =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.iscsi_write_cache = on {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.iser_helper   = tgtadm {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.iser_ip_address = 10.0.0.210 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.iser_port     = 3260 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.num_shell_tries = 3 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.replication_device = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.report_discard_supported = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.reserved_percentage = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.san_api_port  = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.san_clustername =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.san_ip        =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.san_is_local  = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.san_login     = admin {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.san_password  = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.san_private_key =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.san_ssh_port  = 22 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.san_thin_provision = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.ssh_conn_timeout = 30 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.ssh_max_pool_conn = 5 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.ssh_min_pool_conn = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.target_helper = tgtadm {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.target_ip_address = 10.0.0.210 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.target_port   = 3260 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.target_protocol = iscsi {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:48 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.trace_flags   = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.unique_fqdn_network = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.use_chap_auth = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.volume_backend_name = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.volume_clear  = zero {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.volume_clear_ionice = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.volume_clear_size = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_reports.file_event_handler = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_reports.log_dir           = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.backend_availability_zone = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.backend_host       = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.backend_native_threads_pool_size = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.backup_use_temp_snapshot = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.chap_password      = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.chap_username      = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.chiscsi_conf       = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.driver_client_cert = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.driver_client_cert_key = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.driver_data_namespace = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.driver_ssl_cert_path = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.driver_ssl_cert_verify = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.driver_use_ssl     = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.enable_unsupported_driver = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.enforce_multipath_for_image_xfer = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.extra_capabilities = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.filter_function    = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.goodness_function  = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.iet_conf           = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.image_upload_use_cinder_backend = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.image_upload_use_internal_tenant = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.image_volume_cache_enabled = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.image_volume_cache_max_count = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.image_volume_cache_max_size_gb = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.iscsi_iotype       = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.iscsi_target_flags = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.iscsi_write_cache  = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.iser_helper        = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.iser_ip_address    = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.iser_port          = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.iser_target_prefix = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.max_over_subscription_ratio = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.num_iser_scan_tries = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.num_shell_tries    = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.num_volume_device_scan_tries = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.nvmeof_conn_info_version = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.nvmet_ns_id        = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.nvmet_port_id      = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.replication_device = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.report_discard_supported = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.reserved_percentage = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.scst_target_driver = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.scst_target_iqn_name = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.storage_protocol   = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.suppress_requests_ssl_warnings = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.target_helper      = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.target_ip_address  = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.target_port        = 3260 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.target_prefix      = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.target_protocol    = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.target_secondary_ip_addresses = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.trace_flags        = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.unique_fqdn_network = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.use_chap_auth      = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.use_multipath_for_image_xfer = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.volume_backend_name = joviandss-2 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.volume_clear       = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.volume_clear_ionice = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.volume_clear_size  = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.volume_copy_blkio_cgroup_name = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.volume_copy_bps_limit = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.volume_dd_blocksize = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.volume_driver      = cinder.volume.drivers.open_e.iscsi.JovianISCSIDriver {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] joviandss-2.volumes_dir        = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_notifications.driver = [] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_notifications.retry = -1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] key_manager.fixed_key          = **** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.barbican_api_version  = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.barbican_endpoint     = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.barbican_endpoint_type = public {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.barbican_region_name  = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.cafile                = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.certfile              = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.collect_timing        = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.insecure              = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.keyfile               = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.number_of_retries     = 60 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.retry_delay           = 1 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.send_service_user_token = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.split_loggers         = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.timeout               = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.verify_ssl            = True {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican.verify_ssl_path       = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican_service_user.auth_section = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican_service_user.auth_type = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican_service_user.cafile   = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican_service_user.certfile = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican_service_user.collect_timing = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican_service_user.insecure = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican_service_user.keyfile  = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican_service_user.split_loggers = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] barbican_service_user.timeout  = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.approle_role_id          = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.approle_secret_id        = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.cafile                   = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.certfile                 = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.collect_timing           = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.insecure                 = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.keyfile                  = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.kv_mountpoint            = secret {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.kv_version               = 2 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.namespace                = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.root_token_id            = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.split_loggers            = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.ssl_ca_crt_file          = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.timeout                  = None {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.use_ssl                  = False {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:49 user cinder-volume[73692]: DEBUG oslo_service.service [None req-d5453c1b-6efb-48a9-8dae-ccf1a1fb4b80 None None] ******************************************************************************** {{(pid=73692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 12 06:17:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114801848320', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:17:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] check pool {{(pid=73792) is_pool_exists /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:71}}
Apr 12 06:17:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:17:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:17:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114801848320', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:17:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:17:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:17:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:17:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114801848320', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:17:50 user cinder-volume[73792]: INFO cinder.volume.driver [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Driver hasn't implemented _init_vendor_properties()
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.driver [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Initialized capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73792) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:832}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG oslo_db.sqlalchemy.engines [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73792) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writer thread running {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.db.sqlalchemy.api [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Building query based on filter {{(pid=73792) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.image.image_utils [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73792) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1146}}
Apr 12 06:17:50 user cinder-volume[73792]: INFO cinder.keymgr.migration [None req-b67bb007-df2a-4984-97b9-5a00385eee36 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114801848320', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.manager [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:17:50 user cinder-volume[73792]: INFO cinder.volume.manager [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Driver initialization completed successfully.
Apr 12 06:17:50 user cinder-volume[73792]: INFO cinder.manager [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Initiating service 2 cleanup
Apr 12 06:17:50 user cinder-volume[73792]: INFO cinder.manager [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Service 2 cleanup completed.
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.service [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Creating RPC server for service cinder-volume {{(pid=73792) start /opt/stack/cinder/cinder/service.py:238}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.service [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73792) start /opt/stack/cinder/cinder/service.py:244}}
Apr 12 06:17:50 user cinder-volume[73792]: INFO cinder.volume.manager [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Initializing RPC dependent components of volume driver JovianISCSIDriver (1.0.2)
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:17:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:17:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114801848320', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:17:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:17:51 user cinder-volume[73792]: INFO cinder.volume.manager [None req-35a8373f-8119-4671-a81d-340baa83ace2 None None] Driver post RPC initialization completed successfully.
Apr 12 06:17:58 user cinder-volume[73692]: DEBUG dbcounter [-] [73692] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=73692) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:18:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:18:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=24,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:18:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:18:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:18:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:19:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:19:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:19:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:19:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:19:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:19:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:19:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:19:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114801836032', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:19:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:19:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:19:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:19:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:20:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:20:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:20:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:20:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:20:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:20:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:20:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:20:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114801836032', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:20:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:20:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:20:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:20:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:21:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:21:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:21:27 user cinder-volume[73792]: INFO cinder.volume.manager [None req-290355bd-3ec9-4014-b5e2-ab3d7dcc05ba tempest-GroupsV320Test-683513782 None] Group tempest-GroupsV320Test-Group-1002471826: creating
Apr 12 06:21:27 user cinder-volume[73792]: INFO cinder.volume.manager [None req-290355bd-3ec9-4014-b5e2-ab3d7dcc05ba tempest-GroupsV320Test-683513782 None] Group tempest-GroupsV320Test-Group-1002471826: created successfully
Apr 12 06:21:27 user cinder-volume[73792]: INFO cinder.volume.manager [None req-290355bd-3ec9-4014-b5e2-ab3d7dcc05ba tempest-GroupsV320Test-683513782 None] Create group completed successfully.
Apr 12 06:21:29 user cinder-volume[73792]: DEBUG cinder.quota [None req-767482b5-9e00-45bc-98bb-bb543e9fb07e tempest-GroupsV320Test-683513782 None] Created reservations ['cb521254-4487-4185-af61-a1fe5e2caa7f'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-767482b5-9e00-45bc-98bb-bb543e9fb07e tempest-GroupsV320Test-683513782 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:21:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-767482b5-9e00-45bc-98bb-bb543e9fb07e tempest-GroupsV320Test-683513782 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:21:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-767482b5-9e00-45bc-98bb-bb543e9fb07e tempest-GroupsV320Test-683513782 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-767482b5-9e00-45bc-98bb-bb543e9fb07e tempest-GroupsV320Test-683513782 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:30 user cinder-volume[73792]: INFO cinder.action_track [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-858797954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d15b362a-d144-40e8-b3e8-9c08422cf887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37c12737a4b4ea99cbb996e20a41131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='99d0d24ab54c485eb3f961d35a00258d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-767482b5-9e00-45bc-98bb-bb543e9fb07e tempest-GroupsV320Test-683513782 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801836032', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-767482b5-9e00-45bc-98bb-bb543e9fb07e tempest-GroupsV320Test-683513782 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-767482b5-9e00-45bc-98bb-bb543e9fb07e tempest-GroupsV320Test-683513782 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:21:30 user cinder-volume[73792]: INFO cinder.volume.manager [None req-767482b5-9e00-45bc-98bb-bb543e9fb07e tempest-GroupsV320Test-683513782 None] Delete group completed successfully.
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Flow 'volume_create_manager' (068fac9f-cf6e-4079-940d-1d0c52a535cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ffb4abf-9e00-449d-b6be-3fc64fed14d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ffb4abf-9e00-449d-b6be-3fc64fed14d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-858797954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d15b362a-d144-40e8-b3e8-9c08422cf887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37c12737a4b4ea99cbb996e20a41131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:21:30Z,use_quota=True,user_id='99d0d24ab54c485eb3f961d35a00258d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22196958-e4fc-4876-8096-a9d86dca73fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22196958-e4fc-4876-8096-a9d86dca73fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9667dc-23c3-4046-9e25-7c3dc07ac45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9667dc-23c3-4046-9e25-7c3dc07ac45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15b362a-d144-40e8-b3e8-9c08422cf887', 'volume_name': 'volume-d15b362a-d144-40e8-b3e8-9c08422cf887', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577a7243-212e-4b5f-9ea8-dddbcfdb6f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577a7243-212e-4b5f-9ea8-dddbcfdb6f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f10ef8-e025-47f6-a6f7-6eba75216cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:30 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Volume d15b362a-d144-40e8-b3e8-9c08422cf887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15b362a-d144-40e8-b3e8-9c08422cf887', 'volume_size': 1}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] creating volume v_d15b362a-d144-40e8-b3e8-9c08422cf887. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] create volume {'name': 'v_d15b362a-d144-40e8-b3e8-9c08422cf887', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d15b362a-d144-40e8-b3e8-9c08422cf887', 'is_clone': False, 'name': 'v_d15b362a-d144-40e8-b3e8-9c08422cf887'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f10ef8-e025-47f6-a6f7-6eba75216cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15b362a-d144-40e8-b3e8-9c08422cf887', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f1564a-a596-4270-8484-82254322452a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:30 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Volume volume-d15b362a-d144-40e8-b3e8-9c08422cf887 (d15b362a-d144-40e8-b3e8-9c08422cf887): created successfully
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f1564a-a596-4270-8484-82254322452a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] Flow 'volume_create_manager' (068fac9f-cf6e-4079-940d-1d0c52a535cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:30 user cinder-volume[73792]: INFO cinder.action_track [None req-3fecaedc-c0ad-4a23-a295-42246b012188 tempest-SnapshotMetadataTestJSON-1988682342 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-858797954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d15b362a-d144-40e8-b3e8-9c08422cf887,launched_at=2023-04-12T06:21:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37c12737a4b4ea99cbb996e20a41131',provider_auth='CHAP kDaLiQbI jMSQvkWowZDHhB',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:21:30Z,use_quota=True,user_id='99d0d24ab54c485eb3f961d35a00258d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114801790976', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:21:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:21:31 user cinder-volume[73792]: INFO cinder.action_track [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Snapshot-95615087',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=90e6cd5d-76c3-4a94-a42e-5ac58dfb8990,metadata={},progress='0%',project_id='e37c12737a4b4ea99cbb996e20a41131',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='99d0d24ab54c485eb3f961d35a00258d',volume=<?>,volume_id=d15b362a-d144-40e8-b3e8-9c08422cf887,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] create snapshot 90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 for volume d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:21:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] cloning v_d15b362a-d144-40e8-b3e8-9c08422cf887 to s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:21:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] create snapshot s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:21:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] create volume s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 from snapshot s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:21:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d15b362a-d144-40e8-b3e8-9c08422cf887@s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990', 'is_clone': True, 'full_name': 'Pool-0/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990', 'name': 's_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] volume s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:21:32 user cinder-volume[73792]: INFO cinder.volume.manager [None req-3899e608-952f-4795-aa00-c2d22371eb3d tempest-SnapshotMetadataTestJSON-1988682342 None] Create snapshot completed successfully
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Acquiring lock "cinder-90e6cd5d-76c3-4a94-a42e-5ac58dfb8990-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Lock "cinder-90e6cd5d-76c3-4a94-a42e-5ac58dfb8990-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] deleating snapshot s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] get snapshots for volume s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] get volume s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d15b362a-d144-40e8-b3e8-9c08422cf887@s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281909', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59650', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4683944364422113023', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f69daba4c6b48e52', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801754112', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '36349', 'name': 's_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] delete snapshot s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 of volume v_d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887/snapshots/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887/snapshots/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887/snapshots/s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] snapshot s_90e6cd5d-76c3-4a94-a42e-5ac58dfb8990 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:21:35 user cinder-volume[73792]: WARNING cinder.quota [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Deprecated: Default quota for resource: gigabytes_joviandss-2 is set by the default quota flag: quota_gigabytes_joviandss-2, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:21:35 user cinder-volume[73792]: WARNING cinder.quota [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Deprecated: Default quota for resource: snapshots_joviandss-2 is set by the default quota flag: quota_snapshots_joviandss-2, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.quota [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Created reservations ['7a5c69a5-b660-4073-a9c6-a92683e2d8c3', '7351c608-197c-4a12-a70c-9297089fe5cf', '823851e7-be4e-4d0a-8e6f-b799da5b1aae', 'b13a026c-b462-4ad7-b203-6095df7de32e'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:35 user cinder-volume[73792]: INFO cinder.volume.manager [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Delete snapshot completed successfully.
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4bbf615a-7394-4e66-a264-812c1a78b05d tempest-SnapshotMetadataTestJSON-1988682342 None] Lock "cinder-90e6cd5d-76c3-4a94-a42e-5ac58dfb8990-delete_snapshot" released by "delete_snapshot" :: held 1.052s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.coordination [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Acquiring lock "cinder-d15b362a-d144-40e8-b3e8-9c08422cf887-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.coordination [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Lock "cinder-d15b362a-d144-40e8-b3e8-9c08422cf887-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] remove_export for volume: d15b362a-d144-40e8-b3e8-9c08422cf887. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-858797954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d15b362a-d144-40e8-b3e8-9c08422cf887,launched_at=2023-04-12T06:21:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37c12737a4b4ea99cbb996e20a41131',provider_auth='CHAP kDaLiQbI jMSQvkWowZDHhB',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:21:35Z,updated_at=2023-04-12T06:21:35Z,use_quota=True,user_id='99d0d24ab54c485eb3f961d35a00258d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] detach volume v_d15b362a-d144-40e8-b3e8-9c08422cf887 from target iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887/luns/v_d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887/luns/v_d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887/luns/v_d15b362a-d144-40e8-b3e8-9c08422cf887'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887/luns/v_d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] failed to remove resource iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 because of JDSS resource v_d15b362a-d144-40e8-b3e8-9c08422cf887 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] delete target: iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] delete target iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] failed to remove resource iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 because of JDSS resource iqn.2010-10.org.openstack:d15b362a-d144-40e8-b3e8-9c08422cf887 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] deleating volume v_d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] get snapshots for volume v_d15b362a-d144-40e8-b3e8-9c08422cf887  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] get volume v_d15b362a-d144-40e8-b3e8-9c08422cf887 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d15b362a-d144-40e8-b3e8-9c08422cf887', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281907', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59644', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2964161164258381896', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8df1c2c373147678', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801766400', 'san:volume_id': '8df1c2c373147678c92655182fc172ba4fef8f3b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36437', 'name': 'v_d15b362a-d144-40e8-b3e8-9c08422cf887', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] delete volume:v_d15b362a-d144-40e8-b3e8-9c08422cf887 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d15b362a-d144-40e8-b3e8-9c08422cf887 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] volume v_d15b362a-d144-40e8-b3e8-9c08422cf887 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:21:38 user cinder-volume[73792]: WARNING cinder.quota [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Deprecated: Default quota for resource: volumes_joviandss-2 is set by the default quota flag: quota_volumes_joviandss-2, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.quota [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Created reservations ['07ad717c-b6dd-4f87-85ea-7bc0a40295e2', '432a96f6-33b9-4280-9b43-a7c5b67f74e5', 'd74d9e94-8496-447b-b411-3e731b7da982', '99cecb68-10a5-4d0c-9133-7585f5e64060'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:38 user cinder-volume[73792]: INFO cinder.action_track [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1065153366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc299b2e-c271-40d5-b3d1-841f0ab3eb1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33a314d42d0460488463989a1a8d652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='764b270bd6a14399b88b1113c7b3cb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Flow 'volume_create_manager' (5a4b05d7-4ad5-4c5e-ae38-8da53b336119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3401833b-9c16-41f2-b7ad-781f0be15e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3401833b-9c16-41f2-b7ad-781f0be15e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1065153366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc299b2e-c271-40d5-b3d1-841f0ab3eb1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33a314d42d0460488463989a1a8d652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:21:38Z,use_quota=True,user_id='764b270bd6a14399b88b1113c7b3cb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda4c0aa-2c1e-44a7-ac13-7532009940cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda4c0aa-2c1e-44a7-ac13-7532009940cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ddeafc-5700-42c8-9069-19462fcfd5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ddeafc-5700-42c8-9069-19462fcfd5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc299b2e-c271-40d5-b3d1-841f0ab3eb1a', 'volume_name': 'volume-fc299b2e-c271-40d5-b3d1-841f0ab3eb1a', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57562329-faff-4796-a9c9-09aa44b0d22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57562329-faff-4796-a9c9-09aa44b0d22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42382ca4-ea72-4202-92ec-fe36b6a7bbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:38 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Volume fc299b2e-c271-40d5-b3d1-841f0ab3eb1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc299b2e-c271-40d5-b3d1-841f0ab3eb1a', 'volume_size': 1}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] creating volume v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] create volume {'name': 'v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801848320', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.manager [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:21:38 user cinder-volume[73792]: INFO cinder.volume.manager [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Deleted volume successfully.
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.coordination [None req-8879991c-8c84-4f87-8ce0-c0ba53a6f360 tempest-SnapshotMetadataTestJSON-1988682342 None] Lock "cinder-d15b362a-d144-40e8-b3e8-9c08422cf887-delete_volume" released by "delete_volume" :: held 3.482s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:21:38 user cinder-volume[73792]: INFO cinder.action_track [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1527160703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7a4bd1f3-3c34-420b-b302-9ff7b7c65363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c596d24b9344d75b69d1f3fc4d40ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='ed40a215050f4766b853e43087bf01cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Flow 'volume_create_manager' (344f35be-8a4c-466a-8a92-6447d1cc1b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbd2f5e-ddc5-461c-a0e4-7ead4257372d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbd2f5e-ddc5-461c-a0e4-7ead4257372d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1527160703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7a4bd1f3-3c34-420b-b302-9ff7b7c65363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c596d24b9344d75b69d1f3fc4d40ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:21:39Z,use_quota=True,user_id='ed40a215050f4766b853e43087bf01cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7520b655-a63f-40f5-81d8-5a73a511d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7520b655-a63f-40f5-81d8-5a73a511d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afeb613-ca9d-42e2-bdba-a93a698dfa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afeb613-ca9d-42e2-bdba-a93a698dfa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a4bd1f3-3c34-420b-b302-9ff7b7c65363', 'volume_name': 'volume-7a4bd1f3-3c34-420b-b302-9ff7b7c65363', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46321921-bbc8-4223-b9e7-75efa4cf0ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46321921-bbc8-4223-b9e7-75efa4cf0ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e9523c-4ef0-4932-a389-482fa924aae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:38 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Volume 7a4bd1f3-3c34-420b-b302-9ff7b7c65363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a4bd1f3-3c34-420b-b302-9ff7b7c65363', 'volume_size': 1}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] creating volume v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] create volume {'name': 'v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a', 'is_clone': False, 'name': 'v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42382ca4-ea72-4202-92ec-fe36b6a7bbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc299b2e-c271-40d5-b3d1-841f0ab3eb1a', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda1b752-740c-4ccb-9c9f-60c68358f96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:39 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Volume volume-fc299b2e-c271-40d5-b3d1-841f0ab3eb1a (fc299b2e-c271-40d5-b3d1-841f0ab3eb1a): created successfully
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda1b752-740c-4ccb-9c9f-60c68358f96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] Flow 'volume_create_manager' (5a4b05d7-4ad5-4c5e-ae38-8da53b336119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:39 user cinder-volume[73792]: INFO cinder.action_track [None req-10257b10-1ef0-41d2-abde-7c33bec54670 tempest-VolumesServicesTestJSON-1383364443 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1065153366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc299b2e-c271-40d5-b3d1-841f0ab3eb1a,launched_at=2023-04-12T06:21:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33a314d42d0460488463989a1a8d652',provider_auth='CHAP VyNhHJSs sdZc7K4Ubr8jom',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:38Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:21:38Z,use_quota=True,user_id='764b270bd6a14399b88b1113c7b3cb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363', 'is_clone': False, 'name': 'v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e9523c-4ef0-4932-a389-482fa924aae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a4bd1f3-3c34-420b-b302-9ff7b7c65363', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85d77dc-b662-42e4-b531-3ffe0be26d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:39 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Volume volume-7a4bd1f3-3c34-420b-b302-9ff7b7c65363 (7a4bd1f3-3c34-420b-b302-9ff7b7c65363): created successfully
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85d77dc-b662-42e4-b531-3ffe0be26d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Flow 'volume_create_manager' (344f35be-8a4c-466a-8a92-6447d1cc1b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:39 user cinder-volume[73792]: INFO cinder.action_track [None req-4e01e4ce-7255-4b52-a645-1a0f1a24dd0f tempest-VolumeQuotasNegativeTestJSON-1802691560 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1527160703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7a4bd1f3-3c34-420b-b302-9ff7b7c65363,launched_at=2023-04-12T06:21:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c596d24b9344d75b69d1f3fc4d40ba4',provider_auth='CHAP sOwqZgbo OlxCFJUmuiDcTq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:21:39Z,use_quota=True,user_id='ed40a215050f4766b853e43087bf01cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Acquiring lock "cinder-fc299b2e-c271-40d5-b3d1-841f0ab3eb1a-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Lock "cinder-fc299b2e-c271-40d5-b3d1-841f0ab3eb1a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=28,cinder:SELECT=66,cinder:INSERT=4,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] remove_export for volume: fc299b2e-c271-40d5-b3d1-841f0ab3eb1a. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1065153366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc299b2e-c271-40d5-b3d1-841f0ab3eb1a,launched_at=2023-04-12T06:21:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33a314d42d0460488463989a1a8d652',provider_auth='CHAP VyNhHJSs sdZc7K4Ubr8jom',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:38Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:21:40Z,updated_at=2023-04-12T06:21:40Z,use_quota=True,user_id='764b270bd6a14399b88b1113c7b3cb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] detach volume v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a from target iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a/luns/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a/luns/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a/luns/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a/luns/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] failed to remove resource iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a because of JDSS resource v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] delete target: iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] delete target iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] failed to remove resource iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a because of JDSS resource iqn.2010-10.org.openstack:fc299b2e-c271-40d5-b3d1-841f0ab3eb1a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] deleating volume v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] get snapshots for volume v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] get volume v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281916', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59659', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5647684578024887562', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'deea9fdee7014685', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801684480', 'san:volume_id': 'deea9fdee7014685a93830e1ea1ee96c1981273a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37150', 'name': 'v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] delete volume:v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Acquiring lock "cinder-7a4bd1f3-3c34-420b-b302-9ff7b7c65363-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Lock "cinder-7a4bd1f3-3c34-420b-b302-9ff7b7c65363-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] remove_export for volume: 7a4bd1f3-3c34-420b-b302-9ff7b7c65363. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1527160703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7a4bd1f3-3c34-420b-b302-9ff7b7c65363,launched_at=2023-04-12T06:21:39Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='8c596d24b9344d75b69d1f3fc4d40ba4',provider_auth='CHAP sOwqZgbo OlxCFJUmuiDcTq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:21:41Z,updated_at=2023-04-12T06:21:41Z,use_quota=True,user_id='ed40a215050f4766b853e43087bf01cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] detach volume v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 from target iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363/luns/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363/luns/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363/luns/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363/luns/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] failed to remove resource iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 because of JDSS resource v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] delete target: iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] delete target iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] failed to remove resource iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 because of JDSS resource iqn.2010-10.org.openstack:7a4bd1f3-3c34-420b-b302-9ff7b7c65363 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] deleating volume v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] get snapshots for volume v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:41 user cinder-volume[73792]: INFO cinder.volume.manager [None req-228d8159-b0ff-4806-8356-f64d9f288820 tempest-GroupSnapshotsTest-2133346524 None] Group tempest-GroupSnapshotsTest-Group-829517485: creating
Apr 12 06:21:41 user cinder-volume[73792]: INFO cinder.volume.manager [None req-228d8159-b0ff-4806-8356-f64d9f288820 tempest-GroupSnapshotsTest-2133346524 None] Group tempest-GroupSnapshotsTest-Group-829517485: created successfully
Apr 12 06:21:41 user cinder-volume[73792]: INFO cinder.volume.manager [None req-228d8159-b0ff-4806-8356-f64d9f288820 tempest-GroupSnapshotsTest-2133346524 None] Create group completed successfully.
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] get volume v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281916', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59663', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9751331501737787512', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ef40b8c01de9e3cd', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801766400', 'san:volume_id': 'ef40b8c01de9e3cdcd75a3bbcd2e40815a87f6ec', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37159', 'name': 'v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] delete volume:v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] volume v_fc299b2e-c271-40d5-b3d1-841f0ab3eb1a deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=66,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=6 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.quota [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Created reservations ['19481947-b2b7-4788-b2e9-1e762d939cc1', '4c98e3a7-68f5-42ea-8ab4-beec57401c3e', '2febeb6b-baf3-4115-9490-cd97a9960dbd', '4c6259e7-2cd9-4814-b83d-93dce5281381'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801766400', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.manager [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:21:42 user cinder-volume[73792]: INFO cinder.volume.manager [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Deleted volume successfully.
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1d8b2763-8751-4c68-89ef-a1eaf5b7519a tempest-VolumesServicesTestJSON-1383364443 None] Lock "cinder-fc299b2e-c271-40d5-b3d1-841f0ab3eb1a-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:21:42 user cinder-volume[73792]: INFO cinder.action_track [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1222953122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1d830937-be1e-43df-afb5-bc0112d33dc3,host='user@joviandss-2#joviandss-2',id=11b9227c-4767-4ff8-93f0-1f5a4cd415c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca43ac18-6065-429c-bfb0-5f9bb64dc5a9),volume_type_id=ca43ac18-6065-429c-bfb0-5f9bb64dc5a9) 
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Flow 'volume_create_manager' (9f3a6af9-a990-4347-92a3-0a23dc55c393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15c7cff-5e23-4bf9-9e0f-868481ae16b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15c7cff-5e23-4bf9-9e0f-868481ae16b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1222953122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1d830937-be1e-43df-afb5-bc0112d33dc3,host='user@joviandss-2#joviandss-2',id=11b9227c-4767-4ff8-93f0-1f5a4cd415c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:21:43Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca43ac18-6065-429c-bfb0-5f9bb64dc5a9),volume_type_id=ca43ac18-6065-429c-bfb0-5f9bb64dc5a9)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb88c8a-302d-4f38-8d87-a4d8d33c887c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb88c8a-302d-4f38-8d87-a4d8d33c887c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cd65c3-29d5-46a4-b206-059185b18af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cd65c3-29d5-46a4-b206-059185b18af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b9227c-4767-4ff8-93f0-1f5a4cd415c6', 'volume_name': 'volume-11b9227c-4767-4ff8-93f0-1f5a4cd415c6', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e7f95f-566d-468e-8429-1fe1a64c16f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e7f95f-566d-468e-8429-1fe1a64c16f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa88bd08-b9a5-46a4-ab41-5a740f772b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:42 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Volume 11b9227c-4767-4ff8-93f0-1f5a4cd415c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b9227c-4767-4ff8-93f0-1f5a4cd415c6', 'volume_size': 1}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] creating volume v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] create volume {'name': 'v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] volume v_7a4bd1f3-3c34-420b-b302-9ff7b7c65363 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.quota [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Created reservations ['ec21cd33-19cb-4945-b54e-18a36e43b256', 'ab9c1619-e015-49dc-b422-a1012ea6822d', '5ec96da0-57b1-44f7-8843-962020c54421', 'a70aecc6-4442-4e5e-8969-ee81f8fc09a4'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6', 'is_clone': False, 'name': 'v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa88bd08-b9a5-46a4-ab41-5a740f772b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b9227c-4767-4ff8-93f0-1f5a4cd415c6', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6a7899-fe82-4241-843e-3191ad90df5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:43 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Volume volume-11b9227c-4767-4ff8-93f0-1f5a4cd415c6 (11b9227c-4767-4ff8-93f0-1f5a4cd415c6): created successfully
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6a7899-fe82-4241-843e-3191ad90df5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] Flow 'volume_create_manager' (9f3a6af9-a990-4347-92a3-0a23dc55c393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:43 user cinder-volume[73792]: INFO cinder.action_track [None req-c908d85e-f2ab-42fa-9bc4-0d521881c70d tempest-GroupSnapshotsTest-2133346524 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1222953122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1d830937-be1e-43df-afb5-bc0112d33dc3,host='user@joviandss-2#joviandss-2',id=11b9227c-4767-4ff8-93f0-1f5a4cd415c6,launched_at=2023-04-12T06:21:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth='CHAP wEMtArKP aSvYQIlWrAgu75',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:43Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:21:43Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca43ac18-6065-429c-bfb0-5f9bb64dc5a9),volume_type_id=ca43ac18-6065-429c-bfb0-5f9bb64dc5a9) 
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801741824', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.manager [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:21:43 user cinder-volume[73792]: INFO cinder.volume.manager [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Deleted volume successfully.
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bae2cd67-f039-443c-96ff-66d416b76d26 tempest-VolumeQuotasNegativeTestJSON-1802691560 None] Lock "cinder-7a4bd1f3-3c34-420b-b302-9ff7b7c65363-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:21:43 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] GroupSnapshot e47743e9-5c95-42c8-a38f-9d10b23bed6a: creating.
Apr 12 06:21:43 user cinder-volume[73792]: INFO cinder.action_track [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1770908715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] Group snapshot e47743e9-5c95-42c8-a38f-9d10b23bed6a: creating. {{(pid=73792) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4160}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (fae2718a-fda3-4395-baac-62c55fd4eed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eaa976-4cac-4050-9f5e-b5c85436442e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eaa976-4cac-4050-9f5e-b5c85436442e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1770908715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:21:44Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e2441c-d7b7-4285-8544-1ec000a840e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e2441c-d7b7-4285-8544-1ec000a840e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54113539-07ec-4b81-badf-137f8907e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54113539-07ec-4b81-badf-137f8907e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5', 'volume_name': 'volume-e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1fbda6-8e5c-4486-bdaf-90bd2497cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1fbda6-8e5c-4486-bdaf-90bd2497cb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a659a626-c9ff-4ee0-b4ee-43c6b59c43ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:44 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Volume e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5', 'volume_size': 1}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] creating volume v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] create volume {'name': 'v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] create snapshot 9bc0a62e-7f51-422c-af1d-ff41fc66e0db for volume 11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] cloning v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 to s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] create snapshot s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5', 'is_clone': False, 'name': 'v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a659a626-c9ff-4ee0-b4ee-43c6b59c43ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72b19a9-af21-4569-8097-9d10871e1977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:44 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Volume volume-e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 (e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5): created successfully
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72b19a9-af21-4569-8097-9d10871e1977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (fae2718a-fda3-4395-baac-62c55fd4eed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:44 user cinder-volume[73792]: INFO cinder.action_track [None req-b0d19387-f47a-401b-8980-166b958a8aa9 tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1770908715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5,launched_at=2023-04-12T06:21:44Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP eLZRvQwJ lGzfgTt8MLVpen',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:44Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:21:44Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_9bc0a62e-7f51-422c-af1d-ff41fc66e0db'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] create volume s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db from snapshot s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6@s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db', 'is_clone': True, 'full_name': 'Pool-0/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db', 'name': 's_9bc0a62e-7f51-422c-af1d-ff41fc66e0db'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] volume s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:21:45 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7526226e-1456-4e7d-8c01-007c84cb894c tempest-GroupSnapshotsTest-2133346524 None] group_snapshot e47743e9-5c95-42c8-a38f-9d10b23bed6a: created successfully
Apr 12 06:21:45 user cinder-volume[73792]: INFO cinder.action_track [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1015288441',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4a6c14f7-6a0f-4a8a-83f4-9b6455757c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (28ce579b-496f-45a3-a962-6ea50d2b44b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350e6198-49be-439a-baab-128400512d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350e6198-49be-439a-baab-128400512d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1015288441',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4a6c14f7-6a0f-4a8a-83f4-9b6455757c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:21:45Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d349134-9989-4535-b86c-6288e99d0365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d349134-9989-4535-b86c-6288e99d0365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063529e0-f42c-4447-9f25-0ecf5e3113d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063529e0-f42c-4447-9f25-0ecf5e3113d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a6c14f7-6a0f-4a8a-83f4-9b6455757c25', 'volume_name': 'volume-4a6c14f7-6a0f-4a8a-83f4-9b6455757c25', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653f6d22-5617-410a-8e85-a5888d71b665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653f6d22-5617-410a-8e85-a5888d71b665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27eda2df-a3ca-4ad6-a87a-7bc2c35283df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:45 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Volume 4a6c14f7-6a0f-4a8a-83f4-9b6455757c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a6c14f7-6a0f-4a8a-83f4-9b6455757c25', 'volume_size': 1}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] creating volume v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] create volume {'name': 'v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25', 'is_clone': False, 'name': 'v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27eda2df-a3ca-4ad6-a87a-7bc2c35283df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a6c14f7-6a0f-4a8a-83f4-9b6455757c25', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fae1ef-ffcd-4959-8755-e1d0054ed2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:46 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Volume volume-4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 (4a6c14f7-6a0f-4a8a-83f4-9b6455757c25): created successfully
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fae1ef-ffcd-4959-8755-e1d0054ed2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (28ce579b-496f-45a3-a962-6ea50d2b44b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:46 user cinder-volume[73792]: INFO cinder.action_track [None req-a70281b7-e05a-4660-8625-551c42955d0b tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1015288441',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4a6c14f7-6a0f-4a8a-83f4-9b6455757c25,launched_at=2023-04-12T06:21:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP AiqEZHPd U7KNVawRI8lHDz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:45Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:21:45Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.coordination [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Acquiring lock "cinder-4a6c14f7-6a0f-4a8a-83f4-9b6455757c25-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.coordination [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Lock "cinder-4a6c14f7-6a0f-4a8a-83f4-9b6455757c25-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] remove_export for volume: 4a6c14f7-6a0f-4a8a-83f4-9b6455757c25. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1770908715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4a6c14f7-6a0f-4a8a-83f4-9b6455757c25,launched_at=2023-04-12T06:21:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP AiqEZHPd U7KNVawRI8lHDz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:45Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:21:46Z,updated_at=2023-04-12T06:21:46Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] detach volume v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 from target iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25/luns/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25/luns/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25/luns/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25/luns/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 because of JDSS resource v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] delete target: iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] delete target iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] create volume 34fef1cb-a81f-43d5-9180-5239fd5243f8 from snapshot 9bc0a62e-7f51-422c-af1d-ff41fc66e0db {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] cloning s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db to v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] create snapshot v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 because of JDSS resource iqn.2010-10.org.openstack:4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] deleating volume v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] get snapshots for volume v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] get volume v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281923', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59683', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18046419115399876842', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '791ca0a06ad4ac1a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801577984', 'san:volume_id': '791ca0a06ad4ac1a180d6305f2278e607cfda9f0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37272', 'name': 'v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] delete volume:v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_34fef1cb-a81f-43d5-9180-5239fd5243f8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] create volume v_34fef1cb-a81f-43d5-9180-5239fd5243f8 from snapshot v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:21:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db@v_34fef1cb-a81f-43d5-9180-5239fd5243f8', 'is_clone': True, 'full_name': 'Pool-0/v_34fef1cb-a81f-43d5-9180-5239fd5243f8', 'name': 'v_34fef1cb-a81f-43d5-9180-5239fd5243f8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] get volume v_34fef1cb-a81f-43d5-9180-5239fd5243f8 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db@v_34fef1cb-a81f-43d5-9180-5239fd5243f8', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_34fef1cb-a81f-43d5-9180-5239fd5243f8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281924', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59689', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1486220712733369791', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7e0bb66fae434eb0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801635328', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '36051', 'name': 'v_34fef1cb-a81f-43d5-9180-5239fd5243f8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:47 user cinder-volume[73792]: INFO cinder.volume.manager [None req-e87e3f79-02b9-44be-b7df-bca3c9323ac0 tempest-GroupSnapshotsTest-2133346524 None] Create group from source-snapshot-e47743e9-5c95-42c8-a38f-9d10b23bed6a completed successfully.
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] volume v_4a6c14f7-6a0f-4a8a-83f4-9b6455757c25 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.quota [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Created reservations ['b47ee906-8b84-488f-a464-d4fce7489f90', 'c9f45cb7-bf8a-400c-bd3e-c1baea0189b4', '405bf106-5de2-40d8-bcf6-125640b81b2d', '8f61348d-603a-4329-aac4-d987184dc3a3'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=62,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=59,cinder:UPDATE=33,cinder:DELETE=4,cinder:INSERT=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] remove_export for volume: 34fef1cb-a81f-43d5-9180-5239fd5243f8. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ec6b9d1f-1168-4d13-b81c-fff4d74d9367,host='user@joviandss-2#joviandss-2',id=34fef1cb-a81f-43d5-9180-5239fd5243f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth='CHAP haDkfmvK OQvGTtkARXhgHy',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=1,snapshot_id=9bc0a62e-7f51-422c-af1d-ff41fc66e0db,snapshots=<?>,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-12T06:21:48Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca43ac18-6065-429c-bfb0-5f9bb64dc5a9),volume_type_id=ca43ac18-6065-429c-bfb0-5f9bb64dc5a9) from target:iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] detach volume v_34fef1cb-a81f-43d5-9180-5239fd5243f8 from target iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8/luns/v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8/luns/v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8/luns/v_34fef1cb-a81f-43d5-9180-5239fd5243f8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8/luns/v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] failed to remove resource iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8 because of JDSS resource v_34fef1cb-a81f-43d5-9180-5239fd5243f8 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] delete target: iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] delete target iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] failed to remove resource iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8 because of JDSS resource iqn.2010-10.org.openstack:34fef1cb-a81f-43d5-9180-5239fd5243f8 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] deleating volume v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] get snapshots for volume v_34fef1cb-a81f-43d5-9180-5239fd5243f8  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34fef1cb-a81f-43d5-9180-5239fd5243f8/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34fef1cb-a81f-43d5-9180-5239fd5243f8/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34fef1cb-a81f-43d5-9180-5239fd5243f8/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] get volume v_34fef1cb-a81f-43d5-9180-5239fd5243f8 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.coordination [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Acquiring lock "cinder-e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.coordination [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Lock "cinder-e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db@v_34fef1cb-a81f-43d5-9180-5239fd5243f8', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_34fef1cb-a81f-43d5-9180-5239fd5243f8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281924', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59689', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1486220712733369791', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7e0bb66fae434eb0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801635328', 'san:volume_id': '7e0bb66fae434eb099667b984a558507443c4c73', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '36051', 'name': 'v_34fef1cb-a81f-43d5-9180-5239fd5243f8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] delete snapshot v_34fef1cb-a81f-43d5-9180-5239fd5243f8 of volume s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/snapshots/v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/snapshots/v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] remove_export for volume: e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:43Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-178749213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5,launched_at=2023-04-12T06:21:44Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP eLZRvQwJ lGzfgTt8MLVpen',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:44Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:21:49Z,updated_at=2023-04-12T06:21:49Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] detach volume v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 from target iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5/luns/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5/luns/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5/luns/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5/luns/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 because of JDSS resource v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] delete target: iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] delete target iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801635328', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.manager [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 because of JDSS resource iqn.2010-10.org.openstack:e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] deleating volume v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] get snapshots for volume v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:48 user cinder-volume[73792]: INFO cinder.volume.manager [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Deleted volume successfully.
Apr 12 06:21:48 user cinder-volume[73792]: DEBUG cinder.coordination [None req-296c40ca-cb70-4c70-a810-67f2e9c22981 tempest-VolumesGetTest-136869643 None] Lock "cinder-4a6c14f7-6a0f-4a8a-83f4-9b6455757c25-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] get volume v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281921', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59674', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3345501987679117772', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '46c8c8a12983ac15', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801635328', 'san:volume_id': '46c8c8a12983ac15876ff73a372011a4b02e7a8a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36140', 'name': 'v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] delete volume:v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/snapshots/v_34fef1cb-a81f-43d5-9180-5239fd5243f8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] snapshot v_34fef1cb-a81f-43d5-9180-5239fd5243f8 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.quota [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['8760f1b7-f381-4c5f-8d9b-8f5f5bc8a741'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:49 user cinder-volume[73792]: WARNING cinder.quota [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1808845331 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1808845331, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:21:49 user cinder-volume[73792]: WARNING cinder.quota [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1808845331 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1808845331, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.quota [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['24983218-46cc-46ad-98cb-4823883189c5', '8b7d698b-fc3d-42b1-b022-8ed42e4129cf', 'e0cd7581-215f-4d43-b09e-20e7b527872e', '56348729-eefc-4a43-b6ae-c6516d07101b'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:50 user cinder-volume[73792]: INFO cinder.action_track [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-739528468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=45bd801b-2b15-4505-84ec-44ff56dac3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe56066d1e74aa8832def1a45b0159e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='92e14b7aead14246ac757a5e231d75ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Flow 'volume_create_manager' (c08f0ade-37e8-499d-b07d-8e73222dad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1f5847-79c0-49c6-a871-a031a39d0dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1f5847-79c0-49c6-a871-a031a39d0dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-739528468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=45bd801b-2b15-4505-84ec-44ff56dac3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe56066d1e74aa8832def1a45b0159e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:21:50Z,use_quota=True,user_id='92e14b7aead14246ac757a5e231d75ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c71482-e83e-4d1c-8e44-85c5f652ff2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c71482-e83e-4d1c-8e44-85c5f652ff2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe9eda8-ecc5-4238-a204-70ff2f0d3b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe9eda8-ecc5-4238-a204-70ff2f0d3b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45bd801b-2b15-4505-84ec-44ff56dac3f0', 'volume_name': 'volume-45bd801b-2b15-4505-84ec-44ff56dac3f0', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fd67e8-73d1-439c-a259-6bc2a583324c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fd67e8-73d1-439c-a259-6bc2a583324c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef8b0eb-5dc3-4f2d-aa23-021081099971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:50 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Volume 45bd801b-2b15-4505-84ec-44ff56dac3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45bd801b-2b15-4505-84ec-44ff56dac3f0', 'volume_size': 1}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] creating volume v_45bd801b-2b15-4505-84ec-44ff56dac3f0. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] create volume {'name': 'v_45bd801b-2b15-4505-84ec-44ff56dac3f0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] volume v_e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.quota [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Created reservations ['4cea5b79-91cc-4207-8288-0e29c015c30e', '7fe37e7a-e3a0-48e1-b0f8-071e39fa5a04', 'b1fee71a-c5d9-479e-acec-2b79f191e2f5', '7d880cca-77e6-4aa9-b649-d6c292e1a21a'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801741824', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.manager [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:21:50 user cinder-volume[73792]: INFO cinder.volume.manager [None req-3fe813b1-8d6e-4864-a1c5-df7ef0dea326 tempest-GroupSnapshotsTest-2133346524 None] Delete group completed successfully.
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:50 user cinder-volume[73792]: INFO cinder.volume.manager [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] group_snapshot e47743e9-5c95-42c8-a38f-9d10b23bed6a: deleting
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_45bd801b-2b15-4505-84ec-44ff56dac3f0', 'is_clone': False, 'name': 'v_45bd801b-2b15-4505-84ec-44ff56dac3f0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] group_snapshot e47743e9-5c95-42c8-a38f-9d10b23bed6a: deleting {{(pid=73792) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4335}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef8b0eb-5dc3-4f2d-aa23-021081099971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45bd801b-2b15-4505-84ec-44ff56dac3f0', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5072d5be-3904-409f-bac7-3f772191b093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] deleating snapshot s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] get snapshots for volume s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:50 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Volume volume-45bd801b-2b15-4505-84ec-44ff56dac3f0 (45bd801b-2b15-4505-84ec-44ff56dac3f0): created successfully
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5072d5be-3904-409f-bac7-3f772191b093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] Flow 'volume_create_manager' (c08f0ade-37e8-499d-b07d-8e73222dad3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:50 user cinder-volume[73792]: INFO cinder.action_track [None req-7b52089d-624e-420b-8d53-b3873ef8ddc8 tempest-AbsoluteLimitsTests-1676885475 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-739528468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=45bd801b-2b15-4505-84ec-44ff56dac3f0,launched_at=2023-04-12T06:21:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe56066d1e74aa8832def1a45b0159e',provider_auth='CHAP ILkgpcHS XWhrnRCt0coJ79',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:50Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:21:50Z,use_quota=True,user_id='92e14b7aead14246ac757a5e231d75ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] get volume s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6@s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281922', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59679', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13934279253429898416', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f75b7e767cf8fa84', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801647616', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37260', 'name': 's_9bc0a62e-7f51-422c-af1d-ff41fc66e0db', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] delete snapshot s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db of volume v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6/snapshots/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6/snapshots/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801647616', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.manager [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:21:51 user cinder-volume[73792]: INFO cinder.volume.manager [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Deleted volume successfully.
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.coordination [None req-900e7058-ef63-4277-bf42-ce0547db1553 tempest-VolumesGetTest-136869643 None] Lock "cinder-e2d6fe7a-0aaf-42eb-9f63-324074c6bbb5-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:21:51 user cinder-volume[73792]: INFO cinder.action_track [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-910515731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=667d4fd9-e499-4293-b4be-7dfd67633f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Acquiring lock "cinder-45bd801b-2b15-4505-84ec-44ff56dac3f0-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (71ecc966-6114-4eb8-b966-c16d0dd14519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bad0984-bf01-4dd0-9fc0-f4866e7b7702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Lock "cinder-45bd801b-2b15-4505-84ec-44ff56dac3f0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bad0984-bf01-4dd0-9fc0-f4866e7b7702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-910515731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=667d4fd9-e499-4293-b4be-7dfd67633f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:21:51Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b9bc04-ceff-4e18-b1df-99b03a9284ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b9bc04-ceff-4e18-b1df-99b03a9284ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc36a2c3-ef82-4783-886f-fe6d302d2a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc36a2c3-ef82-4783-886f-fe6d302d2a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '667d4fd9-e499-4293-b4be-7dfd67633f8d', 'volume_name': 'volume-667d4fd9-e499-4293-b4be-7dfd67633f8d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45c325d-58be-4476-8a82-693575b57110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45c325d-58be-4476-8a82-693575b57110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c66c0d-bf98-43a3-9aae-c3c41523c11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:51 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Volume 667d4fd9-e499-4293-b4be-7dfd67633f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-667d4fd9-e499-4293-b4be-7dfd67633f8d', 'volume_size': 1}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] creating volume v_667d4fd9-e499-4293-b4be-7dfd67633f8d. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] create volume {'name': 'v_667d4fd9-e499-4293-b4be-7dfd67633f8d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] remove_export for volume: 45bd801b-2b15-4505-84ec-44ff56dac3f0. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-739528468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=45bd801b-2b15-4505-84ec-44ff56dac3f0,launched_at=2023-04-12T06:21:51Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe56066d1e74aa8832def1a45b0159e',provider_auth='CHAP ILkgpcHS XWhrnRCt0coJ79',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:50Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:21:51Z,updated_at=2023-04-12T06:21:51Z,use_quota=True,user_id='92e14b7aead14246ac757a5e231d75ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] detach volume v_45bd801b-2b15-4505-84ec-44ff56dac3f0 from target iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0/luns/v_45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0/luns/v_45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0/luns/v_45bd801b-2b15-4505-84ec-44ff56dac3f0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0/luns/v_45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] failed to remove resource iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 because of JDSS resource v_45bd801b-2b15-4505-84ec-44ff56dac3f0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] delete target: iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] delete target iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] failed to remove resource iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 because of JDSS resource iqn.2010-10.org.openstack:45bd801b-2b15-4505-84ec-44ff56dac3f0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] deleating volume v_45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] get snapshots for volume v_45bd801b-2b15-4505-84ec-44ff56dac3f0  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45bd801b-2b15-4505-84ec-44ff56dac3f0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45bd801b-2b15-4505-84ec-44ff56dac3f0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45bd801b-2b15-4505-84ec-44ff56dac3f0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] get volume v_45bd801b-2b15-4505-84ec-44ff56dac3f0 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_45bd801b-2b15-4505-84ec-44ff56dac3f0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281927', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59698', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1700010194202458575', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0ed929b01c6ac003', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801565696', 'san:volume_id': '0ed929b01c6ac003cc743d580b946f5e80c01ba9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37283', 'name': 'v_45bd801b-2b15-4505-84ec-44ff56dac3f0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] delete volume:v_45bd801b-2b15-4505-84ec-44ff56dac3f0 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6/snapshots/s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] snapshot s_9bc0a62e-7f51-422c-af1d-ff41fc66e0db deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_667d4fd9-e499-4293-b4be-7dfd67633f8d', 'is_clone': False, 'name': 'v_667d4fd9-e499-4293-b4be-7dfd67633f8d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c66c0d-bf98-43a3-9aae-c3c41523c11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667d4fd9-e499-4293-b4be-7dfd67633f8d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d73ca05-1072-436e-92e4-d0c2d236f917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:52 user cinder-volume[73792]: WARNING cinder.quota [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1808845331 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1808845331, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:21:52 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Volume volume-667d4fd9-e499-4293-b4be-7dfd67633f8d (667d4fd9-e499-4293-b4be-7dfd67633f8d): created successfully
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d73ca05-1072-436e-92e4-d0c2d236f917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (71ecc966-6114-4eb8-b966-c16d0dd14519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.quota [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['edae3044-807d-4bd0-9cdf-530d3dc13a4f', 'ca914b63-aa98-4299-ad52-bafffe648a17', '89c023fc-0a9b-4ebb-85c7-65ffad1e160a', '00535cd2-3e76-42c4-a013-41b1b38682c0'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:52 user cinder-volume[73792]: INFO cinder.action_track [None req-790f778b-6cde-4945-9558-d4ce735f072f tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-910515731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=667d4fd9-e499-4293-b4be-7dfd67633f8d,launched_at=2023-04-12T06:21:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP zlwqrSon BCReFniNj2cT4D',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:51Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:21:51Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=58,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=6 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=62,cinder:INSERT=7,cinder:UPDATE=31 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:21:52 user cinder-volume[73792]: INFO cinder.volume.manager [None req-fd2bed99-7b8e-478e-845f-0d77b8b66c0c tempest-GroupSnapshotsTest-2133346524 None] group_snapshot e47743e9-5c95-42c8-a38f-9d10b23bed6a: deleted successfully
Apr 12 06:21:52 user cinder-volume[73792]: INFO cinder.action_track [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1295239657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4f9af040-900d-4054-b86a-1b899bfbf0c4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=667d4fd9-e499-4293-b4be-7dfd67633f8d,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (070c34b8-d334-4fd6-b9f1-b115cb934b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbb2e24-4954-406d-a6ad-98e2a9f4fada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbb2e24-4954-406d-a6ad-98e2a9f4fada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1295239657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4f9af040-900d-4054-b86a-1b899bfbf0c4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=667d4fd9-e499-4293-b4be-7dfd67633f8d,status='creating',terminated_at=None,updated_at=2023-04-12T06:21:53Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e0d1cb-4269-4d98-9564-b7fafc7b0207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e0d1cb-4269-4d98-9564-b7fafc7b0207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de71aaa-777b-440d-b3f2-387796184f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de71aaa-777b-440d-b3f2-387796184f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4f9af040-900d-4054-b86a-1b899bfbf0c4', 'volume_name': 'volume-4f9af040-900d-4054-b86a-1b899bfbf0c4', 'volume_size': 1, 'source_volid': '667d4fd9-e499-4293-b4be-7dfd67633f8d', 'source_volstatus': 'available'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f262b8d4-c11a-4e62-9afc-cfc7e7f10623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f262b8d4-c11a-4e62-9afc-cfc7e7f10623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab7045b-d21f-4a57-a5c5-393010dc11b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:52 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Volume 4f9af040-900d-4054-b86a-1b899bfbf0c4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4f9af040-900d-4054-b86a-1b899bfbf0c4', 'volume_size': 1, 'source_volid': '667d4fd9-e499-4293-b4be-7dfd67633f8d', 'source_volstatus': 'available'}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] cloned volume 667d4fd9-e499-4293-b4be-7dfd67633f8d to 4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] cloning v_667d4fd9-e499-4293-b4be-7dfd67633f8d to v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] create snapshot v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45bd801b-2b15-4505-84ec-44ff56dac3f0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] volume v_45bd801b-2b15-4505-84ec-44ff56dac3f0 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.quota [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Created reservations ['476d8703-9dbf-486b-ba99-ca294e1fbec2', 'f3b7976a-ea26-4e65-8267-c0f4ac840414', '7f0b2270-7b08-4684-9c35-0f09bdc33b0c', '573c8bde-9b42-4c1d-9d46-1c6fd585a34a'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] remove_export for volume: 11b9227c-4767-4ff8-93f0-1f5a4cd415c6. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1222953122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1d830937-be1e-43df-afb5-bc0112d33dc3,host='user@joviandss-2#joviandss-2',id=11b9227c-4767-4ff8-93f0-1f5a4cd415c6,launched_at=2023-04-12T06:21:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth='CHAP wEMtArKP aSvYQIlWrAgu75',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:43Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-12T06:21:53Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca43ac18-6065-429c-bfb0-5f9bb64dc5a9),volume_type_id=ca43ac18-6065-429c-bfb0-5f9bb64dc5a9) from target:iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] detach volume v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 from target iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6/luns/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6/luns/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6/luns/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6/luns/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] failed to remove resource iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 because of JDSS resource v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] delete target: iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] delete target iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_4f9af040-900d-4054-b86a-1b899bfbf0c4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] create volume v_4f9af040-900d-4054-b86a-1b899bfbf0c4 from snapshot v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] failed to remove resource iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 because of JDSS resource iqn.2010-10.org.openstack:11b9227c-4767-4ff8-93f0-1f5a4cd415c6 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] deleating volume v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] get snapshots for volume v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] get volume v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281920', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59669', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14971144064462127595', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ad3b7e8fc1bc72d4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801598464', 'san:volume_id': 'ad3b7e8fc1bc72d417e87cad3d2d4776144f601b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37172', 'name': 'v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] delete volume:v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801635328', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.manager [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:21:53 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Deleted volume successfully.
Apr 12 06:21:53 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a6ce8e0b-d89d-4e5e-9d58-48ce66d2e817 tempest-AbsoluteLimitsTests-1676885475 None] Lock "cinder-45bd801b-2b15-4505-84ec-44ff56dac3f0-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:21:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_667d4fd9-e499-4293-b4be-7dfd67633f8d@v_4f9af040-900d-4054-b86a-1b899bfbf0c4', 'is_clone': True, 'full_name': 'Pool-0/v_4f9af040-900d-4054-b86a-1b899bfbf0c4', 'name': 'v_4f9af040-900d-4054-b86a-1b899bfbf0c4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] get volume v_4f9af040-900d-4054-b86a-1b899bfbf0c4 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_667d4fd9-e499-4293-b4be-7dfd67633f8d@v_4f9af040-900d-4054-b86a-1b899bfbf0c4', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4f9af040-900d-4054-b86a-1b899bfbf0c4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281931', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59713', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8816032449035671553', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'efe80ce7f57bec5b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801598464', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37016', 'name': 'v_4f9af040-900d-4054-b86a-1b899bfbf0c4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab7045b-d21f-4a57-a5c5-393010dc11b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f9af040-900d-4054-b86a-1b899bfbf0c4', 'volume_size': 1, 'source_volid': '667d4fd9-e499-4293-b4be-7dfd67633f8d', 'source_volstatus': 'available'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d170b555-9b77-4d33-ab74-5d602cf9f059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:54 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Volume volume-4f9af040-900d-4054-b86a-1b899bfbf0c4 (4f9af040-900d-4054-b86a-1b899bfbf0c4): created successfully
Apr 12 06:21:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d170b555-9b77-4d33-ab74-5d602cf9f059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (070c34b8-d334-4fd6-b9f1-b115cb934b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:54 user cinder-volume[73792]: INFO cinder.action_track [None req-8cbf1b0e-b760-4ca5-8346-cbf2cbcc970c tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1295239657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4f9af040-900d-4054-b86a-1b899bfbf0c4,launched_at=2023-04-12T06:21:54Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP pElhIHbu 3xKXGhHgE9Vjtv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:53Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=667d4fd9-e499-4293-b4be-7dfd67633f8d,status='available',terminated_at=None,updated_at=2023-04-12T06:21:53Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] volume v_11b9227c-4767-4ff8-93f0-1f5a4cd415c6 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.quota [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['0fa2bab0-3ffa-4457-a8ec-8d0cf32a1b30'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:55 user cinder-volume[73792]: WARNING cinder.db.sqlalchemy.api [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1808845331']
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.quota [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['f8882dc8-b91c-4e74-baab-909d831d721b', 'a4d9e5b3-9b21-4489-80d1-994581f2d8d2', '8792e769-8a63-45a7-9849-69741e66c9f2', '013a098d-e04d-46bd-9851-973bff514318'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:55 user cinder-volume[73792]: INFO cinder.action_track [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-279712990',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (7824a499-6011-4a43-9fb6-7cca2002e15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a710dc2-b3a9-4f43-b82e-4af17003c3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a710dc2-b3a9-4f43-b82e-4af17003c3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-279712990',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:21:56Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad83c355-d7ef-486d-98de-d6674e920f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad83c355-d7ef-486d-98de-d6674e920f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31950ed5-641b-4687-b8fc-f4cced61f038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31950ed5-641b-4687-b8fc-f4cced61f038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2', 'volume_name': 'volume-0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8b41a1-2eaf-4d3d-a882-ac41f593c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8b41a1-2eaf-4d3d-a882-ac41f593c984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b54d853-3bb1-4a84-8016-08f90c593e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:55 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Volume 0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2', 'volume_size': 1}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] creating volume v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] create volume {'name': 'v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801680384', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.manager [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:21:56 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c9a4fa5a-a98a-4fa4-af64-d67aa226b934 tempest-GroupSnapshotsTest-2133346524 None] Delete group completed successfully.
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2', 'is_clone': False, 'name': 'v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b54d853-3bb1-4a84-8016-08f90c593e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6889266-e08c-479c-950b-e174ee5ef69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:56 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Volume volume-0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 (0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2): created successfully
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6889266-e08c-479c-950b-e174ee5ef69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (7824a499-6011-4a43-9fb6-7cca2002e15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:56 user cinder-volume[73792]: INFO cinder.volume.manager [None req-4004d166-68b8-46b9-9afe-4841fe19e086 tempest-GroupSnapshotsTest-2133346524 None] Group tempest-GroupSnapshotsTest-Group-585606510: creating
Apr 12 06:21:56 user cinder-volume[73792]: INFO cinder.action_track [None req-fbef8cd4-2ac7-4397-9bae-0fe474c9cdd2 tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-279712990',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2,launched_at=2023-04-12T06:21:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP CnBiZzjI lOh9poMZPs73CL',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:56Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:21:56Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:21:56 user cinder-volume[73792]: INFO cinder.volume.manager [None req-4004d166-68b8-46b9-9afe-4841fe19e086 tempest-GroupSnapshotsTest-2133346524 None] Group tempest-GroupSnapshotsTest-Group-585606510: created successfully
Apr 12 06:21:56 user cinder-volume[73792]: INFO cinder.volume.manager [None req-4004d166-68b8-46b9-9afe-4841fe19e086 tempest-GroupSnapshotsTest-2133346524 None] Create group completed successfully.
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.coordination [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Acquiring lock "cinder-0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.coordination [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Lock "cinder-0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] remove_export for volume: 0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1295239657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2,launched_at=2023-04-12T06:21:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP CnBiZzjI lOh9poMZPs73CL',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:56Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:21:57Z,updated_at=2023-04-12T06:21:57Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] detach volume v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 from target iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2/luns/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2/luns/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2/luns/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2/luns/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 because of JDSS resource v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] delete target: iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] delete target iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 because of JDSS resource iqn.2010-10.org.openstack:0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] deleating volume v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] get snapshots for volume v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] get volume v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281933', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59718', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '666939908081078258', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c15f67ed633e376f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801573888', 'san:volume_id': 'c15f67ed633e376f37a59679c0109bce5dbd11f4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37296', 'name': 'v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] delete volume:v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:57 user cinder-volume[73792]: INFO cinder.action_track [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1521546314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cc11c7ad-651f-43ba-9a0b-0a31531684aa,host='user@joviandss-2#joviandss-2',id=d85f4406-7d66-4c5b-8518-63722c8822b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389a12e1-c731-4334-80b0-bb8f514634b1),volume_type_id=389a12e1-c731-4334-80b0-bb8f514634b1) 
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Flow 'volume_create_manager' (e4071844-205c-47dc-b854-e37d48e55c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecc37f0-1bbc-49c0-9473-999c32c3ba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecc37f0-1bbc-49c0-9473-999c32c3ba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1521546314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cc11c7ad-651f-43ba-9a0b-0a31531684aa,host='user@joviandss-2#joviandss-2',id=d85f4406-7d66-4c5b-8518-63722c8822b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:21:58Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389a12e1-c731-4334-80b0-bb8f514634b1),volume_type_id=389a12e1-c731-4334-80b0-bb8f514634b1)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8798a0fb-81fa-4cd9-8a87-13f15b5d81a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8798a0fb-81fa-4cd9-8a87-13f15b5d81a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d00cc0-2807-4006-a4c3-b2111170bf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d00cc0-2807-4006-a4c3-b2111170bf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd85f4406-7d66-4c5b-8518-63722c8822b0', 'volume_name': 'volume-d85f4406-7d66-4c5b-8518-63722c8822b0', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a65b4f-f9d0-4d60-b873-97f3868b6b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a65b4f-f9d0-4d60-b873-97f3868b6b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94879428-b020-4d71-b211-ce2df8adf224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:57 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Volume d85f4406-7d66-4c5b-8518-63722c8822b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d85f4406-7d66-4c5b-8518-63722c8822b0', 'volume_size': 1}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] creating volume v_d85f4406-7d66-4c5b-8518-63722c8822b0. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] create volume {'name': 'v_d85f4406-7d66-4c5b-8518-63722c8822b0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d85f4406-7d66-4c5b-8518-63722c8822b0', 'is_clone': False, 'name': 'v_d85f4406-7d66-4c5b-8518-63722c8822b0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94879428-b020-4d71-b211-ce2df8adf224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d85f4406-7d66-4c5b-8518-63722c8822b0', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06c3410-2189-4a79-80d4-5b97382740d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:58 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Volume volume-d85f4406-7d66-4c5b-8518-63722c8822b0 (d85f4406-7d66-4c5b-8518-63722c8822b0): created successfully
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06c3410-2189-4a79-80d4-5b97382740d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] Flow 'volume_create_manager' (e4071844-205c-47dc-b854-e37d48e55c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:58 user cinder-volume[73792]: INFO cinder.action_track [None req-cd11d225-df0d-47fd-968d-9a06894cd6f6 tempest-GroupSnapshotsTest-2133346524 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1521546314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cc11c7ad-651f-43ba-9a0b-0a31531684aa,host='user@joviandss-2#joviandss-2',id=d85f4406-7d66-4c5b-8518-63722c8822b0,launched_at=2023-04-12T06:21:58Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth='CHAP objOfyix SI2j06wDEicteA',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:58Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:21:58Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389a12e1-c731-4334-80b0-bb8f514634b1),volume_type_id=389a12e1-c731-4334-80b0-bb8f514634b1) 
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] volume v_0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG cinder.quota [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Created reservations ['ebc32ab7-ba5a-4d39-a9f7-c7d0daf5e911', 'c2339f82-1bc9-4052-8c18-94434c05e06c', '85e74c64-bd63-44e1-819a-42e444020a50', '626b9dc0-1425-45d4-96fe-43ac38a5816d'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=58,cinder:UPDATE=30,cinder:INSERT=9,cinder:DELETE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Acquiring lock "cinder-4f9af040-900d-4054-b86a-1b899bfbf0c4-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Lock "cinder-4f9af040-900d-4054-b86a-1b899bfbf0c4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=60,cinder:UPDATE=35,cinder:INSERT=4,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] remove_export for volume: 4f9af040-900d-4054-b86a-1b899bfbf0c4. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:53Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-1716774113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4f9af040-900d-4054-b86a-1b899bfbf0c4,launched_at=2023-04-12T06:21:54Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP pElhIHbu 3xKXGhHgE9Vjtv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:53Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=667d4fd9-e499-4293-b4be-7dfd67633f8d,status='deleting',terminated_at=2023-04-12T06:21:59Z,updated_at=2023-04-12T06:21:59Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] detach volume v_4f9af040-900d-4054-b86a-1b899bfbf0c4 from target iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4/luns/v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4/luns/v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4/luns/v_4f9af040-900d-4054-b86a-1b899bfbf0c4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4/luns/v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 because of JDSS resource v_4f9af040-900d-4054-b86a-1b899bfbf0c4 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] delete target: iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] delete target iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 because of JDSS resource iqn.2010-10.org.openstack:4f9af040-900d-4054-b86a-1b899bfbf0c4 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] deleating volume v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] get snapshots for volume v_4f9af040-900d-4054-b86a-1b899bfbf0c4  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f9af040-900d-4054-b86a-1b899bfbf0c4/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f9af040-900d-4054-b86a-1b899bfbf0c4/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801598464', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.manager [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:21:59 user cinder-volume[73792]: INFO cinder.volume.manager [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Deleted volume successfully.
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.coordination [None req-fe743ff6-3f1d-406f-b2aa-ecbee4b44710 tempest-VolumesGetTest-136869643 None] Lock "cinder-0dfdf08d-75fd-4c46-9ba3-2ab9a18b35b2-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f9af040-900d-4054-b86a-1b899bfbf0c4/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] get volume v_4f9af040-900d-4054-b86a-1b899bfbf0c4 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_667d4fd9-e499-4293-b4be-7dfd67633f8d@v_4f9af040-900d-4054-b86a-1b899bfbf0c4', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4f9af040-900d-4054-b86a-1b899bfbf0c4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281931', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59713', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8816032449035671553', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'efe80ce7f57bec5b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801598464', 'san:volume_id': 'efe80ce7f57bec5bc310034231362c203252e7f7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37016', 'name': 'v_4f9af040-900d-4054-b86a-1b899bfbf0c4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] delete snapshot v_4f9af040-900d-4054-b86a-1b899bfbf0c4 of volume v_667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d/snapshots/v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d/snapshots/v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:21:59 user cinder-volume[73792]: INFO cinder.action_track [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-802312066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cc11c7ad-651f-43ba-9a0b-0a31531684aa,host='user@joviandss-2#joviandss-2',id=a6836010-6acc-49bc-b3d2-4fdf531cac31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389a12e1-c731-4334-80b0-bb8f514634b1),volume_type_id=389a12e1-c731-4334-80b0-bb8f514634b1) 
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Flow 'volume_create_manager' (2b6ca016-4577-4a6e-b47c-8c8461d02b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9a08e5-ae46-4ccb-a340-d576eeb04577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9a08e5-ae46-4ccb-a340-d576eeb04577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-802312066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cc11c7ad-651f-43ba-9a0b-0a31531684aa,host='user@joviandss-2#joviandss-2',id=a6836010-6acc-49bc-b3d2-4fdf531cac31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:00Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389a12e1-c731-4334-80b0-bb8f514634b1),volume_type_id=389a12e1-c731-4334-80b0-bb8f514634b1)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c65358-2702-4572-834c-7d740f592070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c65358-2702-4572-834c-7d740f592070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4b540e-de5d-44f8-940c-2acfa50219bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4b540e-de5d-44f8-940c-2acfa50219bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6836010-6acc-49bc-b3d2-4fdf531cac31', 'volume_name': 'volume-a6836010-6acc-49bc-b3d2-4fdf531cac31', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b4478f-1f30-4cb4-8b88-07a589cc53c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b4478f-1f30-4cb4-8b88-07a589cc53c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e3dad0-35df-4962-b9a7-3717a71d4fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:21:59 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Volume a6836010-6acc-49bc-b3d2-4fdf531cac31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6836010-6acc-49bc-b3d2-4fdf531cac31', 'volume_size': 1}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] creating volume v_a6836010-6acc-49bc-b3d2-4fdf531cac31. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] create volume {'name': 'v_a6836010-6acc-49bc-b3d2-4fdf531cac31', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:21:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d/snapshots/v_4f9af040-900d-4054-b86a-1b899bfbf0c4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] snapshot v_4f9af040-900d-4054-b86a-1b899bfbf0c4 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:22:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a6836010-6acc-49bc-b3d2-4fdf531cac31', 'is_clone': False, 'name': 'v_a6836010-6acc-49bc-b3d2-4fdf531cac31'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e3dad0-35df-4962-b9a7-3717a71d4fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6836010-6acc-49bc-b3d2-4fdf531cac31', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cabc184-635c-4cb9-9a85-26ac4969109b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:00 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Volume volume-a6836010-6acc-49bc-b3d2-4fdf531cac31 (a6836010-6acc-49bc-b3d2-4fdf531cac31): created successfully
Apr 12 06:22:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cabc184-635c-4cb9-9a85-26ac4969109b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] Flow 'volume_create_manager' (2b6ca016-4577-4a6e-b47c-8c8461d02b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:00 user cinder-volume[73792]: INFO cinder.action_track [None req-4e140534-7c9b-43a5-99ac-372c85cea55b tempest-GroupSnapshotsTest-2133346524 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-802312066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cc11c7ad-651f-43ba-9a0b-0a31531684aa,host='user@joviandss-2#joviandss-2',id=a6836010-6acc-49bc-b3d2-4fdf531cac31,launched_at=2023-04-12T06:22:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth='CHAP coRKlAPB caGHkjwDIKftX7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:00Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389a12e1-c731-4334-80b0-bb8f514634b1),volume_type_id=389a12e1-c731-4334-80b0-bb8f514634b1) 
Apr 12 06:22:00 user cinder-volume[73792]: DEBUG cinder.quota [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Created reservations ['bd39fb78-8b73-4711-9437-f60e2871f086', '5daa3cb3-40fd-4af5-a9ff-8cdb7f9fb982', '8abaf5c3-6178-49a7-adc6-28a1fe648e6f', 'ecf60740-07c1-4973-9281-91109dc3b382'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:22:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:22:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:01 user cinder-volume[73792]: INFO cinder.volume.manager [None req-595ffbb0-6fea-4195-85e0-7fe3fefd7b4f tempest-GroupSnapshotsTest-2133346524 None] Update group completed successfully.
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801553408', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.manager [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:22:01 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Deleted volume successfully.
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c742cdb8-cd89-44f6-93d9-9f0aa900f8c6 tempest-VolumesGetTest-136869643 None] Lock "cinder-4f9af040-900d-4054-b86a-1b899bfbf0c4-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Acquiring lock "cinder-667d4fd9-e499-4293-b4be-7dfd67633f8d-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Lock "cinder-667d4fd9-e499-4293-b4be-7dfd67633f8d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] remove_export for volume: 667d4fd9-e499-4293-b4be-7dfd67633f8d. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-910515731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=667d4fd9-e499-4293-b4be-7dfd67633f8d,launched_at=2023-04-12T06:21:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP zlwqrSon BCReFniNj2cT4D',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:51Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:22:01Z,updated_at=2023-04-12T06:22:02Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] detach volume v_667d4fd9-e499-4293-b4be-7dfd67633f8d from target iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d/luns/v_667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d/luns/v_667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d/luns/v_667d4fd9-e499-4293-b4be-7dfd67633f8d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d/luns/v_667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d because of JDSS resource v_667d4fd9-e499-4293-b4be-7dfd67633f8d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] delete target: iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] delete target iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d because of JDSS resource iqn.2010-10.org.openstack:667d4fd9-e499-4293-b4be-7dfd67633f8d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] deleating volume v_667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] get snapshots for volume v_667d4fd9-e499-4293-b4be-7dfd67633f8d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] get volume v_667d4fd9-e499-4293-b4be-7dfd67633f8d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_667d4fd9-e499-4293-b4be-7dfd67633f8d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281929', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59706', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7624858438862846821', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1753370420943fb2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801553408', 'san:volume_id': '1753370420943fb23119eb0d9274ef2ee90915e7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37001', 'name': 'v_667d4fd9-e499-4293-b4be-7dfd67633f8d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] delete volume:v_667d4fd9-e499-4293-b4be-7dfd67633f8d recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:02 user cinder-volume[73792]: INFO cinder.action_track [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1006945509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5528cc9d-8283-48ce-b6d3-f579aae9dd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4464512ecbd453598329ee1e128a3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='31da274adadf4b039ed401eef15643d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Flow 'volume_create_manager' (4465d906-fb81-440b-a014-4e8b14068f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df61dadd-65d8-42fc-ac9f-29f64b7d1f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df61dadd-65d8-42fc-ac9f-29f64b7d1f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1006945509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5528cc9d-8283-48ce-b6d3-f579aae9dd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4464512ecbd453598329ee1e128a3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:02Z,use_quota=True,user_id='31da274adadf4b039ed401eef15643d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b369a6f-99c8-45ba-9c43-12c313315f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b369a6f-99c8-45ba-9c43-12c313315f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d5cd57-fa89-470b-b824-78b09e256762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d5cd57-fa89-470b-b824-78b09e256762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5528cc9d-8283-48ce-b6d3-f579aae9dd62', 'volume_name': 'volume-5528cc9d-8283-48ce-b6d3-f579aae9dd62', 'volume_size': 2}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f273f1-cf11-4948-b2cc-c634e2393ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f273f1-cf11-4948-b2cc-c634e2393ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ee587e-30bd-4261-9d93-daaac89f2caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:02 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Volume 5528cc9d-8283-48ce-b6d3-f579aae9dd62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5528cc9d-8283-48ce-b6d3-f579aae9dd62', 'volume_size': 2}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] creating volume v_5528cc9d-8283-48ce-b6d3-f579aae9dd62. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] create volume {'name': 'v_5528cc9d-8283-48ce-b6d3-f579aae9dd62', 'size': '2147483648', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:02 user cinder-volume[73792]: INFO cinder.volume.manager [None req-1eb5a6ec-6048-4a10-8d59-e882308b6a4b tempest-GroupSnapshotsTest-2133346524 None] Update group completed successfully.
Apr 12 06:22:02 user cinder-volume[73792]: INFO cinder.action_track [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1929876138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6938de6c-91d6-44b2-af51-33e34e241f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:02 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Flow 'volume_create_manager' (2ce6ff57-682f-4c0c-adcd-d66286fe9f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7dc489-4802-4c4a-b86e-a85415a56013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62', 'is_clone': False, 'name': 'v_5528cc9d-8283-48ce-b6d3-f579aae9dd62'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7dc489-4802-4c4a-b86e-a85415a56013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1929876138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6938de6c-91d6-44b2-af51-33e34e241f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:03Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49129af-878f-4bc4-90bb-c50f1cf76727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49129af-878f-4bc4-90bb-c50f1cf76727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ccaad6-4ff9-4f77-8dfe-e59f8e7eb3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ee587e-30bd-4261-9d93-daaac89f2caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5528cc9d-8283-48ce-b6d3-f579aae9dd62', 'volume_size': 2}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8e8498-a0c1-46ea-a31b-5e26e4f0f581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:03 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Volume volume-5528cc9d-8283-48ce-b6d3-f579aae9dd62 (5528cc9d-8283-48ce-b6d3-f579aae9dd62): created successfully
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8e8498-a0c1-46ea-a31b-5e26e4f0f581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] Flow 'volume_create_manager' (4465d906-fb81-440b-a014-4e8b14068f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:03 user cinder-volume[73792]: INFO cinder.action_track [None req-793ee74a-ce4a-45ca-a8bb-4269a24ae012 tempest-VolumesCloneNegativeTest-566572733 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1006945509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5528cc9d-8283-48ce-b6d3-f579aae9dd62,launched_at=2023-04-12T06:22:03Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4464512ecbd453598329ee1e128a3d6',provider_auth='CHAP wykNRDgZ 5G8QpmhXHnoa4l',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:02Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:02Z,use_quota=True,user_id='31da274adadf4b039ed401eef15643d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ccaad6-4ff9-4f77-8dfe-e59f8e7eb3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6938de6c-91d6-44b2-af51-33e34e241f29', 'volume_name': 'volume-6938de6c-91d6-44b2-af51-33e34e241f29', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769ca1e70>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516cd130-b0e0-41a0-bae8-df1423603150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516cd130-b0e0-41a0-bae8-df1423603150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b466718-358e-4107-ab11-457fecdcee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:03 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume 6938de6c-91d6-44b2-af51-33e34e241f29: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6938de6c-91d6-44b2-af51-33e34e241f29', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769ca1e70>}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Cloning 6938de6c-91d6-44b2-af51-33e34e241f29 from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 0.019s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Preparing cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_667d4fd9-e499-4293-b4be-7dfd67633f8d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] volume v_667d4fd9-e499-4293-b4be-7dfd67633f8d deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Acquiring lock "cinder-5528cc9d-8283-48ce-b6d3-f579aae9dd62-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Lock "cinder-5528cc9d-8283-48ce-b6d3-f579aae9dd62-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:22:03 user cinder-volume[73792]: INFO cinder.volume.manager [None req-2dbbab20-0194-4ff3-aeb1-84278432ea50 tempest-GroupSnapshotsTest-2133346524 None] Update group completed successfully.
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.quota [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Created reservations ['606dbd08-bce3-4538-afa0-674550e9b1c4', 'c9a322cf-b27f-47e3-be3e-5ae44c6c525a', '1e167f0d-c070-4709-91fe-90e1811c6290', '72c3ffed-b037-4a19-a003-0d6341f98afe'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] remove_export for volume: 5528cc9d-8283-48ce-b6d3-f579aae9dd62. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1006945509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5528cc9d-8283-48ce-b6d3-f579aae9dd62,launched_at=2023-04-12T06:22:03Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4464512ecbd453598329ee1e128a3d6',provider_auth='CHAP wykNRDgZ 5G8QpmhXHnoa4l',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:02Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:22:04Z,updated_at=2023-04-12T06:22:04Z,use_quota=True,user_id='31da274adadf4b039ed401eef15643d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] detach volume v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 from target iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62/luns/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62/luns/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62/luns/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62/luns/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] failed to remove resource iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 because of JDSS resource v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] delete target: iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] delete target iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] failed to remove resource iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 because of JDSS resource iqn.2010-10.org.openstack:5528cc9d-8283-48ce-b6d3-f579aae9dd62 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] deleating volume v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] get snapshots for volume v_5528cc9d-8283-48ce-b6d3-f579aae9dd62  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:03 user cinder-volume[73792]: INFO cinder.action_track [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-43653872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=617c227c-3388-4abd-9ffd-12322592b77d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b7afce3f7c4e1db9077933eff8b1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='5d07ddcf82664034877889adce8cf081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:03 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Flow 'volume_create_manager' (ad7803ef-f427-4ba1-af78-1472a81f7f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638370f3-78ad-4753-a3b4-2cc6ecaf2d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638370f3-78ad-4753-a3b4-2cc6ecaf2d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-43653872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=617c227c-3388-4abd-9ffd-12322592b77d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b7afce3f7c4e1db9077933eff8b1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:04Z,use_quota=True,user_id='5d07ddcf82664034877889adce8cf081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0313ab-53bd-48ba-9e96-fc4e049c9d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0313ab-53bd-48ba-9e96-fc4e049c9d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da413b2-2f70-4bbe-b85e-de29c2bbaa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da413b2-2f70-4bbe-b85e-de29c2bbaa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '617c227c-3388-4abd-9ffd-12322592b77d', 'volume_name': 'volume-617c227c-3388-4abd-9ffd-12322592b77d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd8f26b-8c5b-46d1-9857-9cc1e02c7b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd8f26b-8c5b-46d1-9857-9cc1e02c7b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f948d887-be9e-4d3e-a89f-a2c8c1d8607c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:04 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Volume 617c227c-3388-4abd-9ffd-12322592b77d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-617c227c-3388-4abd-9ffd-12322592b77d', 'volume_size': 1}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] creating volume v_617c227c-3388-4abd-9ffd-12322592b77d. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] create volume {'name': 'v_617c227c-3388-4abd-9ffd-12322592b77d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] get volume v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281940', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59734', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1805150169603980370', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9fc3041ed1fe6285', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801565696', 'san:volume_id': '9fc3041ed1fe62854a04f9c72b2735abe0fc62db', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36153', 'name': 'v_5528cc9d-8283-48ce-b6d3-f579aae9dd62', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] delete volume:v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.image.image_utils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2, size 15.55 MB, duration 1.00 sec {{(pid=73792) fetch /opt/stack/cinder/cinder/image/image_utils.py:628}}
Apr 12 06:22:04 user cinder-volume[73792]: INFO cinder.image.image_utils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Image download 15.55 MB at 15.55 MB/s
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801565696', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.manager [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2 {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:04 user cinder-volume[73792]: INFO cinder.volume.manager [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Deleted volume successfully.
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f2192802-91c5-4582-842f-ed7f9a27441e tempest-VolumesGetTest-136869643 None] Lock "cinder-667d4fd9-e499-4293-b4be-7dfd67633f8d-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:22:04 user sudo[80835]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2
Apr 12 06:22:04 user sudo[80835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=66,cinder:UPDATE=27,cinder:DELETE=5,cinder:INSERT=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_617c227c-3388-4abd-9ffd-12322592b77d', 'is_clone': False, 'name': 'v_617c227c-3388-4abd-9ffd-12322592b77d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f948d887-be9e-4d3e-a89f-a2c8c1d8607c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-617c227c-3388-4abd-9ffd-12322592b77d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea70963-5f43-419b-a0b1-2f4833f5170c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:04 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Volume volume-617c227c-3388-4abd-9ffd-12322592b77d (617c227c-3388-4abd-9ffd-12322592b77d): created successfully
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea70963-5f43-419b-a0b1-2f4833f5170c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] Flow 'volume_create_manager' (ad7803ef-f427-4ba1-af78-1472a81f7f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:04 user cinder-volume[73792]: INFO cinder.action_track [None req-79827676-af0c-44b4-aac8-61feb8e4d198 tempest-VolumesTransfersTest-1994120206 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-43653872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=617c227c-3388-4abd-9ffd-12322592b77d,launched_at=2023-04-12T06:22:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b7afce3f7c4e1db9077933eff8b1b1',provider_auth='CHAP MXfrcwih H6NJzA8MBaW5qG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:04Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:04Z,use_quota=True,user_id='5d07ddcf82664034877889adce8cf081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:04 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=66,cinder:UPDATE=28,cinder:INSERT=6 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:22:04 user cinder-volume[73792]: INFO cinder.volume.manager [None req-1d481ce2-157e-48fd-87cb-2fb1ed691a9f tempest-GroupSnapshotsTest-2133346524 None] Update group completed successfully.
Apr 12 06:22:05 user cinder-volume[73792]: INFO cinder.action_track [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1707023688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ac2c28f3-2ecb-41f6-b97b-b8749353655b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (c2c5f75f-dc23-4aa0-8d02-a50a2a0851e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80275df8-bd44-43f5-8762-06b2c7837f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80275df8-bd44-43f5-8762-06b2c7837f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1707023688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ac2c28f3-2ecb-41f6-b97b-b8749353655b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:05Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8968fdd-37ca-4814-aba9-f849e660b119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8968fdd-37ca-4814-aba9-f849e660b119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2076f9f4-77b2-42c9-8ad5-bd79894bad23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:05 user sudo[80835]: pam_unix(sudo:session): session closed for user root
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2" returned: 0 in 1.049s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.image.image_utils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Temporary image 4f2549ed-915f-4494-87f3-9269834fa9da is fetched for user 977b800fab264446b0492c93b0dc12d3. {{(pid=73792) fetch /opt/stack/cinder/cinder/image/image_utils.py:1279}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2 {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2076f9f4-77b2-42c9-8ad5-bd79894bad23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac2c28f3-2ecb-41f6-b97b-b8749353655b', 'volume_name': 'volume-ac2c28f3-2ecb-41f6-b97b-b8749353655b', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769b8b040>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5310d43a-113a-4c81-b174-b79706f415d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5310d43a-113a-4c81-b174-b79706f415d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5275d64-1dc6-4526-b55c-fae68101bda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:05 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Volume ac2c28f3-2ecb-41f6-b97b-b8749353655b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac2c28f3-2ecb-41f6-b97b-b8749353655b', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769b8b040>}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Cloning ac2c28f3-2ecb-41f6-b97b-b8749353655b from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:22:05 user cinder-volume[73792]: DEBUG cinder.coordination [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:22:05 user sudo[80888]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2
Apr 12 06:22:05 user sudo[80888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] volume v_5528cc9d-8283-48ce-b6d3-f579aae9dd62 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.quota [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Created reservations ['3c190601-d8bd-483a-9035-afcd8c2e05a8', '3f479cea-97ec-4014-a6a1-d6c9669c85d7', '91c67b78-2ee9-499b-b9d2-de953720d59c', '15f0b9c7-b0ed-4f51-a6cd-5ebf0befa179'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:06 user cinder-volume[73792]: INFO cinder.volume.manager [None req-356b9c7e-4a14-476a-b2e1-61d7b54018b1 tempest-VolumesTransfersTest-382636807 None] Transfer volume completed successfully.
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:06 user cinder-volume[73792]: INFO cinder.volume.manager [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] GroupSnapshot 8999a735-dc37-4cf2-8e2b-e40d49d909f1: creating.
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Group snapshot 8999a735-dc37-4cf2-8e2b-e40d49d909f1: creating. {{(pid=73792) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4160}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] create snapshot 73c0fc16-36f9-4ef8-8464-a39dd4e6246a for volume d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] cloning v_d85f4406-7d66-4c5b-8518-63722c8822b0 to s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] create snapshot s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:06 user sudo[80888]: pam_unix(sudo:session): session closed for user root
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2" returned: 0 in 1.234s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] creating volume v_6938de6c-91d6-44b2-af51-33e34e241f29. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] create volume {'name': 'v_6938de6c-91d6-44b2-af51-33e34e241f29', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801565696', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.manager [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:22:06 user cinder-volume[73792]: INFO cinder.volume.manager [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Deleted volume successfully.
Apr 12 06:22:06 user cinder-volume[73792]: DEBUG cinder.coordination [None req-37ae857d-f604-4f5c-b7db-649cac1bff2a tempest-VolumesCloneNegativeTest-566572733 None] Lock "cinder-5528cc9d-8283-48ce-b6d3-f579aae9dd62-delete_volume" released by "delete_volume" :: held 3.350s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:22:06 user cinder-volume[73792]: INFO cinder.action_track [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1995203384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d2470870-a46d-44c2-98dc-448e98ab0866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d2a1b102d54e8194741137e193436f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='896e1c5d0edd4a1d9d122115f02dfef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Acquiring lock "cinder-617c227c-3388-4abd-9ffd-12322592b77d-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Flow 'volume_create_manager' (b83d6e10-4c74-41f8-ae2a-cbb64792f430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecddbd6f-0156-4b93-bb51-131b8bd43f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Lock "cinder-617c227c-3388-4abd-9ffd-12322592b77d-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecddbd6f-0156-4b93-bb51-131b8bd43f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1995203384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d2470870-a46d-44c2-98dc-448e98ab0866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d2a1b102d54e8194741137e193436f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:07Z,use_quota=True,user_id='896e1c5d0edd4a1d9d122115f02dfef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e948445-ab5c-47c6-99ef-69b177bee6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e948445-ab5c-47c6-99ef-69b177bee6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df5882f-d5af-4cb4-a058-e3ad8021f746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df5882f-d5af-4cb4-a058-e3ad8021f746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2470870-a46d-44c2-98dc-448e98ab0866', 'volume_name': 'volume-d2470870-a46d-44c2-98dc-448e98ab0866', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aad8627-b54b-4c39-861a-76da3cb8ab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aad8627-b54b-4c39-861a-76da3cb8ab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb257dcb-4629-4cb8-8547-e9beea0ceda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:07 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Volume d2470870-a46d-44c2-98dc-448e98ab0866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2470870-a46d-44c2-98dc-448e98ab0866', 'volume_size': 1}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] creating volume v_d2470870-a46d-44c2-98dc-448e98ab0866. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] create volume {'name': 'v_d2470870-a46d-44c2-98dc-448e98ab0866', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] remove_export for volume: 617c227c-3388-4abd-9ffd-12322592b77d. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-43653872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=617c227c-3388-4abd-9ffd-12322592b77d,launched_at=2023-04-12T06:22:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002e3d4b37924f55b679ed397d8017ea',provider_auth='CHAP MXfrcwih H6NJzA8MBaW5qG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:04Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:22:07Z,updated_at=2023-04-12T06:22:07Z,use_quota=True,user_id='1daeb4190f8e4780b57b6e22146f009d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] detach volume v_617c227c-3388-4abd-9ffd-12322592b77d from target iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d/luns/v_617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d/luns/v_617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d/luns/v_617c227c-3388-4abd-9ffd-12322592b77d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d/luns/v_617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] failed to remove resource iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d because of JDSS resource v_617c227c-3388-4abd-9ffd-12322592b77d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] delete target: iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] delete target iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] failed to remove resource iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d because of JDSS resource iqn.2010-10.org.openstack:617c227c-3388-4abd-9ffd-12322592b77d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] deleating volume v_617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] get snapshots for volume v_617c227c-3388-4abd-9ffd-12322592b77d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_617c227c-3388-4abd-9ffd-12322592b77d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_617c227c-3388-4abd-9ffd-12322592b77d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6938de6c-91d6-44b2-af51-33e34e241f29', 'is_clone': False, 'name': 'v_6938de6c-91d6-44b2-af51-33e34e241f29'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Attempting download of 4f2549ed-915f-4494-87f3-9269834fa9da ((None, None)) to volume 6938de6c-91d6-44b2-af51-33e34e241f29. {{(pid=73792) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.driver [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] copy_image_to_volume volume-6938de6c-91d6-44b2-af51-33e34e241f29. {{(pid=73792) _copy_image_data_to_volume /opt/stack/cinder/cinder/volume/driver.py:890}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG os_brick.utils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:22:07 user cinder-volume[73792]: INFO oslo.privsep.daemon [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp4n0x95vw/privsep.sock']
Apr 12 06:22:07 user sudo[80937]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp4n0x95vw/privsep.sock
Apr 12 06:22:07 user sudo[80937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_73c0fc16-36f9-4ef8-8464-a39dd4e6246a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] create volume s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a from snapshot s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_617c227c-3388-4abd-9ffd-12322592b77d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] get volume v_617c227c-3388-4abd-9ffd-12322592b77d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_617c227c-3388-4abd-9ffd-12322592b77d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281941', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59739', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15004316654232421545', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2ff9c5ccd10c4893', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801446912', 'san:volume_id': '2ff9c5ccd10c489333449ad102039a3bfc9ec1b3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37211', 'name': 'v_617c227c-3388-4abd-9ffd-12322592b77d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] delete volume:v_617c227c-3388-4abd-9ffd-12322592b77d recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d2470870-a46d-44c2-98dc-448e98ab0866', 'is_clone': False, 'name': 'v_d2470870-a46d-44c2-98dc-448e98ab0866'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb257dcb-4629-4cb8-8547-e9beea0ceda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2470870-a46d-44c2-98dc-448e98ab0866', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea60f14-4643-401f-93c7-217efa9d31c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:08 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Volume volume-d2470870-a46d-44c2-98dc-448e98ab0866 (d2470870-a46d-44c2-98dc-448e98ab0866): created successfully
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea60f14-4643-401f-93c7-217efa9d31c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] Flow 'volume_create_manager' (b83d6e10-4c74-41f8-ae2a-cbb64792f430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:08 user cinder-volume[73792]: INFO cinder.action_track [None req-c2eea253-0d4a-4ff1-b986-acf82c567f06 tempest-TaggedAttachmentsTest-1179204824 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1995203384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d2470870-a46d-44c2-98dc-448e98ab0866,launched_at=2023-04-12T06:22:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d2a1b102d54e8194741137e193436f',provider_auth='CHAP cDzhwJUi Qx3CKFLliXdOGU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:07Z,use_quota=True,user_id='896e1c5d0edd4a1d9d122115f02dfef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d85f4406-7d66-4c5b-8518-63722c8822b0@s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a', 'is_clone': True, 'full_name': 'Pool-0/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a', 'name': 's_73c0fc16-36f9-4ef8-8464-a39dd4e6246a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] volume s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] create snapshot e8d48e22-3705-4046-a440-0b12a23411d4 for volume a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] cloning v_a6836010-6acc-49bc-b3d2-4fdf531cac31 to s_e8d48e22-3705-4046-a440-0b12a23411d4 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] create snapshot s_e8d48e22-3705-4046-a440-0b12a23411d4 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_617c227c-3388-4abd-9ffd-12322592b77d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] volume v_617c227c-3388-4abd-9ffd-12322592b77d deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:22:08 user cinder-volume[73792]: DEBUG cinder.quota [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Created reservations ['d1823061-4935-4441-86b6-e0866133677e', '04b70ae2-505b-430a-92f9-f9b384adff42', '7297300f-c6e0-42f2-8b80-ee8d5e6c72cb', '787b1030-f9a8-4671-8732-d38f9ad6aba1'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:09 user cinder-volume[73792]: INFO cinder.action_track [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:09 user sudo[80937]: pam_unix(sudo:session): session closed for user root
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Flow 'volume_create_manager' (a64969d3-4a27-4f4e-9931-7f0302e4bf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfcaea0-f9c3-4d3c-95c0-6c7034b993b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_e8d48e22-3705-4046-a440-0b12a23411d4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] create volume s_e8d48e22-3705-4046-a440-0b12a23411d4 from snapshot s_e8d48e22-3705-4046-a440-0b12a23411d4 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:09 user cinder-volume[73792]: INFO oslo.privsep.daemon [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Spawned new privsep daemon via rootwrap
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Accepted privsep connection to /tmp/tmp4n0x95vw/privsep.sock {{(pid=73792) __init__ /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:362}}
Apr 12 06:22:09 user cinder-volume[73792]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 06:22:09 user cinder-volume[73792]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 06:22:09 user cinder-volume[73792]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 12 06:22:09 user cinder-volume[73792]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80953
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfcaea0-f9c3-4d3c-95c0-6c7034b993b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:09Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66703b2c-5782-416a-bc27-eca08d303514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66703b2c-5782-416a-bc27-eca08d303514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44525d2-d094-4f8d-9bc2-a76c2420e32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44525d2-d094-4f8d-9bc2-a76c2420e32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1872667c-83a2-4de7-a347-cc3fd70bf901', 'volume_name': 'volume-1872667c-83a2-4de7-a347-cc3fd70bf901', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771d3b1b-ce85-42f5-ae79-ef1736ec4a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771d3b1b-ce85-42f5-ae79-ef1736ec4a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577e0d53-e5e3-4a08-88f5-a1ad1719f98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:09 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Volume 1872667c-83a2-4de7-a347-cc3fd70bf901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1872667c-83a2-4de7-a347-cc3fd70bf901', 'volume_size': 1}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] creating volume v_1872667c-83a2-4de7-a347-cc3fd70bf901. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] create volume {'name': 'v_1872667c-83a2-4de7-a347-cc3fd70bf901', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd5b00f-2d4d-4f79-a852-f27f81d48274]: (2,) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801422336', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.manager [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:22:09 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Deleted volume successfully.
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b79b800c-8d3d-4018-987e-f33c61590b4e tempest-VolumesTransfersTest-1676292131 None] Lock "cinder-617c227c-3388-4abd-9ffd-12322592b77d-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a22ba3-294d-4d23-aa72-33cec59ef0fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:09 user cinder-volume[73792]: WARNING os_brick.initiator.connectors.nvmeof [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ae1622-bac1-41ff-a1a8-60302b7c3a6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[035875dd-0805-48cf-8e24-2230b889c585]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aebc832-1c7d-4bbf-8b64-0cc1c5e87f0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Running cmd (subprocess): nvme version {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] 'nvme version' failed. Not Retrying. {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:22:09 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] nvme not present on system {{(pid=73792) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:22:10 user cinder-volume[73792]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33de0fa-d2ec-4b6d-91af-1f38eec8a9e1]: (4, '') {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.lightos [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73792) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.lightos [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73792) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.lightos [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] LIGHTOS: no hostnqn found. {{(pid=73792) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG os_brick.utils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] <== get_connector_properties: return (2609ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.driver [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume 6938de6c-91d6-44b2-af51-33e34e241f29: creating export {{(pid=73792) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] create export for volume: 6938de6c-91d6-44b2-af51-33e34e241f29. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] ensure volume 6938de6c-91d6-44b2-af51-33e34e241f29 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] check if targe iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] create target and attach volume 6938de6c-91d6-44b2-af51-33e34e241f29 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] create target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:10 user cinder-volume[73792]: INFO cinder.action_track [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1688010357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=157da07c-ed62-48a4-ad7a-30fdb576bdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b7afce3f7c4e1db9077933eff8b1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='5d07ddcf82664034877889adce8cf081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Flow 'volume_create_manager' (e82f7104-4623-4b72-8e73-0d87285f7aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caabd192-09d2-40af-8d12-696606e201e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a6836010-6acc-49bc-b3d2-4fdf531cac31@s_e8d48e22-3705-4046-a440-0b12a23411d4', 'is_clone': True, 'full_name': 'Pool-0/s_e8d48e22-3705-4046-a440-0b12a23411d4', 'name': 's_e8d48e22-3705-4046-a440-0b12a23411d4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e8d48e22-3705-4046-a440-0b12a23411d4/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e8d48e22-3705-4046-a440-0b12a23411d4/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caabd192-09d2-40af-8d12-696606e201e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1688010357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=157da07c-ed62-48a4-ad7a-30fdb576bdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b7afce3f7c4e1db9077933eff8b1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:10Z,use_quota=True,user_id='5d07ddcf82664034877889adce8cf081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544cd43a-8e19-4d08-95c9-31d306c07132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544cd43a-8e19-4d08-95c9-31d306c07132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b70497d-40ea-4c14-b75d-325f6d996e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b70497d-40ea-4c14-b75d-325f6d996e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '157da07c-ed62-48a4-ad7a-30fdb576bdfb', 'volume_name': 'volume-157da07c-ed62-48a4-ad7a-30fdb576bdfb', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0b2fdb-6234-41b2-b85c-3bda5cf478e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0b2fdb-6234-41b2-b85c-3bda5cf478e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec989df-d5c5-4aa5-ab95-40ab00d7e4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:10 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Volume 157da07c-ed62-48a4-ad7a-30fdb576bdfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-157da07c-ed62-48a4-ad7a-30fdb576bdfb', 'volume_size': 1}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] creating volume v_157da07c-ed62-48a4-ad7a-30fdb576bdfb. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] create volume {'name': 'v_157da07c-ed62-48a4-ad7a-30fdb576bdfb', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1872667c-83a2-4de7-a347-cc3fd70bf901', 'is_clone': False, 'name': 'v_1872667c-83a2-4de7-a347-cc3fd70bf901'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577e0d53-e5e3-4a08-88f5-a1ad1719f98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1872667c-83a2-4de7-a347-cc3fd70bf901', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03abd4b4-91ea-4564-aca1-de1573971be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e8d48e22-3705-4046-a440-0b12a23411d4/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] volume s_e8d48e22-3705-4046-a440-0b12a23411d4 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb', 'is_clone': False, 'name': 'v_157da07c-ed62-48a4-ad7a-30fdb576bdfb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:11 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Volume volume-1872667c-83a2-4de7-a347-cc3fd70bf901 (1872667c-83a2-4de7-a347-cc3fd70bf901): created successfully
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03abd4b4-91ea-4564-aca1-de1573971be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] Flow 'volume_create_manager' (a64969d3-4a27-4f4e-9931-7f0302e4bf26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec989df-d5c5-4aa5-ab95-40ab00d7e4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157da07c-ed62-48a4-ad7a-30fdb576bdfb', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f63c7e4-49f8-4dab-8114-48bb1eb8cb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:11 user cinder-volume[73792]: INFO cinder.action_track [None req-c590f4b2-81c1-4154-abcc-0f8926fc27a2 tempest-TestVolumeSwap-1856443697 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:09Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:11 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Volume volume-157da07c-ed62-48a4-ad7a-30fdb576bdfb (157da07c-ed62-48a4-ad7a-30fdb576bdfb): created successfully
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f63c7e4-49f8-4dab-8114-48bb1eb8cb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] Flow 'volume_create_manager' (e82f7104-4623-4b72-8e73-0d87285f7aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:11 user cinder-volume[73792]: INFO cinder.action_track [None req-39023b84-0e72-42ce-ad2e-bde360f9c3b3 tempest-VolumesTransfersTest-1994120206 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1688010357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=157da07c-ed62-48a4-ad7a-30fdb576bdfb,launched_at=2023-04-12T06:22:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b7afce3f7c4e1db9077933eff8b1b1',provider_auth='CHAP AhIDgQYJ hMrDP8TJzoRSyO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:10Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:10Z,use_quota=True,user_id='5d07ddcf82664034877889adce8cf081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:11 user cinder-volume[73792]: INFO cinder.volume.manager [None req-9950bb21-4eb8-4bc2-94fb-52f5b49afb0e tempest-GroupSnapshotsTest-2133346524 None] group_snapshot 8999a735-dc37-4cf2-8e2b-e40d49d909f1: created successfully
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Acquiring lock "cinder-157da07c-ed62-48a4-ad7a-30fdb576bdfb-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Lock "cinder-157da07c-ed62-48a4-ad7a-30fdb576bdfb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] remove_export for volume: 157da07c-ed62-48a4-ad7a-30fdb576bdfb. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1688010357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=157da07c-ed62-48a4-ad7a-30fdb576bdfb,launched_at=2023-04-12T06:22:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b7afce3f7c4e1db9077933eff8b1b1',provider_auth='CHAP AhIDgQYJ hMrDP8TJzoRSyO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:10Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:22:12Z,updated_at=2023-04-12T06:22:12Z,use_quota=True,user_id='5d07ddcf82664034877889adce8cf081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] detach volume v_157da07c-ed62-48a4-ad7a-30fdb576bdfb from target iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb/luns/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb/luns/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb/luns/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb/luns/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] failed to remove resource iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb because of JDSS resource v_157da07c-ed62-48a4-ad7a-30fdb576bdfb DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] delete target: iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] delete target iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] failed to remove resource iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb because of JDSS resource iqn.2010-10.org.openstack:157da07c-ed62-48a4-ad7a-30fdb576bdfb DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] deleating volume v_157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] get snapshots for volume v_157da07c-ed62-48a4-ad7a-30fdb576bdfb  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:12 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] group_snapshot 8999a735-dc37-4cf2-8e2b-e40d49d909f1: deleting
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] group_snapshot 8999a735-dc37-4cf2-8e2b-e40d49d909f1: deleting {{(pid=73792) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4335}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] deleating snapshot s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] get snapshots for volume s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] get volume v_157da07c-ed62-48a4-ad7a-30fdb576bdfb info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281948', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59767', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14934058615805705690', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '04e89bad2b49b886', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801258496', 'san:volume_id': '04e89bad2b49b88611838d271025c4c18b6f2056', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37385', 'name': 'v_157da07c-ed62-48a4-ad7a-30fdb576bdfb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] delete volume:v_157da07c-ed62-48a4-ad7a-30fdb576bdfb recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:12 user cinder-volume[73792]: INFO cinder.action_track [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-2016549375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a0819b26-7af7-426a-8242-84954c0851f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Flow 'volume_create_manager' (4fcff90f-8613-4098-ba95-da463f054397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d92463-23ec-40e0-b388-795861deba95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d92463-23ec-40e0-b388-795861deba95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-2016549375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a0819b26-7af7-426a-8242-84954c0851f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:12Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70de533-c304-4c66-b7ae-bae0c8294e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70de533-c304-4c66-b7ae-bae0c8294e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dae4b37-4a64-4662-98cc-1606dc07026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dae4b37-4a64-4662-98cc-1606dc07026b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0819b26-7af7-426a-8242-84954c0851f5', 'volume_name': 'volume-a0819b26-7af7-426a-8242-84954c0851f5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c65342-b494-4e94-b79c-4dbfcc1518f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c65342-b494-4e94-b79c-4dbfcc1518f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23ca66a-729e-42be-b5cf-0af712c9e0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:12 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Volume a0819b26-7af7-426a-8242-84954c0851f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0819b26-7af7-426a-8242-84954c0851f5', 'volume_size': 1}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] creating volume v_a0819b26-7af7-426a-8242-84954c0851f5. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] create volume {'name': 'v_a0819b26-7af7-426a-8242-84954c0851f5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] get volume s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a0819b26-7af7-426a-8242-84954c0851f5', 'is_clone': False, 'name': 'v_a0819b26-7af7-426a-8242-84954c0851f5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23ca66a-729e-42be-b5cf-0af712c9e0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0819b26-7af7-426a-8242-84954c0851f5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e531b5ef-6a0f-42f0-9af6-364a344ae06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=66,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:22:13 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Volume volume-a0819b26-7af7-426a-8242-84954c0851f5 (a0819b26-7af7-426a-8242-84954c0851f5): created successfully
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e531b5ef-6a0f-42f0-9af6-364a344ae06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] Flow 'volume_create_manager' (4fcff90f-8613-4098-ba95-da463f054397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:13 user cinder-volume[73792]: INFO cinder.action_track [None req-baad17f7-b1b5-43cd-aef9-ae797568d386 tempest-TestVolumeSwap-1856443697 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-2016549375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a0819b26-7af7-426a-8242-84954c0851f5,launched_at=2023-04-12T06:22:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP uYNAnVgZ w1iTt2v9XKO8Dd',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:12Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d85f4406-7d66-4c5b-8518-63722c8822b0@s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281945', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59754', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4702323336140681729', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f6a64d444fec93f8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801176576', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '36455', 'name': 's_73c0fc16-36f9-4ef8-8464-a39dd4e6246a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] delete snapshot s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a of volume v_d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0/snapshots/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0/snapshots/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_157da07c-ed62-48a4-ad7a-30fdb576bdfb {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] volume v_157da07c-ed62-48a4-ad7a-30fdb576bdfb deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=61,cinder:DELETE=5,cinder:INSERT=4,cinder:UPDATE=30 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.quota [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Created reservations ['e873b67e-0f1e-42dd-a70e-69a366c3d32a', 'd461d103-b569-49eb-a004-9d1194ae0477', 'c5bb92d8-a47b-40e1-a161-861c3984f766', 'f7b047b6-7ea9-477d-82e4-0703381a1f26'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0/snapshots/s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] snapshot s_73c0fc16-36f9-4ef8-8464-a39dd4e6246a deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] deleating snapshot s_e8d48e22-3705-4046-a440-0b12a23411d4. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] get snapshots for volume s_e8d48e22-3705-4046-a440-0b12a23411d4  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e8d48e22-3705-4046-a440-0b12a23411d4/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e8d48e22-3705-4046-a440-0b12a23411d4/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] atach volume v_6938de6c-91d6-44b2-af51-33e34e241f29 to target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e8d48e22-3705-4046-a440-0b12a23411d4/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] get volume s_e8d48e22-3705-4046-a440-0b12a23411d4 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e8d48e22-3705-4046-a440-0b12a23411d4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e8d48e22-3705-4046-a440-0b12a23411d4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a6836010-6acc-49bc-b3d2-4fdf531cac31@s_e8d48e22-3705-4046-a440-0b12a23411d4', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_e8d48e22-3705-4046-a440-0b12a23411d4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281947', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59761', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15554349670011159495', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '805165353eefefb3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801270784', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '36470', 'name': 's_e8d48e22-3705-4046-a440-0b12a23411d4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e8d48e22-3705-4046-a440-0b12a23411d4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] delete snapshot s_e8d48e22-3705-4046-a440-0b12a23411d4 of volume v_a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31/snapshots/s_e8d48e22-3705-4046-a440-0b12a23411d4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31/snapshots/s_e8d48e22-3705-4046-a440-0b12a23411d4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801270784', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.manager [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:22:14 user cinder-volume[73792]: INFO cinder.volume.manager [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Deleted volume successfully.
Apr 12 06:22:14 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6a7bae3e-c12e-4a10-b734-bbec7b97c1ff tempest-VolumesTransfersTest-1676292131 None] Lock "cinder-157da07c-ed62-48a4-ad7a-30fdb576bdfb-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:22:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31/snapshots/s_e8d48e22-3705-4046-a440-0b12a23411d4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] snapshot s_e8d48e22-3705-4046-a440-0b12a23411d4 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:22:15 user cinder-volume[73792]: WARNING cinder.quota [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1655134230 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1655134230, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:22:15 user cinder-volume[73792]: WARNING cinder.quota [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1655134230 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1655134230, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:22:15 user cinder-volume[73792]: DEBUG cinder.quota [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['01fa1eae-f477-496e-9de9-04e38aad9003', 'eb777545-04d2-411a-80e2-2b65f4b75477', 'eaa05616-b7b1-4a23-84c9-148d42580abd', '81e4eb46-475c-4fd2-a39e-1bb50a226e50'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:15 user cinder-volume[73792]: DEBUG cinder.quota [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['1a2478f2-be0b-46f4-a723-aabd258ce4c1', 'c120f478-a49e-4e4b-8e7b-4a3bf9e66fab', 'b9584a05-4656-40eb-ba30-8e14720b512f', 'b5176169-5c5d-4a33-ad96-f41def7a8df9'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:15 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0307ac8a-3346-44be-ab67-d6230ab8765b tempest-GroupSnapshotsTest-2133346524 None] group_snapshot 8999a735-dc37-4cf2-8e2b-e40d49d909f1: deleted successfully
Apr 12 06:22:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6635346137396436', 'lun': 0, 'mode': 'wt', 'name': 'v_6938de6c-91d6-44b2-af51-33e34e241f29', 'prod_id': 'Storage', 'scsi_id': 'f54a79d648b60efe'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] add credentails to target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:22:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'name': 'PptcCjqG'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] initialize_connection for 6938de6c-91d6-44b2-af51-33e34e241f29 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connector [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Factory for iscsi on None {{(pid=73792) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8769c81390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PptcCjqG', 'auth_password': '***', 'target_lun': False}}" {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:22:16 user cinder-volume[73792]: INFO os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7b8945-194b-4336-b694-abae5eaf149f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:22:16 user cinder-volume[73792]:  {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --interface default --op new {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a9ca73-8aa8-4691-8c6d-cefbcb3ace38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29] added\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29] added
Apr 12 06:22:16 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5d46db-5a5b-4b1c-898c-ff82c5d679e8]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5664a30-ef77-45d1-a627-f3b47d4ef30f]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PptcCjqG {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PptcCjqG" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f828d66-aa93-48ec-925c-6429fdb09b66]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PptcCjqG'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba3cdc3-2610-4c27-9d6a-64e0da1f2262]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[5258e928-d0c3-46e7-bd2b-fb8bf0758805]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:22:16 user cinder-volume[73792]:  {{(pid=73792) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:22:16 user cinder-volume[73792]:  {{(pid=73792) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:22:16 user cinder-volume[73792]: WARNING os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 06:22:16 user cinder-volume[73792]: 
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --login {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --login" returned: 0 in 0.217s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[1271d705-5a13-40ef-ae07-25ff848c1b01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260]
Apr 12 06:22:16 user cinder-volume[73792]: Login to [iface: default, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260] successful.
Apr 12 06:22:16 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f68902-1b43-40f0-b8ea-5f00e17c7f80]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[d779ee2a-a109-43c3-89f4-2bce57aa0f72]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:22:16 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:22:16 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.459s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Connected to 172.16.0.220:3260 {{(pid=73792) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] HCTL ('33', '-', '-', 0) found on session 1 with lun 0 {{(pid=73792) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Scanning host 33 c: -, t: -, l: 0) {{(pid=73792) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf7b180-b633-44b3-b814-807537c77bed]: (4, ('- - 0', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73792) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:22:16 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PptcCjqG', 'auth_password': '***', 'target_lun': False} {{(pid=73792) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] remove_export for volume: a6836010-6acc-49bc-b3d2-4fdf531cac31. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-802312066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cc11c7ad-651f-43ba-9a0b-0a31531684aa,host='user@joviandss-2#joviandss-2',id=a6836010-6acc-49bc-b3d2-4fdf531cac31,launched_at=2023-04-12T06:22:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth='CHAP coRKlAPB caGHkjwDIKftX7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-12T06:22:17Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389a12e1-c731-4334-80b0-bb8f514634b1),volume_type_id=389a12e1-c731-4334-80b0-bb8f514634b1) from target:iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] detach volume v_a6836010-6acc-49bc-b3d2-4fdf531cac31 from target iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31/luns/v_a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31/luns/v_a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31/luns/v_a6836010-6acc-49bc-b3d2-4fdf531cac31'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31/luns/v_a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] failed to remove resource iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 because of JDSS resource v_a6836010-6acc-49bc-b3d2-4fdf531cac31 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] delete target: iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] delete target iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] failed to remove resource iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 because of JDSS resource iqn.2010-10.org.openstack:a6836010-6acc-49bc-b3d2-4fdf531cac31 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] deleating volume v_a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] get snapshots for volume v_a6836010-6acc-49bc-b3d2-4fdf531cac31  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] get volume v_a6836010-6acc-49bc-b3d2-4fdf531cac31 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a6836010-6acc-49bc-b3d2-4fdf531cac31', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281937', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59730', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1539262712309753018', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6728a31ac9974069', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801270784', 'san:volume_id': '6728a31ac9974069d096e3514155fd7afaef3d88', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37200', 'name': 'v_a6836010-6acc-49bc-b3d2-4fdf531cac31', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] delete volume:v_a6836010-6acc-49bc-b3d2-4fdf531cac31 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.508s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '26635346137396436', 'path': '/dev/sdb'} {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdb of=/dev/null count=1 {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdb of=/dev/null count=1" returned: 0 in 0.047s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0e0953-194f-4230-8b75-af63afac56c1]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.00248658 s, 206 kB/s\n')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:17 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_4f2549ed-915f-4494-87f3-9269834fa9da_oamjng1u {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:17 user sudo[81154]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_4f2549ed-915f-4494-87f3-9269834fa9da_oamjng1u
Apr 12 06:22:17 user sudo[81154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6836010-6acc-49bc-b3d2-4fdf531cac31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] volume v_a6836010-6acc-49bc-b3d2-4fdf531cac31 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] remove_export for volume: d85f4406-7d66-4c5b-8518-63722c8822b0. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1521546314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cc11c7ad-651f-43ba-9a0b-0a31531684aa,host='user@joviandss-2#joviandss-2',id=d85f4406-7d66-4c5b-8518-63722c8822b0,launched_at=2023-04-12T06:21:58Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth='CHAP objOfyix SI2j06wDEicteA',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:21:58Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-12T06:22:17Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389a12e1-c731-4334-80b0-bb8f514634b1),volume_type_id=389a12e1-c731-4334-80b0-bb8f514634b1) from target:iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] detach volume v_d85f4406-7d66-4c5b-8518-63722c8822b0 from target iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0/luns/v_d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0/luns/v_d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0/luns/v_d85f4406-7d66-4c5b-8518-63722c8822b0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0/luns/v_d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] failed to remove resource iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 because of JDSS resource v_d85f4406-7d66-4c5b-8518-63722c8822b0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] delete target: iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] delete target iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] failed to remove resource iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 because of JDSS resource iqn.2010-10.org.openstack:d85f4406-7d66-4c5b-8518-63722c8822b0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] deleating volume v_d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] get snapshots for volume v_d85f4406-7d66-4c5b-8518-63722c8822b0  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:18 user sudo[81154]: pam_unix(sudo:session): session closed for user root
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_4f2549ed-915f-4494-87f3-9269834fa9da_oamjng1u" returned: 0 in 0.957s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2 {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:18 user sudo[81169]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2
Apr 12 06:22:18 user sudo[81169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] get volume v_d85f4406-7d66-4c5b-8518-63722c8822b0 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d85f4406-7d66-4c5b-8518-63722c8822b0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281935', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59723', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17680990980749839988', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '73e1cf7199ce0e71', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114801352704', 'san:volume_id': '73e1cf7199ce0e71a9159ad7fa8ab8f7cd855065', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37191', 'name': 'v_d85f4406-7d66-4c5b-8518-63722c8822b0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] delete volume:v_d85f4406-7d66-4c5b-8518-63722c8822b0 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:19 user sudo[81169]: pam_unix(sudo:session): session closed for user root
Apr 12 06:22:19 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2" returned: 0 in 1.026s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:19 user cinder-volume[73792]: DEBUG cinder.image.image_utils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] 4f2549ed-915f-4494-87f3-9269834fa9da was qcow2, converting to raw {{(pid=73792) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:976}}
Apr 12 06:22:19 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2 of=/dev/sdb oflag=direct {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:19 user sudo[81201]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2 of=/dev/sdb oflag=direct
Apr 12 06:22:19 user sudo[81201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d85f4406-7d66-4c5b-8518-63722c8822b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] volume v_d85f4406-7d66-4c5b-8518-63722c8822b0 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG cinder.quota [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['63555312-c617-4504-a847-c99a1b794eb6'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:20 user cinder-volume[73792]: WARNING cinder.quota [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1655134230 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1655134230, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG cinder.quota [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['5a9c03a8-d74f-4fa7-b087-c524f3ef325d', '249f93b1-920c-4654-8cea-85399d6ad49d', '971b1d26-6e7c-4502-97a3-3ccefa2b5f1d', '8e9fd1d3-b34f-42e2-851a-c1a6f386067e'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:20 user sudo[81201]: pam_unix(sudo:session): session closed for user root
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2 of=/dev/sdb oflag=direct" returned: 0 in 0.993s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2 /dev/sdb {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG cinder.quota [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['335f0278-4317-4358-a5d1-e33c45e18dd1', '33f6e650-3e7e-4ca7-8009-490e9c2dc23e', 'a205f620-c091-431f-9cb9-dbeeee386395', 'd3fa80b9-8f3f-4fe0-8a4e-a1b389d30b3d'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:20 user sudo[81285]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2 /dev/sdb
Apr 12 06:22:20 user sudo[81285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=58,cinder:INSERT=13,cinder:UPDATE=29 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:INSERT=8,cinder:SELECT=46,cinder:UPDATE=45,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'available': '114801434624', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:22:21 user cinder-volume[73792]: DEBUG cinder.manager [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:22:21 user cinder-volume[73792]: INFO cinder.volume.manager [None req-041ae39c-0886-4bdd-9682-bbc291db5e4d tempest-GroupSnapshotsTest-2133346524 None] Delete group completed successfully.
Apr 12 06:22:22 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a40a510e-c2cc-4381-bddc-9b095435c70a tempest-GroupSnapshotsTest-2133346524 None] Group tempest-GroupSnapshotsTest-Group-1635908355: creating
Apr 12 06:22:22 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a40a510e-c2cc-4381-bddc-9b095435c70a tempest-GroupSnapshotsTest-2133346524 None] Group tempest-GroupSnapshotsTest-Group-1635908355: created successfully
Apr 12 06:22:22 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a40a510e-c2cc-4381-bddc-9b095435c70a tempest-GroupSnapshotsTest-2133346524 None] Create group completed successfully.
Apr 12 06:22:22 user sudo[81285]: pam_unix(sudo:session): session closed for user root
Apr 12 06:22:22 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2 /dev/sdb" returned: 0 in 2.131s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:22 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2 {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:22 user sudo[81472]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2
Apr 12 06:22:22 user sudo[81472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:22:23 user sudo[81472]: pam_unix(sudo:session): session closed for user root
Apr 12 06:22:23 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2" returned: 0 in 1.191s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:23 user cinder-volume[73792]: DEBUG cinder.image.image_utils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f2549ed-915f-4494-87f3-9269834fa9da_sokceonduser@joviandss-2, size 112.00 MB, duration 2.13 sec, destination /dev/sdb {{(pid=73792) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:432}}
Apr 12 06:22:23 user cinder-volume[73792]: INFO cinder.image.image_utils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Converted 112.00 MB image at 52.51 MB/s
Apr 12 06:22:23 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8769c81390>, {'target_iqn': 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PptcCjqG', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '26635346137396436', 'path': '/dev/sdb'}), 'kwargs': {'force': False}}" {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:22:23 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:22:23 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:22:23 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:24 user cinder-volume[73792]: INFO cinder.action_track [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-382720651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d2e0017-3e6d-4f25-a753-ce94c3339883,host='user@joviandss-2#joviandss-2',id=b3ddfd20-e026-4a8c-8f59-f13042de4b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec4e066a-ce4d-49b4-96ef-b71cfe3606c0),volume_type_id=ec4e066a-ce4d-49b4-96ef-b71cfe3606c0) 
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.039s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc814a46-d7fe-4063-82aa-19e5dd94e7ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:22:24 user cinder-volume[73792]: No targets found.
Apr 12 06:22:24 user cinder-volume[73792]: iSNS:
Apr 12 06:22:24 user cinder-volume[73792]: No targets found.
Apr 12 06:22:24 user cinder-volume[73792]: STATIC:
Apr 12 06:22:24 user cinder-volume[73792]: Target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29
Apr 12 06:22:24 user cinder-volume[73792]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:22:24 user cinder-volume[73792]:                 Iface Name: default
Apr 12 06:22:24 user cinder-volume[73792]: FIRMWARE:
Apr 12 06:22:24 user cinder-volume[73792]: No targets found.
Apr 12 06:22:24 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:22:24 user cinder-volume[73792]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:22:24 user cinder-volume[73792]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=73792) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29', 0)] {{(pid=73792) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e844ec3-0e83-4e29-bb3c-8e1912bbd52c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Flow 'volume_create_manager' (54f655f9-301f-469d-ab77-2a421faf015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798b6826-16f2-46e1-aeaf-8fca3e60c0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde2a3b7-91d2-4243-b93a-31121c9649e0]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:22:24 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:22:24 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8760251510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29'): ({'sdb'}, set())}) {{(pid=73792) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Removing single pathed devices sdb {{(pid=73792) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798b6826-16f2-46e1-aeaf-8fca3e60c0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-382720651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d2e0017-3e6d-4f25-a753-ce94c3339883,host='user@joviandss-2#joviandss-2',id=b3ddfd20-e026-4a8c-8f59-f13042de4b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:24Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec4e066a-ce4d-49b4-96ef-b71cfe3606c0),volume_type_id=ec4e066a-ce4d-49b4-96ef-b71cfe3606c0)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce712ced-c3fa-4e9a-83e7-4693ab91abd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce712ced-c3fa-4e9a-83e7-4693ab91abd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a454c1-32d4-40d7-8d78-034afaaac3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a454c1-32d4-40d7-8d78-034afaaac3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ddfd20-e026-4a8c-8f59-f13042de4b6b', 'volume_name': 'volume-b3ddfd20-e026-4a8c-8f59-f13042de4b6b', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1560b9b5-3dd2-4d5a-a209-ce9bc45b7670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1560b9b5-3dd2-4d5a-a209-ce9bc45b7670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2614d9-800b-458f-b2ae-a1083f007252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:24 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Volume b3ddfd20-e026-4a8c-8f59-f13042de4b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ddfd20-e026-4a8c-8f59-f13042de4b6b', 'volume_size': 1}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] creating volume v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] create volume {'name': 'v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.039s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfeb209-09d9-48ef-9ae1-c6dd3384a27f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.058s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[898baa6c-2e10-4328-8754-f0d5f17ebd98]: (4, ('ok\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Flushing IO for device /dev/sdb {{(pid=73792) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.033s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebee54f-efc8-499b-a85d-0a599e455d06]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73792) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.071s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1da7b7f-5ecf-403f-b642-0655b08ae9b1]: (4, ('1', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=73792) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] SCSI volumes sdb have been removed. {{(pid=73792) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29')] {{(pid=73792) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a699f3b-fb00-4f9c-bc4f-e978d9e30361]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --logout {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[64949f4c-0cea-4275-8c06-e82ee2388345]: (4, ('Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260]\nLogout of [sid: 1, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260]
Apr 12 06:22:24 user cinder-volume[73792]: Logout of [sid: 1, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260] successful.
Apr 12 06:22:24 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op delete {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[1367aece-d450-4ba3-9993-4701ff2675be]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.609s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] <== disconnect_volume: return (611ms) None {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] terminate connection for 6938de6c-91d6-44b2-af51-33e34e241f29  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.driver [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] volume 6938de6c-91d6-44b2-af51-33e34e241f29: removing export {{(pid=73792) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] remove_export for volume: 6938de6c-91d6-44b2-af51-33e34e241f29. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1929876138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6938de6c-91d6-44b2-af51-33e34e241f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP PptcCjqG n4SbVxr1tOhfIX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='downloading',terminated_at=None,updated_at=2023-04-12T06:22:03Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume v_6938de6c-91d6-44b2-af51-33e34e241f29 from target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns/v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns/v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b', 'is_clone': False, 'name': 'v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:25 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2614d9-800b-458f-b2ae-a1083f007252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ddfd20-e026-4a8c-8f59-f13042de4b6b', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:25 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c83407-65e6-4cbd-8cae-db500b7d6326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:25 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Volume volume-b3ddfd20-e026-4a8c-8f59-f13042de4b6b (b3ddfd20-e026-4a8c-8f59-f13042de4b6b): created successfully
Apr 12 06:22:25 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c83407-65e6-4cbd-8cae-db500b7d6326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:25 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] Flow 'volume_create_manager' (54f655f9-301f-469d-ab77-2a421faf015a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:25 user cinder-volume[73792]: INFO cinder.action_track [None req-07032af4-4007-4d15-ba75-a78860976764 tempest-GroupSnapshotsTest-2133346524 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-382720651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d2e0017-3e6d-4f25-a753-ce94c3339883,host='user@joviandss-2#joviandss-2',id=b3ddfd20-e026-4a8c-8f59-f13042de4b6b,launched_at=2023-04-12T06:22:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth='CHAP gjVtaDCf f2Lo6tMDvQWABw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:24Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:24Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec4e066a-ce4d-49b4-96ef-b71cfe3606c0),volume_type_id=ec4e066a-ce4d-49b4-96ef-b71cfe3606c0) 
Apr 12 06:22:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns/v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:22:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:22:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Downloaded image 4f2549ed-915f-4494-87f3-9269834fa9da ((None, None)) to volume 6938de6c-91d6-44b2-af51-33e34e241f29 successfully. {{(pid=73792) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.image.image_utils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Temporary image 4f2549ed-915f-4494-87f3-9269834fa9da for user 977b800fab264446b0492c93b0dc12d3 is deleted. {{(pid=73792) fetch /opt/stack/cinder/cinder/image/image_utils.py:1283}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.quota [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Created reservations ['52602fd6-8626-451b-a415-a9ca6914cb30', 'ddc0bb22-c6e6-4c9a-94d5-756c141c4072', 'f65d1b7d-69e6-4c93-af1f-a7e31fbbda04', '5ca4411d-bcbb-448c-a35e-0284fdf80737'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Creating image volume entry: {'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'replication_driver_data': None, 'updated_at': datetime.datetime(2023, 4, 12, 6, 22, 3, tzinfo=datetime.timezone.utc), 'provider_id': None, 'created_at': datetime.datetime(2023, 4, 12, 6, 22, 3, tzinfo=datetime.timezone.utc), 'provider_auth': 'CHAP PptcCjqG n4SbVxr1tOhfIX', 'user_id': '977b800fab264446b0492c93b0dc12d3', 'display_description': None, 'ec2_id': None, 'scheduled_at': datetime.datetime(2023, 4, 12, 6, 22, 3, tzinfo=datetime.timezone.utc), 'metadata': {}, 'volume_metadata': [], 'host': 'user@joviandss-2#joviandss-2', 'consistencygroup_id': None, 'project_id': '47ae5d35908f49c5b6139fe1fea0ac76', 'terminated_at': None, 'cluster_name': None, 'volume_type_id': 'e0e0be60-6fb6-4d45-a78c-55d792af9857', 'volume_admin_metadata': [], 'display_name': 'image-4f2549ed-915f-4494-87f3-9269834fa9da', 'shared_targets': True, 'provider_geometry': None, 'group_id': None, 'size': 1, 'availability_zone': 'nova', 'replication_status': None, 'launched_at': None, 'deleted': False, 'encryption_key_id': None, 'replication_extended_status': None, 'previous_status': None, 'provider_location': '172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0', 'service_uuid': None, 'multiattach': False, 'deleted_at': None, 'bootable': False, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '6938de6c-91d6-44b2-af51-33e34e241f29'}. {{(pid=73792) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1679}}
Apr 12 06:22:26 user cinder-volume[73792]: INFO cinder.action_track [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='image-4f2549ed-915f-4494-87f3-9269834fa9da',ec2_id=None,encryption_key_id=None,glance_metadata={signature_verified='False'},group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ae5d35908f49c5b6139fe1fea0ac76',provider_auth='CHAP PptcCjqG n4SbVxr1tOhfIX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=6938de6c-91d6-44b2-af51-33e34e241f29,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:03Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume reschedule parameters: False retry: None {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Flow 'volume_create_manager' (fded7caf-51cc-43c0-9e72-72827d58bf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75fe7fd-2a94-4ef1-8939-98f630e1ee11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75fe7fd-2a94-4ef1-8939-98f630e1ee11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='image-4f2549ed-915f-4494-87f3-9269834fa9da',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ae5d35908f49c5b6139fe1fea0ac76',provider_auth='CHAP PptcCjqG n4SbVxr1tOhfIX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=6938de6c-91d6-44b2-af51-33e34e241f29,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:03Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89307153-3eb2-47ee-aeb4-1a5d56db51fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89307153-3eb2-47ee-aeb4-1a5d56db51fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62fb6da-4004-432d-8382-0e3e7ff01c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62fb6da-4004-432d-8382-0e3e7ff01c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'volume_name': 'volume-fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'volume_size': 1, 'source_volid': '6938de6c-91d6-44b2-af51-33e34e241f29', 'source_volstatus': 'downloading'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d94179e-2f21-4a7d-ab52-89c1d7a1a3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d94179e-2f21-4a7d-ab52-89c1d7a1a3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb3cded-278d-42a4-8e77-8024051863fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:26 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'volume_size': 1, 'source_volid': '6938de6c-91d6-44b2-af51-33e34e241f29', 'source_volstatus': 'downloading'}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] cloned volume 6938de6c-91d6-44b2-af51-33e34e241f29 to fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] cloning v_6938de6c-91d6-44b2-af51-33e34e241f29 to v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] create snapshot v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6938de6c-91d6-44b2-af51-33e34e241f29/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6938de6c-91d6-44b2-af51-33e34e241f29/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:26 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] GroupSnapshot f3d070c3-1216-4a07-90bd-f98ea2aa3303: creating.
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] Group snapshot f3d070c3-1216-4a07-90bd-f98ea2aa3303: creating. {{(pid=73792) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4160}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] create snapshot 804a5c77-72d3-4a95-b2e1-0ff316c22d44 for volume b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] cloning v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b to s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] create snapshot s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6938de6c-91d6-44b2-af51-33e34e241f29/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] create volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f from snapshot v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6938de6c-91d6-44b2-af51-33e34e241f29/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6938de6c-91d6-44b2-af51-33e34e241f29/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_804a5c77-72d3-4a95-b2e1-0ff316c22d44'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] create volume s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 from snapshot s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_6938de6c-91d6-44b2-af51-33e34e241f29@v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'is_clone': True, 'full_name': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'name': 'v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6938de6c-91d6-44b2-af51-33e34e241f29/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] get volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_6938de6c-91d6-44b2-af51-33e34e241f29@v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281964', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '59803', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14856853852241740067', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cf35d2978ae9e59a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114785005568', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '36161', 'name': 'v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb3cded-278d-42a4-8e77-8024051863fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'volume_size': 1, 'source_volid': '6938de6c-91d6-44b2-af51-33e34e241f29', 'source_volstatus': 'downloading'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f48495-cd59-4df4-b5d1-ba551f119253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:27 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume volume-fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f (fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f): created successfully
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f48495-cd59-4df4-b5d1-ba551f119253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Flow 'volume_create_manager' (fded7caf-51cc-43c0-9e72-72827d58bf06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:27 user cinder-volume[73792]: INFO cinder.action_track [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='image-4f2549ed-915f-4494-87f3-9269834fa9da',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f,launched_at=2023-04-12T06:22:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ae5d35908f49c5b6139fe1fea0ac76',provider_auth='CHAP gWimcZUl EGyr2eDB7da1nv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=6938de6c-91d6-44b2-af51-33e34e241f29,status='available',terminated_at=None,updated_at=2023-04-12T06:22:03Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Creating new image-volume cache entry for image 4f2549ed-915f-4494-87f3-9269834fa9da on user@joviandss-2#joviandss-2 {{(pid=73792) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] New image-volume cache entry created: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 22, 27, 682023)}. {{(pid=73792) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 24.353s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Marking volume 6938de6c-91d6-44b2-af51-33e34e241f29 as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to 6938de6c-91d6-44b2-af51-33e34e241f29. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Creating volume glance metadata for volume 6938de6c-91d6-44b2-af51-33e34e241f29 backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b466718-358e-4107-ab11-457fecdcee9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6938de6c-91d6-44b2-af51-33e34e241f29', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769ca1e70>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19519223-d555-4c4e-baa2-e171c76f4be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:27 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume volume-6938de6c-91d6-44b2-af51-33e34e241f29 (6938de6c-91d6-44b2-af51-33e34e241f29): created successfully
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19519223-d555-4c4e-baa2-e171c76f4be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] Flow 'volume_create_manager' (2ce6ff57-682f-4c0c-adcd-d66286fe9f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:27 user cinder-volume[73792]: INFO cinder.action_track [None req-3341507e-ecd7-42b6-918c-c740faedadf1 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1929876138',ec2_id=None,encryption_key_id=None,glance_metadata={signature_verified='False'},group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6938de6c-91d6-44b2-af51-33e34e241f29,launched_at=2023-04-12T06:22:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP PptcCjqG n4SbVxr1tOhfIX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:03Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b@s_804a5c77-72d3-4a95-b2e1-0ff316c22d44', 'is_clone': True, 'full_name': 'Pool-0/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44', 'name': 's_804a5c77-72d3-4a95-b2e1-0ff316c22d44'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] volume s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:22:28 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7aa5806e-a3ed-413d-8b80-59a0751f5dc9 tempest-GroupSnapshotsTest-2133346524 None] group_snapshot f3d070c3-1216-4a07-90bd-f98ea2aa3303: created successfully
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 22.515s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 22, 28, 173755)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Found cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 22, 28, 186461)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Creating from source image-volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] cloned volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] cloning v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] create snapshot v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:28 user cinder-volume[73792]: INFO cinder.action_track [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-15452148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3d1bda7d-311d-45ff-9270-f1f4126818f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Flow 'volume_create_manager' (0619a7f5-e932-4dbd-8296-7ce48a3c73b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b89df8a-56d3-4ada-b550-0cb1677a7199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_ac2c28f3-2ecb-41f6-b97b-b8749353655b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] create volume v_ac2c28f3-2ecb-41f6-b97b-b8749353655b from snapshot v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b89df8a-56d3-4ada-b550-0cb1677a7199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-15452148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3d1bda7d-311d-45ff-9270-f1f4126818f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:29Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842a20d2-1428-4f4d-b98d-a2a8011fdf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842a20d2-1428-4f4d-b98d-a2a8011fdf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b357cc-729a-4201-bf9e-e1b99b15292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b357cc-729a-4201-bf9e-e1b99b15292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d1bda7d-311d-45ff-9270-f1f4126818f3', 'volume_name': 'volume-3d1bda7d-311d-45ff-9270-f1f4126818f3', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7e832c-9565-435e-b331-66bad88e690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7e832c-9565-435e-b331-66bad88e690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4cdd9b-4351-43da-8952-e78cbbc505a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:28 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume 3d1bda7d-311d-45ff-9270-f1f4126818f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d1bda7d-311d-45ff-9270-f1f4126818f3', 'volume_size': 1}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] creating volume v_3d1bda7d-311d-45ff-9270-f1f4126818f3. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] create volume {'name': 'v_3d1bda7d-311d-45ff-9270-f1f4126818f3', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:29 user cinder-volume[73792]: INFO cinder.volume.manager [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] group_snapshot f3d070c3-1216-4a07-90bd-f98ea2aa3303: deleting
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] group_snapshot f3d070c3-1216-4a07-90bd-f98ea2aa3303: deleting {{(pid=73792) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4335}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=65,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=13 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] deleating snapshot s_804a5c77-72d3-4a95-b2e1-0ff316c22d44. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] get snapshots for volume s_804a5c77-72d3-4a95-b2e1-0ff316c22d44  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_ac2c28f3-2ecb-41f6-b97b-b8749353655b', 'is_clone': True, 'full_name': 'Pool-0/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b', 'name': 'v_ac2c28f3-2ecb-41f6-b97b-b8749353655b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] get volume v_ac2c28f3-2ecb-41f6-b97b-b8749353655b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_ac2c28f3-2ecb-41f6-b97b-b8749353655b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281966', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '59814', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3449550189252373942', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b7d975e547b880c7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784862208', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '36086', 'name': 'v_ac2c28f3-2ecb-41f6-b97b-b8749353655b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Marking volume ac2c28f3-2ecb-41f6-b97b-b8749353655b as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to ac2c28f3-2ecb-41f6-b97b-b8749353655b. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Creating volume glance metadata for volume ac2c28f3-2ecb-41f6-b97b-b8749353655b backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=70,cinder:UPDATE=17,cinder:INSERT=12,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5275d64-1dc6-4526-b55c-fae68101bda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2c28f3-2ecb-41f6-b97b-b8749353655b', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769b8b040>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc73b75-0614-4d03-9a38-695f70f8bffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:29 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Volume volume-ac2c28f3-2ecb-41f6-b97b-b8749353655b (ac2c28f3-2ecb-41f6-b97b-b8749353655b): created successfully
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc73b75-0614-4d03-9a38-695f70f8bffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (c2c5f75f-dc23-4aa0-8d02-a50a2a0851e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3d1bda7d-311d-45ff-9270-f1f4126818f3', 'is_clone': False, 'name': 'v_3d1bda7d-311d-45ff-9270-f1f4126818f3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4cdd9b-4351-43da-8952-e78cbbc505a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d1bda7d-311d-45ff-9270-f1f4126818f3', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b85924b-4720-44c5-9a46-6c07e9611978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:29 user cinder-volume[73792]: INFO cinder.action_track [None req-64aff8d0-f0bc-46ce-b160-97f2524788d0 tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1707023688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ac2c28f3-2ecb-41f6-b97b-b8749353655b,launched_at=2023-04-12T06:22:29Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP uANZPolv 9bXHB1vk84iLIJ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:05Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:05Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:29 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume volume-3d1bda7d-311d-45ff-9270-f1f4126818f3 (3d1bda7d-311d-45ff-9270-f1f4126818f3): created successfully
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b85924b-4720-44c5-9a46-6c07e9611978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] Flow 'volume_create_manager' (0619a7f5-e932-4dbd-8296-7ce48a3c73b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:29 user cinder-volume[73792]: INFO cinder.action_track [None req-b9543014-fe66-4a3c-a057-ff9deb7ef291 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-15452148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3d1bda7d-311d-45ff-9270-f1f4126818f3,launched_at=2023-04-12T06:22:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP TjSIiUbK 5crgQLCAMJSOev',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:29Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:29Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] get volume s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b@s_804a5c77-72d3-4a95-b2e1-0ff316c22d44', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281964', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59807', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15910165128650534249', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8cf20596fdb7ec7e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784825344', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '35429', 'name': 's_804a5c77-72d3-4a95-b2e1-0ff316c22d44', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] delete snapshot s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 of volume v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b/snapshots/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b/snapshots/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:30 user cinder-volume[73792]: INFO cinder.action_track [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-779396692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19059339-d01d-43bc-9939-181649d28bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Flow 'volume_create_manager' (73f209d7-1f65-4c9d-8c3a-45ff3e828f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6e9645-ae04-45d9-8c99-cace62b42a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:30 user cinder-volume[73792]: INFO cinder.action_track [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-910527140',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=95edcd2d-3957-47cf-9ac3-879755cd38a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6e9645-ae04-45d9-8c99-cace62b42a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-779396692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19059339-d01d-43bc-9939-181649d28bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:30Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf3de3a-bd6a-4bb2-be01-6a4ea369a931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf3de3a-bd6a-4bb2-be01-6a4ea369a931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018bbb51-4bf5-4d0d-a301-9186a4b3b456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018bbb51-4bf5-4d0d-a301-9186a4b3b456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19059339-d01d-43bc-9939-181649d28bc6', 'volume_name': 'volume-19059339-d01d-43bc-9939-181649d28bc6', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ffde58-ed3e-4463-930b-d4117c05d7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ffde58-ed3e-4463-930b-d4117c05d7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d21d6c-5657-44db-b18e-8020531237af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:30 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume 19059339-d01d-43bc-9939-181649d28bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19059339-d01d-43bc-9939-181649d28bc6', 'volume_size': 1}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] creating volume v_19059339-d01d-43bc-9939-181649d28bc6. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] create volume {'name': 'v_19059339-d01d-43bc-9939-181649d28bc6', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (e198f9dc-741d-43a2-b2a6-414f7b94fca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00693a86-e22c-477c-8963-479710ba769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00693a86-e22c-477c-8963-479710ba769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-910527140',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=95edcd2d-3957-47cf-9ac3-879755cd38a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:30Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb64832-9b67-4378-9898-b6566867c8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb64832-9b67-4378-9898-b6566867c8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f4febc-8c79-4641-b738-bf5ba8e6dcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f4febc-8c79-4641-b738-bf5ba8e6dcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95edcd2d-3957-47cf-9ac3-879755cd38a2', 'volume_name': 'volume-95edcd2d-3957-47cf-9ac3-879755cd38a2', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d82a60e-37a0-458d-af9d-7b994d87e7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d82a60e-37a0-458d-af9d-7b994d87e7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76ab7e3-ee66-47cc-83db-d8d05624f564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:30 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Volume 95edcd2d-3957-47cf-9ac3-879755cd38a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95edcd2d-3957-47cf-9ac3-879755cd38a2', 'volume_size': 1}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] creating volume v_95edcd2d-3957-47cf-9ac3-879755cd38a2. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] create volume {'name': 'v_95edcd2d-3957-47cf-9ac3-879755cd38a2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b/snapshots/s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] snapshot s_804a5c77-72d3-4a95-b2e1-0ff316c22d44 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:22:30 user cinder-volume[73792]: WARNING cinder.quota [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1625211265 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1625211265, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:22:30 user cinder-volume[73792]: WARNING cinder.quota [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1625211265 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1625211265, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.quota [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['3449eba3-086f-49d3-b74d-87d88d6536a6', 'daf09e2f-4101-44ea-b9d7-010f315935ac', 'f449b117-0c1c-45fa-9815-4631f3242c51', '22fe0914-bd2f-4d6b-9313-00a255f01410'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:30 user cinder-volume[73792]: INFO cinder.volume.manager [None req-ac2066e8-274c-4174-a77d-66cbfd451da3 tempest-GroupSnapshotsTest-2133346524 None] group_snapshot f3d070c3-1216-4a07-90bd-f98ea2aa3303: deleted successfully
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114784837632', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:22:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_19059339-d01d-43bc-9939-181649d28bc6', 'is_clone': False, 'name': 'v_19059339-d01d-43bc-9939-181649d28bc6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d21d6c-5657-44db-b18e-8020531237af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19059339-d01d-43bc-9939-181649d28bc6', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1794f73-d2c6-4bf5-92f0-a8165deedac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:31 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Volume volume-19059339-d01d-43bc-9939-181649d28bc6 (19059339-d01d-43bc-9939-181649d28bc6): created successfully
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1794f73-d2c6-4bf5-92f0-a8165deedac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] Flow 'volume_create_manager' (73f209d7-1f65-4c9d-8c3a-45ff3e828f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:31 user cinder-volume[73792]: INFO cinder.action_track [None req-7db88b77-9b73-4169-be70-f69a1cc4145a tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-779396692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19059339-d01d-43bc-9939-181649d28bc6,launched_at=2023-04-12T06:22:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP CdTKAgwm 5vYsn74DwoPgT8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:30Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_95edcd2d-3957-47cf-9ac3-879755cd38a2', 'is_clone': False, 'name': 'v_95edcd2d-3957-47cf-9ac3-879755cd38a2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76ab7e3-ee66-47cc-83db-d8d05624f564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95edcd2d-3957-47cf-9ac3-879755cd38a2', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474058f9-458e-477e-a721-a74cc261f0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:31 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Volume volume-95edcd2d-3957-47cf-9ac3-879755cd38a2 (95edcd2d-3957-47cf-9ac3-879755cd38a2): created successfully
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474058f9-458e-477e-a721-a74cc261f0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] Flow 'volume_create_manager' (e198f9dc-741d-43a2-b2a6-414f7b94fca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:31 user cinder-volume[73792]: INFO cinder.action_track [None req-aca60238-8fce-469f-ae07-8253fc53652a tempest-VolumesGetTest-136869643 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-910527140',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=95edcd2d-3957-47cf-9ac3-879755cd38a2,launched_at=2023-04-12T06:22:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP lszSBDQo whtDSpdm0Mc2bR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:30Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] remove_export for volume: b3ddfd20-e026-4a8c-8f59-f13042de4b6b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-382720651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d2e0017-3e6d-4f25-a753-ce94c3339883,host='user@joviandss-2#joviandss-2',id=b3ddfd20-e026-4a8c-8f59-f13042de4b6b,launched_at=2023-04-12T06:22:26Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf2de76110d43f5a543577870210488',provider_auth='CHAP gjVtaDCf f2Lo6tMDvQWABw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:24Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-12T06:22:32Z,use_quota=True,user_id='868337bf1684489d88dda6765134835e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec4e066a-ce4d-49b4-96ef-b71cfe3606c0),volume_type_id=ec4e066a-ce4d-49b4-96ef-b71cfe3606c0) from target:iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] detach volume v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b from target iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b/luns/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b/luns/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b/luns/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b/luns/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] failed to remove resource iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b because of JDSS resource v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] delete target: iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] delete target iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] failed to remove resource iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b because of JDSS resource iqn.2010-10.org.openstack:b3ddfd20-e026-4a8c-8f59-f13042de4b6b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] deleating volume v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] get snapshots for volume v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] get volume v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281962', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59793', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17684146549418507240', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '36304d43745360ce', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784673792', 'san:volume_id': '36304d43745360ce1eb4ab92e2182c9f1a642ae4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36073', 'name': 'v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] delete volume:v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Acquiring lock "cinder-95edcd2d-3957-47cf-9ac3-879755cd38a2-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Lock "cinder-95edcd2d-3957-47cf-9ac3-879755cd38a2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] remove_export for volume: 95edcd2d-3957-47cf-9ac3-879755cd38a2. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1707023688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=95edcd2d-3957-47cf-9ac3-879755cd38a2,launched_at=2023-04-12T06:22:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP lszSBDQo whtDSpdm0Mc2bR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:22:33Z,updated_at=2023-04-12T06:22:33Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] detach volume v_95edcd2d-3957-47cf-9ac3-879755cd38a2 from target iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2/luns/v_95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2/luns/v_95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2/luns/v_95edcd2d-3957-47cf-9ac3-879755cd38a2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2/luns/v_95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 because of JDSS resource v_95edcd2d-3957-47cf-9ac3-879755cd38a2 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] delete target: iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] delete target iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 because of JDSS resource iqn.2010-10.org.openstack:95edcd2d-3957-47cf-9ac3-879755cd38a2 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] deleating volume v_95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] get snapshots for volume v_95edcd2d-3957-47cf-9ac3-879755cd38a2  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95edcd2d-3957-47cf-9ac3-879755cd38a2/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95edcd2d-3957-47cf-9ac3-879755cd38a2/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95edcd2d-3957-47cf-9ac3-879755cd38a2/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] get volume v_95edcd2d-3957-47cf-9ac3-879755cd38a2 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_95edcd2d-3957-47cf-9ac3-879755cd38a2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281968', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59830', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15525913487293507307', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2a164dacb8b9cbf2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784755712', 'san:volume_id': '2a164dacb8b9cbf2c8b56b46093b6f233843a943', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37420', 'name': 'v_95edcd2d-3957-47cf-9ac3-879755cd38a2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] delete volume:v_95edcd2d-3957-47cf-9ac3-879755cd38a2 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] volume v_b3ddfd20-e026-4a8c-8f59-f13042de4b6b deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.quota [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['9b07de4e-7a07-43ea-91cc-27b279c4a8b3'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:33 user cinder-volume[73792]: WARNING cinder.quota [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1625211265 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1625211265, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.quota [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Created reservations ['b980e845-f44b-4218-8234-495da560d23b', '2727b2d5-278c-4e93-99de-b9d38f72c8ad', '03fa3c29-4908-4c99-9de0-904a26d0cc70', '0127f39e-2ebf-4db7-b2e5-53410b44f685'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Geting {'code': 200, 'error': None, 'data': {'available': '114784825344', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:22:34 user cinder-volume[73792]: DEBUG cinder.manager [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:22:34 user cinder-volume[73792]: INFO cinder.volume.manager [None req-ace2aa28-43ee-43e9-85ca-c6d01cd0bce1 tempest-GroupSnapshotsTest-2133346524 None] Delete group completed successfully.
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95edcd2d-3957-47cf-9ac3-879755cd38a2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] volume v_95edcd2d-3957-47cf-9ac3-879755cd38a2 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=60,cinder:INSERT=11,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG cinder.quota [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Created reservations ['1dfb1734-31d2-4e92-bd54-e85bdbab7328', 'bc6506a9-1d18-4f4b-9a51-0820615d8527', '14b3e77c-0f37-4041-8e8c-ef120eedbf39', '65d1013b-c890-430b-bccd-4b71b8aa69bd'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=27,cinder:SELECT=58,cinder:INSERT=13,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'available': '114784825344', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG cinder.manager [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:22:35 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Deleted volume successfully.
Apr 12 06:22:35 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c9853790-f942-4a12-9e85-885173c925a6 tempest-VolumesGetTest-136869643 None] Lock "cinder-95edcd2d-3957-47cf-9ac3-879755cd38a2-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.coordination [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Acquiring lock "cinder-ac2c28f3-2ecb-41f6-b97b-b8749353655b-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.coordination [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Lock "cinder-ac2c28f3-2ecb-41f6-b97b-b8749353655b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] remove_export for volume: ac2c28f3-2ecb-41f6-b97b-b8749353655b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:05Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-2053861840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ac2c28f3-2ecb-41f6-b97b-b8749353655b,launched_at=2023-04-12T06:22:29Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='880a9aa73fd34b2a94154bf441e9dd40',provider_auth='CHAP uANZPolv 9bXHB1vk84iLIJ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:05Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:22:36Z,updated_at=2023-04-12T06:22:36Z,use_quota=True,user_id='0c9a5aa63b504fc69888aeb65c1869e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] detach volume v_ac2c28f3-2ecb-41f6-b97b-b8749353655b from target iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b/luns/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b/luns/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b/luns/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b/luns/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b because of JDSS resource v_ac2c28f3-2ecb-41f6-b97b-b8749353655b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] delete target: iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] delete target iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] failed to remove resource iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b because of JDSS resource iqn.2010-10.org.openstack:ac2c28f3-2ecb-41f6-b97b-b8749353655b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] deleating volume v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] get snapshots for volume v_ac2c28f3-2ecb-41f6-b97b-b8749353655b  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] get volume v_ac2c28f3-2ecb-41f6-b97b-b8749353655b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_ac2c28f3-2ecb-41f6-b97b-b8749353655b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281966', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '59814', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3449550189252373942', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b7d975e547b880c7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784825344', 'san:volume_id': 'b7d975e547b880c76c2a1a9a369575b09400d356', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '36086', 'name': 'v_ac2c28f3-2ecb-41f6-b97b-b8749353655b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] delete snapshot v_ac2c28f3-2ecb-41f6-b97b-b8749353655b of volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_ac2c28f3-2ecb-41f6-b97b-b8749353655b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] snapshot v_ac2c28f3-2ecb-41f6-b97b-b8749353655b deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:22:37 user cinder-volume[73792]: DEBUG cinder.quota [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Created reservations ['75fd0007-eb18-4111-b0f1-0c5c761f7351', '4f9f86a9-a39a-482d-bc0b-c7aa2ab7f0c5', '845aba38-dfba-49fd-8864-ebb531afd2bb', '06f67eb5-75f7-42a2-b6b5-0b72f2cb0ad1'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:22:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:22:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Geting {'code': 200, 'error': None, 'data': {'available': '114784849920', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:22:38 user cinder-volume[73792]: DEBUG cinder.manager [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:22:38 user cinder-volume[73792]: INFO cinder.volume.manager [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Deleted volume successfully.
Apr 12 06:22:38 user cinder-volume[73792]: DEBUG cinder.coordination [None req-9c15de85-5fd8-44c3-b4ec-ff298ee46b60 tempest-VolumesGetTest-136869643 None] Lock "cinder-ac2c28f3-2ecb-41f6-b97b-b8749353655b-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:22:38 user cinder-volume[73792]: INFO cinder.volume.manager [None req-063fe084-7a87-4534-96d3-2d75ee014321 tempest-GroupSnapshotsV319Test-2116381113 None] Group tempest-GroupSnapshotsV319Test-Group-376251883: creating
Apr 12 06:22:38 user cinder-volume[73792]: INFO cinder.volume.manager [None req-063fe084-7a87-4534-96d3-2d75ee014321 tempest-GroupSnapshotsV319Test-2116381113 None] Group tempest-GroupSnapshotsV319Test-Group-376251883: created successfully
Apr 12 06:22:38 user cinder-volume[73792]: INFO cinder.volume.manager [None req-063fe084-7a87-4534-96d3-2d75ee014321 tempest-GroupSnapshotsV319Test-2116381113 None] Create group completed successfully.
Apr 12 06:22:39 user cinder-volume[73792]: INFO cinder.action_track [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1602084391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e5bf291-763c-4655-963e-0cb0e0adde18,host='user@joviandss-2#joviandss-2',id=7b5a0775-127c-4d11-b8e7-7ef2ac247e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1a28ff01b34dbda6b23744c85dbdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='ab107f6f941c42108b5d4db09cdb1976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2456a91-9c92-4a6a-8be6-91b4f5603707),volume_type_id=d2456a91-9c92-4a6a-8be6-91b4f5603707) 
Apr 12 06:22:39 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Flow 'volume_create_manager' (9929bb7b-641f-4db4-9293-cd90d03b65d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0bb0fcc-b61e-45db-b7e4-f904799e073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0bb0fcc-b61e-45db-b7e4-f904799e073d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1602084391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e5bf291-763c-4655-963e-0cb0e0adde18,host='user@joviandss-2#joviandss-2',id=7b5a0775-127c-4d11-b8e7-7ef2ac247e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1a28ff01b34dbda6b23744c85dbdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:40Z,use_quota=True,user_id='ab107f6f941c42108b5d4db09cdb1976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2456a91-9c92-4a6a-8be6-91b4f5603707),volume_type_id=d2456a91-9c92-4a6a-8be6-91b4f5603707)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e321bf-2486-4d90-ad7f-8a7588038e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e321bf-2486-4d90-ad7f-8a7588038e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b31663f-9c51-498c-8dab-8b704d7b3f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b31663f-9c51-498c-8dab-8b704d7b3f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b5a0775-127c-4d11-b8e7-7ef2ac247e33', 'volume_name': 'volume-7b5a0775-127c-4d11-b8e7-7ef2ac247e33', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e067ed-d021-4d8a-bdf1-354237ca3e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e067ed-d021-4d8a-bdf1-354237ca3e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6602676d-bdac-49fe-85f4-77448ce4ee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Volume 7b5a0775-127c-4d11-b8e7-7ef2ac247e33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b5a0775-127c-4d11-b8e7-7ef2ac247e33', 'volume_size': 1}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] creating volume v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] create volume {'name': 'v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33', 'is_clone': False, 'name': 'v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6602676d-bdac-49fe-85f4-77448ce4ee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5a0775-127c-4d11-b8e7-7ef2ac247e33', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c3ae16-8330-4db8-a8d3-0727f68155cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Volume volume-7b5a0775-127c-4d11-b8e7-7ef2ac247e33 (7b5a0775-127c-4d11-b8e7-7ef2ac247e33): created successfully
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c3ae16-8330-4db8-a8d3-0727f68155cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] Flow 'volume_create_manager' (9929bb7b-641f-4db4-9293-cd90d03b65d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:40 user cinder-volume[73792]: INFO cinder.action_track [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-673748094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7b336ad6-910c-4dd4-8ef4-c16d440e9881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:40 user cinder-volume[73792]: INFO cinder.action_track [None req-8b81017c-690c-4f82-8138-5524fb9582ad tempest-GroupSnapshotsV319Test-2116381113 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1602084391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e5bf291-763c-4655-963e-0cb0e0adde18,host='user@joviandss-2#joviandss-2',id=7b5a0775-127c-4d11-b8e7-7ef2ac247e33,launched_at=2023-04-12T06:22:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1a28ff01b34dbda6b23744c85dbdae',provider_auth='CHAP YjEXSnws f84C23uAR5Hpi9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:40Z,use_quota=True,user_id='ab107f6f941c42108b5d4db09cdb1976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2456a91-9c92-4a6a-8be6-91b4f5603707),volume_type_id=d2456a91-9c92-4a6a-8be6-91b4f5603707) 
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Flow 'volume_create_manager' (88e99f1f-c7e4-4d8b-bfd1-6c1db24b1590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa3f854-48c4-46ec-8134-75492844fa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa3f854-48c4-46ec-8134-75492844fa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-673748094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7b336ad6-910c-4dd4-8ef4-c16d440e9881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:41Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ab308b-1b9a-49ba-803a-49210f9853e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ab308b-1b9a-49ba-803a-49210f9853e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0771ad19-2707-4c20-995a-2c4c16903a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0771ad19-2707-4c20-995a-2c4c16903a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'volume_name': 'volume-7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feee3761-f48e-491c-9c00-691d649a4587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feee3761-f48e-491c-9c00-691d649a4587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94ea6bf-3500-4356-b52a-d18263326817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Volume 7b336ad6-910c-4dd4-8ef4-c16d440e9881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'volume_size': 1}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] creating volume v_7b336ad6-910c-4dd4-8ef4-c16d440e9881. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] create volume {'name': 'v_7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'is_clone': False, 'name': 'v_7b336ad6-910c-4dd4-8ef4-c16d440e9881'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94ea6bf-3500-4356-b52a-d18263326817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5248550-db57-4f12-92fc-fa3a1f3bbcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:41 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Volume volume-7b336ad6-910c-4dd4-8ef4-c16d440e9881 (7b336ad6-910c-4dd4-8ef4-c16d440e9881): created successfully
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5248550-db57-4f12-92fc-fa3a1f3bbcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] Flow 'volume_create_manager' (88e99f1f-c7e4-4d8b-bfd1-6c1db24b1590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:41 user cinder-volume[73792]: INFO cinder.action_track [None req-fe117678-bc10-406f-a282-6cbcc872f467 tempest-TestStampPattern-1782553765 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-673748094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7b336ad6-910c-4dd4-8ef4-c16d440e9881,launched_at=2023-04-12T06:22:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP zvpZhPcJ YTkzhvPCfoUt58',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:41Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:41Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:41 user cinder-volume[73792]: INFO cinder.volume.manager [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] GroupSnapshot 35573a8a-f50c-4fba-8eb9-52be097b2a91: creating.
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] Group snapshot 35573a8a-f50c-4fba-8eb9-52be097b2a91: creating. {{(pid=73792) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4160}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] create snapshot c2287c61-6562-4bf5-a32a-218fed9a0ca6 for volume 7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] cloning v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 to s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] create snapshot s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c2287c61-6562-4bf5-a32a-218fed9a0ca6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] create volume s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 from snapshot s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33@s_c2287c61-6562-4bf5-a32a-218fed9a0ca6', 'is_clone': True, 'full_name': 'Pool-0/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6', 'name': 's_c2287c61-6562-4bf5-a32a-218fed9a0ca6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] volume s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:22:42 user cinder-volume[73792]: INFO cinder.volume.manager [None req-cbb3ab05-c03e-4fc2-9378-589310aa65b5 tempest-GroupSnapshotsV319Test-2116381113 None] group_snapshot 35573a8a-f50c-4fba-8eb9-52be097b2a91: created successfully
Apr 12 06:22:42 user cinder-volume[73792]: INFO cinder.volume.manager [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] group_snapshot 35573a8a-f50c-4fba-8eb9-52be097b2a91: deleting
Apr 12 06:22:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] group_snapshot 35573a8a-f50c-4fba-8eb9-52be097b2a91: deleting {{(pid=73792) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4335}}
Apr 12 06:22:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] deleating snapshot s_c2287c61-6562-4bf5-a32a-218fed9a0ca6. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:22:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] get snapshots for volume s_c2287c61-6562-4bf5-a32a-218fed9a0ca6  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] get volume s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33@s_c2287c61-6562-4bf5-a32a-218fed9a0ca6', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281979', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59849', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4217449747989425841', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd423dc976fbfbb57', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784673792', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37056', 'name': 's_c2287c61-6562-4bf5-a32a-218fed9a0ca6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] delete snapshot s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 of volume v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:22:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33/snapshots/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33/snapshots/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33/snapshots/s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] snapshot s_c2287c61-6562-4bf5-a32a-218fed9a0ca6 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:22:43 user cinder-volume[73792]: WARNING cinder.quota [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-838505421 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-838505421, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:22:43 user cinder-volume[73792]: WARNING cinder.quota [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-838505421 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-838505421, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:22:43 user cinder-volume[73792]: DEBUG cinder.quota [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] Created reservations ['101c5d51-10ee-44b2-9532-d04379c0a7c4', '8a78c347-ddbd-4595-b0a5-f615c015bd7a', 'a47b1eca-de78-46f7-a52b-21760d1e2c53', '7aca6871-bb53-4f8e-b463-748a28fd39f6'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:44 user cinder-volume[73792]: INFO cinder.volume.manager [None req-6ad50325-4593-4249-bfb0-5756ff9b0a4b tempest-GroupSnapshotsV319Test-2116381113 None] group_snapshot 35573a8a-f50c-4fba-8eb9-52be097b2a91: deleted successfully
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] remove_export for volume: 7b5a0775-127c-4d11-b8e7-7ef2ac247e33. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1602084391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e5bf291-763c-4655-963e-0cb0e0adde18,host='user@joviandss-2#joviandss-2',id=7b5a0775-127c-4d11-b8e7-7ef2ac247e33,launched_at=2023-04-12T06:22:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1a28ff01b34dbda6b23744c85dbdae',provider_auth='CHAP YjEXSnws f84C23uAR5Hpi9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-12T06:22:45Z,use_quota=True,user_id='ab107f6f941c42108b5d4db09cdb1976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2456a91-9c92-4a6a-8be6-91b4f5603707),volume_type_id=d2456a91-9c92-4a6a-8be6-91b4f5603707) from target:iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] detach volume v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 from target iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33/luns/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33/luns/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33/luns/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33/luns/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] failed to remove resource iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 because of JDSS resource v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] delete target: iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] delete target iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] failed to remove resource iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 because of JDSS resource iqn.2010-10.org.openstack:7b5a0775-127c-4d11-b8e7-7ef2ac247e33 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] deleating volume v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] get snapshots for volume v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] get volume v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281977', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59839', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3473982801324472976', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4ffd37ab35ac9713', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784686080', 'san:volume_id': '4ffd37ab35ac97139a0bafbad88867b55dbc22ad', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37034', 'name': 'v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] delete volume:v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] volume v_7b5a0775-127c-4d11-b8e7-7ef2ac247e33 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:22:46 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=31,cinder:SELECT=62,cinder:INSERT=5,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:22:46 user cinder-volume[73792]: DEBUG cinder.quota [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Created reservations ['61bd5316-e517-4d97-9b77-b20f431a4a4d'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:46 user cinder-volume[73792]: WARNING cinder.quota [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-838505421 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-838505421, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:22:46 user cinder-volume[73792]: DEBUG cinder.quota [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Created reservations ['0e7ae4ed-c2e5-4614-9f3e-0228fa4a11c9', '37177e08-27fc-4dcd-8e6a-92b44192a7bd', '94a940f7-968f-4c13-b5c8-145691766a41', '6a5c0be3-e463-4977-8f7f-ad78df749d4c'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:22:46 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=64,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=6 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:22:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:22:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:22:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Geting {'code': 200, 'error': None, 'data': {'available': '114784768000', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.manager [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:22:47 user cinder-volume[73792]: INFO cinder.volume.manager [None req-6078ae1a-64cf-4ded-b074-bf348e31ac06 tempest-GroupSnapshotsV319Test-2116381113 None] Delete group completed successfully.
Apr 12 06:22:47 user cinder-volume[73792]: INFO cinder.action_track [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1929876138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6938de6c-91d6-44b2-af51-33e34e241f29,launched_at=2023-04-12T06:22:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP PptcCjqG n4SbVxr1tOhfIX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:22:43Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:47 user cinder-volume[73792]: INFO cinder.action_track [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1929876138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6938de6c-91d6-44b2-af51-33e34e241f29,launched_at=2023-04-12T06:22:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP PptcCjqG n4SbVxr1tOhfIX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:22:43Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] create export for volume: 6938de6c-91d6-44b2-af51-33e34e241f29. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] ensure volume 6938de6c-91d6-44b2-af51-33e34e241f29 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] check if targe iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] create target and attach volume 6938de6c-91d6-44b2-af51-33e34e241f29 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] create target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] atach volume v_6938de6c-91d6-44b2-af51-33e34e241f29 to target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:22:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6635346137396436', 'lun': 0, 'mode': 'wt', 'name': 'v_6938de6c-91d6-44b2-af51-33e34e241f29', 'prod_id': 'Storage', 'scsi_id': 'f54a79d648b60efe'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] add credentails to target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:22:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'name': 'PptcCjqG'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] initialize_connection for 6938de6c-91d6-44b2-af51-33e34e241f29 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:22:52 user cinder-volume[73792]: INFO cinder.action_track [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PptcCjqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '7de96b37-b23a-4ffb-a822-75cc529fde57'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1929876138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6938de6c-91d6-44b2-af51-33e34e241f29,launched_at=2023-04-12T06:22:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP PptcCjqG n4SbVxr1tOhfIX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:22:43Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:52 user cinder-volume[73792]: INFO cinder.action_track [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-27345195-0ab9-4d69-93ca-85e1504a8343 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1929876138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6938de6c-91d6-44b2-af51-33e34e241f29,launched_at=2023-04-12T06:22:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP PptcCjqG n4SbVxr1tOhfIX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:22:53Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:53 user cinder-volume[73792]: INFO cinder.action_track [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-15452148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3d1bda7d-311d-45ff-9270-f1f4126818f3,launched_at=2023-04-12T06:22:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP TjSIiUbK 5crgQLCAMJSOev',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:29Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:22:44Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:53 user cinder-volume[73792]: INFO cinder.action_track [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-15452148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3d1bda7d-311d-45ff-9270-f1f4126818f3,launched_at=2023-04-12T06:22:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP TjSIiUbK 5crgQLCAMJSOev',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:29Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:22:44Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] create export for volume: 3d1bda7d-311d-45ff-9270-f1f4126818f3. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:22:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] ensure volume 3d1bda7d-311d-45ff-9270-f1f4126818f3 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:22:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] check if targe iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:22:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] create target and attach volume 3d1bda7d-311d-45ff-9270-f1f4126818f3 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:22:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] create target iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:22:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] atach volume v_3d1bda7d-311d-45ff-9270-f1f4126818f3 to target iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:22:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:57 user cinder-volume[73792]: INFO cinder.action_track [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Flow 'volume_create_manager' (9c5d37cd-f2df-46dd-a21c-06be1ee997ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10046d78-6f4a-4433-a9f8-4896aace3859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10046d78-6f4a-4433-a9f8-4896aace3859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:22:57Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c275ceb0-0043-4008-965a-017fa9e61cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c275ceb0-0043-4008-965a-017fa9e61cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dab03b4-08e1-42ee-b7be-1fc914f80765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dab03b4-08e1-42ee-b7be-1fc914f80765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'volume_name': 'volume-d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769d0fe50>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5bccc74-61a1-4288-acf4-6c80703f0c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5bccc74-61a1-4288-acf4-6c80703f0c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a1887a-a31f-420b-9500-4691a73f5720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:57 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Volume d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769d0fe50>}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Cloning d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.coordination [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.coordination [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 22, 57, 497030)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Found cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.coordination [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 22, 57, 511133)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Creating from source image-volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] cloned volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] cloning v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] create snapshot v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6436303030663539', 'lun': 0, 'mode': 'wt', 'name': 'v_3d1bda7d-311d-45ff-9270-f1f4126818f3', 'prod_id': 'Storage', 'scsi_id': 'd6000f59555ff928'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] add credentails to target iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'name': 'TjSIiUbK'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] create volume v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a from snapshot v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] initialize_connection for 3d1bda7d-311d-45ff-9270-f1f4126818f3 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:22:58 user cinder-volume[73792]: INFO cinder.action_track [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjSIiUbK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '261ff49c-2a93-46e3-9267-ec53612a848a'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-15452148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3d1bda7d-311d-45ff-9270-f1f4126818f3,launched_at=2023-04-12T06:22:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP TjSIiUbK 5crgQLCAMJSOev',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:29Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:22:44Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:58 user cinder-volume[73792]: INFO cinder.action_track [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-4b9105a5-29ee-4b0a-afbb-ed64d244912c tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-15452148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3d1bda7d-311d-45ff-9270-f1f4126818f3,launched_at=2023-04-12T06:22:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP TjSIiUbK 5crgQLCAMJSOev',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:29Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:22:58Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'is_clone': True, 'full_name': 'Pool-0/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'name': 'v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] get volume v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:58 user cinder-volume[73792]: INFO cinder.action_track [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-779396692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19059339-d01d-43bc-9939-181649d28bc6,launched_at=2023-04-12T06:22:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP CdTKAgwm 5vYsn74DwoPgT8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:22:44Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:58 user cinder-volume[73792]: INFO cinder.action_track [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-779396692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19059339-d01d-43bc-9939-181649d28bc6,launched_at=2023-04-12T06:22:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP CdTKAgwm 5vYsn74DwoPgT8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:22:44Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] create export for volume: 19059339-d01d-43bc-9939-181649d28bc6. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] ensure volume 19059339-d01d-43bc-9939-181649d28bc6 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] check if targe iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281995', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '59870', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14287637078480051128', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd498b40f84436c16', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784743424', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37230', 'name': 'v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Marking volume d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Creating volume glance metadata for volume d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] create target and attach volume 19059339-d01d-43bc-9939-181649d28bc6 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] create target iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a1887a-a31f-420b-9500-4691a73f5720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769d0fe50>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6da6b61-d3d3-4dd3-991e-94b74030d6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:22:58 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Volume volume-d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a): created successfully
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6da6b61-d3d3-4dd3-991e-94b74030d6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:22:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] Flow 'volume_create_manager' (9c5d37cd-f2df-46dd-a21c-06be1ee997ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:22:58 user cinder-volume[73792]: INFO cinder.action_track [None req-80687902-809e-419d-88e0-3da3b31a3ad7 tempest-TestShelveInstance-735091148 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:58Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:22:57Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] atach volume v_19059339-d01d-43bc-9939-181649d28bc6 to target iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:01 user cinder-volume[73792]: INFO cinder.action_track [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:23:00Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:01 user cinder-volume[73792]: INFO cinder.action_track [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:23:00Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] create export for volume: d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] ensure volume d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] check if targe iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] create target and attach volume d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] create target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:02 user cinder-volume[73792]: INFO cinder.action_track [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1169745416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=90c32fc4-104b-407c-af3e-f4d0bc4bdc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32abd65612d644a0a03075bf4250e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='3cf8b1d004d04431853e6a20e758923a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Flow 'volume_create_manager' (c6ca80f9-a487-46fe-b7bb-bc618e15fb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80341389-8c9f-49ca-b2d0-a5bdda7c6cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80341389-8c9f-49ca-b2d0-a5bdda7c6cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1169745416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=90c32fc4-104b-407c-af3e-f4d0bc4bdc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32abd65612d644a0a03075bf4250e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:23:02Z,use_quota=True,user_id='3cf8b1d004d04431853e6a20e758923a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851dfac4-7d08-4432-bcfc-921c2cca1906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851dfac4-7d08-4432-bcfc-921c2cca1906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0e6d5c-05ad-45e6-9075-660bed2ea1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0e6d5c-05ad-45e6-9075-660bed2ea1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c32fc4-104b-407c-af3e-f4d0bc4bdc5b', 'volume_name': 'volume-90c32fc4-104b-407c-af3e-f4d0bc4bdc5b', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128713d1-2368-4230-848a-a24955ed1022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128713d1-2368-4230-848a-a24955ed1022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ec5acf-2c4d-4b52-bdfd-462edff057b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:02 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Volume 90c32fc4-104b-407c-af3e-f4d0bc4bdc5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c32fc4-104b-407c-af3e-f4d0bc4bdc5b', 'volume_size': 1}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] creating volume v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] create volume {'name': 'v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b', 'is_clone': False, 'name': 'v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ec5acf-2c4d-4b52-bdfd-462edff057b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c32fc4-104b-407c-af3e-f4d0bc4bdc5b', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29278098-5176-4084-a45a-c48a4dfc2d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:02 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Volume volume-90c32fc4-104b-407c-af3e-f4d0bc4bdc5b (90c32fc4-104b-407c-af3e-f4d0bc4bdc5b): created successfully
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29278098-5176-4084-a45a-c48a4dfc2d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] Flow 'volume_create_manager' (c6ca80f9-a487-46fe-b7bb-bc618e15fb72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:02 user cinder-volume[73792]: INFO cinder.action_track [None req-392f497c-9f91-4a07-9c11-989290956ce4 tempest-VolumesTransfersV357Test-332126076 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1169745416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=90c32fc4-104b-407c-af3e-f4d0bc4bdc5b,launched_at=2023-04-12T06:23:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32abd65612d644a0a03075bf4250e75e',provider_auth='CHAP fsmHBjNh 4eXb0mDGLlRIik',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:02Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:23:02Z,use_quota=True,user_id='3cf8b1d004d04431853e6a20e758923a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3634636638653330', 'lun': 0, 'mode': 'wt', 'name': 'v_19059339-d01d-43bc-9939-181649d28bc6', 'prod_id': 'Storage', 'scsi_id': '64cf8e3082c6a0fb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] add credentails to target iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:23:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': {'name': 'CdTKAgwm'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] initialize_connection for 19059339-d01d-43bc-9939-181649d28bc6 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:23:03 user cinder-volume[73792]: INFO cinder.action_track [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdTKAgwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '0da574b5-fbcf-4265-9cd4-d6fc0a79d05c'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-779396692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19059339-d01d-43bc-9939-181649d28bc6,launched_at=2023-04-12T06:22:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP CdTKAgwm 5vYsn74DwoPgT8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:22:44Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:03 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=65,cinder:INSERT=7,cinder:UPDATE=28 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:23:03 user cinder-volume[73792]: INFO cinder.action_track [req-b74fafe7-9054-4bb7-9251-513929a7f4a1 req-535d4356-589e-4025-ab07-fb90ef9139e4 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-779396692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19059339-d01d-43bc-9939-181649d28bc6,launched_at=2023-04-12T06:22:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP CdTKAgwm 5vYsn74DwoPgT8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:23:03Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:03 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a6fc7223-0708-4123-9223-79e41b33c90d tempest-VolumesTransfersV357Test-1740941493 None] Transfer volume completed successfully.
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Acquiring lock "cinder-90c32fc4-104b-407c-af3e-f4d0bc4bdc5b-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Lock "cinder-90c32fc4-104b-407c-af3e-f4d0bc4bdc5b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] remove_export for volume: 90c32fc4-104b-407c-af3e-f4d0bc4bdc5b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1169745416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=90c32fc4-104b-407c-af3e-f4d0bc4bdc5b,launched_at=2023-04-12T06:23:03Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c841af7c7b924fed821427e01e80b78b',provider_auth='CHAP fsmHBjNh 4eXb0mDGLlRIik',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:02Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:23:04Z,updated_at=2023-04-12T06:23:04Z,use_quota=True,user_id='28ee2f0c01bd484394a6ce0a4b0b5901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] detach volume v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b from target iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b/luns/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b/luns/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b/luns/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b/luns/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] failed to remove resource iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b because of JDSS resource v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] delete target: iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] delete target iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] failed to remove resource iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b because of JDSS resource iqn.2010-10.org.openstack:90c32fc4-104b-407c-af3e-f4d0bc4bdc5b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] deleating volume v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] get snapshots for volume v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] get volume v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281999', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59874', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6677512511010881778', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bc6d5137ec81a2be', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784661504', 'san:volume_id': 'bc6d5137ec81a2be82d5ad8030f77e77e6bac925', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37241', 'name': 'v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] delete volume:v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] atach volume v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a to target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] volume v_90c32fc4-104b-407c-af3e-f4d0bc4bdc5b deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:23:05 user cinder-volume[73792]: DEBUG cinder.quota [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Created reservations ['89e84eaf-f62b-4606-b9fd-84f6456688e3', '44ffb757-3539-45b0-8cfd-70f23d6c1243', 'af5812ae-3909-45a7-959d-6715724349d6', '0496ba35-d354-467b-8808-aaf33655dc3e'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:05 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=73,cinder:UPDATE=16,cinder:INSERT=9,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:23:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:23:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:23:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6434393862343066', 'lun': 0, 'mode': 'wt', 'name': 'v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'prod_id': 'Storage', 'scsi_id': 'd498b40f84436c16'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] add credentails to target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:23:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] Geting {'code': 201, 'error': None, 'data': {'name': 'bcOxDrPR'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] initialize_connection for d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:23:06 user cinder-volume[73792]: INFO cinder.action_track [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOxDrPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '49b30f8f-e996-4b85-8960-ff1be3fb4a63'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:23:00Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:06 user cinder-volume[73792]: INFO cinder.action_track [req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d req-1b1f77ed-27b4-4347-9a02-1fbbeff022c7 tempest-TestShelveInstance-735091148 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:23:06Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Geting {'code': 200, 'error': None, 'data': {'available': '114784731136', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.manager [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:23:06 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Deleted volume successfully.
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7c094b72-c65a-4d6c-ac68-eae0d0ca8375 tempest-VolumesTransfersV357Test-2040179243 None] Lock "cinder-90c32fc4-104b-407c-af3e-f4d0bc4bdc5b-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:23:06 user cinder-volume[73792]: INFO cinder.action_track [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1359151301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7e0658b5-7019-42ef-9538-3a60491c76b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32abd65612d644a0a03075bf4250e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='3cf8b1d004d04431853e6a20e758923a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Flow 'volume_create_manager' (a38c8154-3bb0-40ed-a990-cb876385963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976d7f27-0f8e-4699-bea8-43ba92b40b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976d7f27-0f8e-4699-bea8-43ba92b40b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1359151301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7e0658b5-7019-42ef-9538-3a60491c76b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32abd65612d644a0a03075bf4250e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:23:07Z,use_quota=True,user_id='3cf8b1d004d04431853e6a20e758923a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6432f33-d3b9-4e0b-b74a-eeecd22398d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6432f33-d3b9-4e0b-b74a-eeecd22398d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f362e102-149a-4e9d-a080-d21e30dbb5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f362e102-149a-4e9d-a080-d21e30dbb5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0658b5-7019-42ef-9538-3a60491c76b9', 'volume_name': 'volume-7e0658b5-7019-42ef-9538-3a60491c76b9', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185c4afa-3ee3-4fe2-a064-12a7857485cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185c4afa-3ee3-4fe2-a064-12a7857485cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273a6c28-3fee-4d94-b195-ad88d8d0df5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:06 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Volume 7e0658b5-7019-42ef-9538-3a60491c76b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0658b5-7019-42ef-9538-3a60491c76b9', 'volume_size': 1}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] creating volume v_7e0658b5-7019-42ef-9538-3a60491c76b9. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] create volume {'name': 'v_7e0658b5-7019-42ef-9538-3a60491c76b9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7e0658b5-7019-42ef-9538-3a60491c76b9', 'is_clone': False, 'name': 'v_7e0658b5-7019-42ef-9538-3a60491c76b9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273a6c28-3fee-4d94-b195-ad88d8d0df5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0658b5-7019-42ef-9538-3a60491c76b9', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb20e04-c97a-4e7b-848d-2b297894da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:07 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Volume volume-7e0658b5-7019-42ef-9538-3a60491c76b9 (7e0658b5-7019-42ef-9538-3a60491c76b9): created successfully
Apr 12 06:23:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb20e04-c97a-4e7b-848d-2b297894da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] Flow 'volume_create_manager' (a38c8154-3bb0-40ed-a990-cb876385963f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:07 user cinder-volume[73792]: INFO cinder.action_track [None req-5a3e1d7b-76a7-4d48-b84e-3eb08ebf47ab tempest-VolumesTransfersV357Test-332126076 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1359151301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7e0658b5-7019-42ef-9538-3a60491c76b9,launched_at=2023-04-12T06:23:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32abd65612d644a0a03075bf4250e75e',provider_auth='CHAP loMnYaDR L8IpGwH6DrKZs3',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:23:07Z,use_quota=True,user_id='3cf8b1d004d04431853e6a20e758923a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Acquiring lock "cinder-7e0658b5-7019-42ef-9538-3a60491c76b9-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Lock "cinder-7e0658b5-7019-42ef-9538-3a60491c76b9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] remove_export for volume: 7e0658b5-7019-42ef-9538-3a60491c76b9. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1359151301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7e0658b5-7019-42ef-9538-3a60491c76b9,launched_at=2023-04-12T06:23:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32abd65612d644a0a03075bf4250e75e',provider_auth='CHAP loMnYaDR L8IpGwH6DrKZs3',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:23:08Z,updated_at=2023-04-12T06:23:08Z,use_quota=True,user_id='3cf8b1d004d04431853e6a20e758923a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] detach volume v_7e0658b5-7019-42ef-9538-3a60491c76b9 from target iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9/luns/v_7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9/luns/v_7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9/luns/v_7e0658b5-7019-42ef-9538-3a60491c76b9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9/luns/v_7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] failed to remove resource iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 because of JDSS resource v_7e0658b5-7019-42ef-9538-3a60491c76b9 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] delete target: iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] delete target iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] failed to remove resource iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 because of JDSS resource iqn.2010-10.org.openstack:7e0658b5-7019-42ef-9538-3a60491c76b9 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] deleating volume v_7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] get snapshots for volume v_7e0658b5-7019-42ef-9538-3a60491c76b9  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e0658b5-7019-42ef-9538-3a60491c76b9/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e0658b5-7019-42ef-9538-3a60491c76b9/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e0658b5-7019-42ef-9538-3a60491c76b9/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] get volume v_7e0658b5-7019-42ef-9538-3a60491c76b9 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7e0658b5-7019-42ef-9538-3a60491c76b9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282004', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59887', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14380208135003955209', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '84b26df29bcb9fa5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784649216', 'san:volume_id': '84b26df29bcb9fa5c3ad74ae2c85156a7e63fda9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37638', 'name': 'v_7e0658b5-7019-42ef-9538-3a60491c76b9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] delete volume:v_7e0658b5-7019-42ef-9538-3a60491c76b9 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e0658b5-7019-42ef-9538-3a60491c76b9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] volume v_7e0658b5-7019-42ef-9538-3a60491c76b9 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:23:09 user cinder-volume[73792]: DEBUG cinder.quota [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Created reservations ['a50cef56-e8fd-4f69-b4fe-8e070b33b5ef', 'fc15dc56-f118-4253-9ee7-c65f259dfd96', 'cab7856e-6a3e-4d84-a77d-b4af20c0a229', '68491d88-ccdd-466f-8742-aed52dc321d4'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:23:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:23:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Geting {'code': 200, 'error': None, 'data': {'available': '114784731136', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:23:10 user cinder-volume[73792]: DEBUG cinder.manager [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:23:10 user cinder-volume[73792]: INFO cinder.volume.manager [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Deleted volume successfully.
Apr 12 06:23:10 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5a7ec500-3378-4f32-b6f5-fdc57183c185 tempest-VolumesTransfersV357Test-2040179243 None] Lock "cinder-7e0658b5-7019-42ef-9538-3a60491c76b9-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:23:14 user cinder-volume[73792]: INFO cinder.action_track [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-929844401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d19c879c-da32-4478-afd9-cec7c38d5eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8be08e89c20045f69e748fa543a09b67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='1a58eecb5e0b4d768dc5dd7e3cf37d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Flow 'volume_create_manager' (fc5104d8-2524-42df-b85e-cf1bbe92b8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c25a56-1c95-4c99-99e3-0889056c721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c25a56-1c95-4c99-99e3-0889056c721f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-929844401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d19c879c-da32-4478-afd9-cec7c38d5eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8be08e89c20045f69e748fa543a09b67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:23:14Z,use_quota=True,user_id='1a58eecb5e0b4d768dc5dd7e3cf37d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9a0b15-df74-48f4-b98b-f5d733511f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9a0b15-df74-48f4-b98b-f5d733511f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d45f4a-3ab7-47cd-873e-5c8593e59318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d45f4a-3ab7-47cd-873e-5c8593e59318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19c879c-da32-4478-afd9-cec7c38d5eb7', 'volume_name': 'volume-d19c879c-da32-4478-afd9-cec7c38d5eb7', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d26e59-cf43-4f01-b7c4-2b7cfce21ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d26e59-cf43-4f01-b7c4-2b7cfce21ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69074b3f-0491-43d9-95e0-1b615c02859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:14 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Volume d19c879c-da32-4478-afd9-cec7c38d5eb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19c879c-da32-4478-afd9-cec7c38d5eb7', 'volume_size': 1}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] creating volume v_d19c879c-da32-4478-afd9-cec7c38d5eb7. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] create volume {'name': 'v_d19c879c-da32-4478-afd9-cec7c38d5eb7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d19c879c-da32-4478-afd9-cec7c38d5eb7', 'is_clone': False, 'name': 'v_d19c879c-da32-4478-afd9-cec7c38d5eb7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:15 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69074b3f-0491-43d9-95e0-1b615c02859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19c879c-da32-4478-afd9-cec7c38d5eb7', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:15 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2aba690-2644-418c-bc16-85fcd7f46982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:15 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Volume volume-d19c879c-da32-4478-afd9-cec7c38d5eb7 (d19c879c-da32-4478-afd9-cec7c38d5eb7): created successfully
Apr 12 06:23:15 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2aba690-2644-418c-bc16-85fcd7f46982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:15 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] Flow 'volume_create_manager' (fc5104d8-2524-42df-b85e-cf1bbe92b8ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:15 user cinder-volume[73792]: INFO cinder.action_track [None req-ccb3f1b2-ee54-4fe3-b214-00941b51db10 tempest-VolumesSnapshotListTestJSON-141979770 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-929844401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d19c879c-da32-4478-afd9-cec7c38d5eb7,launched_at=2023-04-12T06:23:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8be08e89c20045f69e748fa543a09b67',provider_auth='CHAP LAhvZnFz rjDxmslYTRJFLH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:23:14Z,use_quota=True,user_id='1a58eecb5e0b4d768dc5dd7e3cf37d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:15 user cinder-volume[73792]: INFO cinder.action_track [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Snapshot-375669842',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=e65386fc-b78b-4dc8-bce9-51436434fcc1,metadata={},progress='0%',project_id='8be08e89c20045f69e748fa543a09b67',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='1a58eecb5e0b4d768dc5dd7e3cf37d03',volume=<?>,volume_id=d19c879c-da32-4478-afd9-cec7c38d5eb7,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] create snapshot e65386fc-b78b-4dc8-bce9-51436434fcc1 for volume d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:23:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] cloning v_d19c879c-da32-4478-afd9-cec7c38d5eb7 to s_e65386fc-b78b-4dc8-bce9-51436434fcc1 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:23:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] create snapshot s_e65386fc-b78b-4dc8-bce9-51436434fcc1 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:23:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_e65386fc-b78b-4dc8-bce9-51436434fcc1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] create volume s_e65386fc-b78b-4dc8-bce9-51436434fcc1 from snapshot s_e65386fc-b78b-4dc8-bce9-51436434fcc1 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:23:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d19c879c-da32-4478-afd9-cec7c38d5eb7@s_e65386fc-b78b-4dc8-bce9-51436434fcc1', 'is_clone': True, 'full_name': 'Pool-0/s_e65386fc-b78b-4dc8-bce9-51436434fcc1', 'name': 's_e65386fc-b78b-4dc8-bce9-51436434fcc1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e65386fc-b78b-4dc8-bce9-51436434fcc1/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e65386fc-b78b-4dc8-bce9-51436434fcc1/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e65386fc-b78b-4dc8-bce9-51436434fcc1/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] volume s_e65386fc-b78b-4dc8-bce9-51436434fcc1 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:23:16 user cinder-volume[73792]: INFO cinder.volume.manager [None req-fdc5116b-66a9-44ee-b9d6-560e0bf5e52c tempest-VolumesSnapshotListTestJSON-141979770 None] Create snapshot completed successfully
Apr 12 06:23:18 user cinder-volume[73792]: INFO cinder.action_track [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Snapshot-957850496',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=827a96b4-ad49-4f63-ad59-afdc80b74d89,metadata={},progress='0%',project_id='8be08e89c20045f69e748fa543a09b67',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='1a58eecb5e0b4d768dc5dd7e3cf37d03',volume=<?>,volume_id=d19c879c-da32-4478-afd9-cec7c38d5eb7,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] create snapshot 827a96b4-ad49-4f63-ad59-afdc80b74d89 for volume d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:23:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] cloning v_d19c879c-da32-4478-afd9-cec7c38d5eb7 to s_827a96b4-ad49-4f63-ad59-afdc80b74d89 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:23:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] create snapshot s_827a96b4-ad49-4f63-ad59-afdc80b74d89 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:23:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_827a96b4-ad49-4f63-ad59-afdc80b74d89'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] create volume s_827a96b4-ad49-4f63-ad59-afdc80b74d89 from snapshot s_827a96b4-ad49-4f63-ad59-afdc80b74d89 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:23:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d19c879c-da32-4478-afd9-cec7c38d5eb7@s_827a96b4-ad49-4f63-ad59-afdc80b74d89', 'is_clone': True, 'full_name': 'Pool-0/s_827a96b4-ad49-4f63-ad59-afdc80b74d89', 'name': 's_827a96b4-ad49-4f63-ad59-afdc80b74d89'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_827a96b4-ad49-4f63-ad59-afdc80b74d89/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_827a96b4-ad49-4f63-ad59-afdc80b74d89/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_827a96b4-ad49-4f63-ad59-afdc80b74d89/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] volume s_827a96b4-ad49-4f63-ad59-afdc80b74d89 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:23:19 user cinder-volume[73792]: INFO cinder.volume.manager [None req-37812d80-d249-4bec-8a21-b824f962230f tempest-VolumesSnapshotListTestJSON-141979770 None] Create snapshot completed successfully
Apr 12 06:23:20 user cinder-volume[73792]: INFO cinder.action_track [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Snapshot-449579250',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=81bc0a8e-7af8-43d8-9898-f00b968453a5,metadata={},progress='0%',project_id='8be08e89c20045f69e748fa543a09b67',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='1a58eecb5e0b4d768dc5dd7e3cf37d03',volume=<?>,volume_id=d19c879c-da32-4478-afd9-cec7c38d5eb7,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] create snapshot 81bc0a8e-7af8-43d8-9898-f00b968453a5 for volume d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:23:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] cloning v_d19c879c-da32-4478-afd9-cec7c38d5eb7 to s_81bc0a8e-7af8-43d8-9898-f00b968453a5 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:23:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] create snapshot s_81bc0a8e-7af8-43d8-9898-f00b968453a5 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:23:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_81bc0a8e-7af8-43d8-9898-f00b968453a5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] create volume s_81bc0a8e-7af8-43d8-9898-f00b968453a5 from snapshot s_81bc0a8e-7af8-43d8-9898-f00b968453a5 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:23:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d19c879c-da32-4478-afd9-cec7c38d5eb7@s_81bc0a8e-7af8-43d8-9898-f00b968453a5', 'is_clone': True, 'full_name': 'Pool-0/s_81bc0a8e-7af8-43d8-9898-f00b968453a5', 'name': 's_81bc0a8e-7af8-43d8-9898-f00b968453a5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81bc0a8e-7af8-43d8-9898-f00b968453a5/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81bc0a8e-7af8-43d8-9898-f00b968453a5/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81bc0a8e-7af8-43d8-9898-f00b968453a5/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] volume s_81bc0a8e-7af8-43d8-9898-f00b968453a5 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:23:21 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0b35e448-1e3c-4664-9d34-765a94145404 tempest-VolumesSnapshotListTestJSON-141979770 None] Create snapshot completed successfully
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Acquiring lock "cinder-81bc0a8e-7af8-43d8-9898-f00b968453a5-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Lock "cinder-81bc0a8e-7af8-43d8-9898-f00b968453a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] deleating snapshot s_81bc0a8e-7af8-43d8-9898-f00b968453a5. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] get snapshots for volume s_81bc0a8e-7af8-43d8-9898-f00b968453a5  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81bc0a8e-7af8-43d8-9898-f00b968453a5/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81bc0a8e-7af8-43d8-9898-f00b968453a5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81bc0a8e-7af8-43d8-9898-f00b968453a5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] get volume s_81bc0a8e-7af8-43d8-9898-f00b968453a5 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81bc0a8e-7af8-43d8-9898-f00b968453a5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81bc0a8e-7af8-43d8-9898-f00b968453a5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d19c879c-da32-4478-afd9-cec7c38d5eb7@s_81bc0a8e-7af8-43d8-9898-f00b968453a5', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_81bc0a8e-7af8-43d8-9898-f00b968453a5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282018', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59911', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12685643350757689014', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dc2050f7d64fe561', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784587776', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37350', 'name': 's_81bc0a8e-7af8-43d8-9898-f00b968453a5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_81bc0a8e-7af8-43d8-9898-f00b968453a5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] delete snapshot s_81bc0a8e-7af8-43d8-9898-f00b968453a5 of volume v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots/s_81bc0a8e-7af8-43d8-9898-f00b968453a5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots/s_81bc0a8e-7af8-43d8-9898-f00b968453a5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots/s_81bc0a8e-7af8-43d8-9898-f00b968453a5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] snapshot s_81bc0a8e-7af8-43d8-9898-f00b968453a5 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:23:23 user cinder-volume[73792]: DEBUG cinder.quota [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Created reservations ['6d45f2f2-126a-4f93-a305-a09e564de4cc', '3ebfbd14-71ff-4cab-85f6-07cdc213356d', '22378b6a-c07b-4bac-bc40-7c0be97d93ef', '20fdacea-97ba-4c5f-ab91-c09b1a3fb0d0'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:23 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=65,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:23:23 user cinder-volume[73792]: INFO cinder.volume.manager [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Delete snapshot completed successfully.
Apr 12 06:23:23 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cfd0428f-6913-49d3-a2ba-3a7127c4f0fe tempest-VolumesSnapshotListTestJSON-141979770 None] Lock "cinder-81bc0a8e-7af8-43d8-9898-f00b968453a5-delete_snapshot" released by "delete_snapshot" :: held 1.122s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:23:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Acquiring lock "cinder-827a96b4-ad49-4f63-ad59-afdc80b74d89-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Lock "cinder-827a96b4-ad49-4f63-ad59-afdc80b74d89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] deleating snapshot s_827a96b4-ad49-4f63-ad59-afdc80b74d89. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:23:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] get snapshots for volume s_827a96b4-ad49-4f63-ad59-afdc80b74d89  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_827a96b4-ad49-4f63-ad59-afdc80b74d89/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_827a96b4-ad49-4f63-ad59-afdc80b74d89/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_827a96b4-ad49-4f63-ad59-afdc80b74d89/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] get volume s_827a96b4-ad49-4f63-ad59-afdc80b74d89 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_827a96b4-ad49-4f63-ad59-afdc80b74d89 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_827a96b4-ad49-4f63-ad59-afdc80b74d89 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d19c879c-da32-4478-afd9-cec7c38d5eb7@s_827a96b4-ad49-4f63-ad59-afdc80b74d89', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_827a96b4-ad49-4f63-ad59-afdc80b74d89', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282016', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59905', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14658130376762559631', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '383b455469426731', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784600064', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37335', 'name': 's_827a96b4-ad49-4f63-ad59-afdc80b74d89', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_827a96b4-ad49-4f63-ad59-afdc80b74d89 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] delete snapshot s_827a96b4-ad49-4f63-ad59-afdc80b74d89 of volume v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:23:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots/s_827a96b4-ad49-4f63-ad59-afdc80b74d89 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots/s_827a96b4-ad49-4f63-ad59-afdc80b74d89 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots/s_827a96b4-ad49-4f63-ad59-afdc80b74d89 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] snapshot s_827a96b4-ad49-4f63-ad59-afdc80b74d89 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:23:26 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=60,cinder:UPDATE=31,cinder:DELETE=5,cinder:INSERT=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:23:26 user cinder-volume[73792]: DEBUG cinder.quota [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Created reservations ['014dca2d-c023-475c-b717-efe6f9531629', '3a9e33cb-6b10-4ddf-805c-6438fc436455', 'e0c3d8b2-0bb9-47dc-a1ec-111f4abd41d5', '26a478c0-5e5a-4309-928e-d14b6342bae7'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:26 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Delete snapshot completed successfully.
Apr 12 06:23:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7f798262-f577-4588-8409-f5307184f53b tempest-VolumesSnapshotListTestJSON-141979770 None] Lock "cinder-827a96b4-ad49-4f63-ad59-afdc80b74d89-delete_snapshot" released by "delete_snapshot" :: held 1.485s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:23:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Acquiring lock "cinder-e65386fc-b78b-4dc8-bce9-51436434fcc1-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Lock "cinder-e65386fc-b78b-4dc8-bce9-51436434fcc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] deleating snapshot s_e65386fc-b78b-4dc8-bce9-51436434fcc1. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:23:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] get snapshots for volume s_e65386fc-b78b-4dc8-bce9-51436434fcc1  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e65386fc-b78b-4dc8-bce9-51436434fcc1/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e65386fc-b78b-4dc8-bce9-51436434fcc1/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e65386fc-b78b-4dc8-bce9-51436434fcc1/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] get volume s_e65386fc-b78b-4dc8-bce9-51436434fcc1 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e65386fc-b78b-4dc8-bce9-51436434fcc1 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e65386fc-b78b-4dc8-bce9-51436434fcc1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d19c879c-da32-4478-afd9-cec7c38d5eb7@s_e65386fc-b78b-4dc8-bce9-51436434fcc1', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_e65386fc-b78b-4dc8-bce9-51436434fcc1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282013', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59899', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '182968528210213995', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b6ad3cecc5bab0f8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114784497664', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37319', 'name': 's_e65386fc-b78b-4dc8-bce9-51436434fcc1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e65386fc-b78b-4dc8-bce9-51436434fcc1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] delete snapshot s_e65386fc-b78b-4dc8-bce9-51436434fcc1 of volume v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:23:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots/s_e65386fc-b78b-4dc8-bce9-51436434fcc1 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots/s_e65386fc-b78b-4dc8-bce9-51436434fcc1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots/s_e65386fc-b78b-4dc8-bce9-51436434fcc1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] snapshot s_e65386fc-b78b-4dc8-bce9-51436434fcc1 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:23:28 user cinder-volume[73792]: DEBUG cinder.quota [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Created reservations ['ef54130a-ab6f-48ec-b16e-d7727a01b95a', 'e03bd78a-d1c0-4ba8-a6d7-43b1015afa51', 'e9cab92a-d38d-4b6b-9d3b-ea652fdfc9ba', 'c9b7d222-964f-4048-90d2-20033635f391'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:28 user cinder-volume[73792]: INFO cinder.volume.manager [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Delete snapshot completed successfully.
Apr 12 06:23:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-11cae527-3b0c-47fd-9fe1-02ee21c623e4 tempest-VolumesSnapshotListTestJSON-141979770 None] Lock "cinder-e65386fc-b78b-4dc8-bce9-51436434fcc1-delete_snapshot" released by "delete_snapshot" :: held 1.468s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Acquiring lock "cinder-d19c879c-da32-4478-afd9-cec7c38d5eb7-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Lock "cinder-d19c879c-da32-4478-afd9-cec7c38d5eb7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] remove_export for volume: d19c879c-da32-4478-afd9-cec7c38d5eb7. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-929844401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d19c879c-da32-4478-afd9-cec7c38d5eb7,launched_at=2023-04-12T06:23:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8be08e89c20045f69e748fa543a09b67',provider_auth='CHAP LAhvZnFz rjDxmslYTRJFLH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:23:29Z,updated_at=2023-04-12T06:23:29Z,use_quota=True,user_id='1a58eecb5e0b4d768dc5dd7e3cf37d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] detach volume v_d19c879c-da32-4478-afd9-cec7c38d5eb7 from target iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7/luns/v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7/luns/v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7/luns/v_d19c879c-da32-4478-afd9-cec7c38d5eb7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7/luns/v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] failed to remove resource iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 because of JDSS resource v_d19c879c-da32-4478-afd9-cec7c38d5eb7 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] delete target: iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] delete target iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] failed to remove resource iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 because of JDSS resource iqn.2010-10.org.openstack:d19c879c-da32-4478-afd9-cec7c38d5eb7 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] deleating volume v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] get snapshots for volume v_d19c879c-da32-4478-afd9-cec7c38d5eb7  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] get volume v_d19c879c-da32-4478-afd9-cec7c38d5eb7 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d19c879c-da32-4478-afd9-cec7c38d5eb7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282012', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59893', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15557235246763927236', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5db18fdc44bfcbb2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774667264', 'san:volume_id': '5db18fdc44bfcbb2b284fec0d05113eb11e87167', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37650', 'name': 'v_d19c879c-da32-4478-afd9-cec7c38d5eb7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] delete volume:v_d19c879c-da32-4478-afd9-cec7c38d5eb7 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d19c879c-da32-4478-afd9-cec7c38d5eb7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] volume v_d19c879c-da32-4478-afd9-cec7c38d5eb7 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.quota [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Created reservations ['e6d47e45-2843-4314-baba-8444e354423a', 'e1fe7cad-94c8-4815-b038-ecb37828e153', '6c9d758d-8f20-4d72-8977-f64608b75a7b', '526cc9dc-98a1-4bfe-916b-89c0663867c7'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Geting {'code': 200, 'error': None, 'data': {'available': '114784731136', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:23:30 user cinder-volume[73792]: INFO cinder.volume.manager [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Deleted volume successfully.
Apr 12 06:23:30 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6bf0894a-68e2-4350-a244-44cbf6b81f5b tempest-VolumesSnapshotListTestJSON-141979770 None] Lock "cinder-d19c879c-da32-4478-afd9-cec7c38d5eb7-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:23:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114774568960', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:23:31 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:23:33 user cinder-volume[73792]: INFO cinder.action_track [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1239204604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=da0a34c6-afba-41f9-ae60-aef7ce680752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Flow 'volume_create_manager' (31fb9fea-542a-4878-a2c5-d805efff48d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ac0dde-e85b-43b2-b4b0-42fb7d352011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ac0dde-e85b-43b2-b4b0-42fb7d352011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1239204604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=da0a34c6-afba-41f9-ae60-aef7ce680752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:23:34Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029031b3-7534-4e2e-9ac5-a0fe0ec15395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029031b3-7534-4e2e-9ac5-a0fe0ec15395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de68c2c2-6a2c-445b-8165-313c31ebfca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de68c2c2-6a2c-445b-8165-313c31ebfca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0a34c6-afba-41f9-ae60-aef7ce680752', 'volume_name': 'volume-da0a34c6-afba-41f9-ae60-aef7ce680752', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b7c40b-2f3c-4559-84d8-ceb5aea58cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b7c40b-2f3c-4559-84d8-ceb5aea58cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a04b61-360f-4979-9fbf-17221055578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:33 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume da0a34c6-afba-41f9-ae60-aef7ce680752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0a34c6-afba-41f9-ae60-aef7ce680752', 'volume_size': 1}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] creating volume v_da0a34c6-afba-41f9-ae60-aef7ce680752. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] create volume {'name': 'v_da0a34c6-afba-41f9-ae60-aef7ce680752', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_da0a34c6-afba-41f9-ae60-aef7ce680752', 'is_clone': False, 'name': 'v_da0a34c6-afba-41f9-ae60-aef7ce680752'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a04b61-360f-4979-9fbf-17221055578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0a34c6-afba-41f9-ae60-aef7ce680752', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87012fb-6804-4892-87ed-5391fbccf55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:34 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume volume-da0a34c6-afba-41f9-ae60-aef7ce680752 (da0a34c6-afba-41f9-ae60-aef7ce680752): created successfully
Apr 12 06:23:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87012fb-6804-4892-87ed-5391fbccf55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Flow 'volume_create_manager' (31fb9fea-542a-4878-a2c5-d805efff48d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:34 user cinder-volume[73792]: INFO cinder.action_track [None req-7f8516c9-792e-401e-b794-fa9801d384a7 tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1239204604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=da0a34c6-afba-41f9-ae60-aef7ce680752,launched_at=2023-04-12T06:23:34Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth='CHAP EjFhwOer 6QvcPXCVhBFJsi',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:23:34Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:35 user cinder-volume[73792]: INFO cinder.action_track [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Snapshot-980589479',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=c0976155-6548-4906-bd79-097038df2193,metadata={},progress='0%',project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume=<?>,volume_id=da0a34c6-afba-41f9-ae60-aef7ce680752,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] create snapshot c0976155-6548-4906-bd79-097038df2193 for volume da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:23:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] cloning v_da0a34c6-afba-41f9-ae60-aef7ce680752 to s_c0976155-6548-4906-bd79-097038df2193 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:23:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] create snapshot s_c0976155-6548-4906-bd79-097038df2193 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:23:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c0976155-6548-4906-bd79-097038df2193'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] create volume s_c0976155-6548-4906-bd79-097038df2193 from snapshot s_c0976155-6548-4906-bd79-097038df2193 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:23:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_da0a34c6-afba-41f9-ae60-aef7ce680752@s_c0976155-6548-4906-bd79-097038df2193', 'is_clone': True, 'full_name': 'Pool-0/s_c0976155-6548-4906-bd79-097038df2193', 'name': 's_c0976155-6548-4906-bd79-097038df2193'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c0976155-6548-4906-bd79-097038df2193/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c0976155-6548-4906-bd79-097038df2193/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c0976155-6548-4906-bd79-097038df2193/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] volume s_c0976155-6548-4906-bd79-097038df2193 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:23:37 user cinder-volume[73792]: INFO cinder.volume.manager [None req-368a6bfa-b855-471d-bb49-f0db5025c600 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Create snapshot completed successfully
Apr 12 06:23:38 user cinder-volume[73792]: INFO cinder.action_track [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2059729214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Flow 'volume_create_manager' (782be1a2-fdf8-482b-9c90-c65c41ebacf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cc71a2-a4f9-40a7-b4e6-79cd2fe94cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cc71a2-a4f9-40a7-b4e6-79cd2fe94cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2059729214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:23:38Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331df7b4-aee0-45f8-a112-bbeb29584260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331df7b4-aee0-45f8-a112-bbeb29584260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ffbe58-4028-4a2f-8309-1c9e3f2168b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ffbe58-4028-4a2f-8309-1c9e3f2168b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b', 'volume_name': 'volume-1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9473ff3a-5f4a-4a11-919d-06a43df3c216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9473ff3a-5f4a-4a11-919d-06a43df3c216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7809b7e-2439-4759-abf9-e15c8ec86831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:38 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume 1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b', 'volume_size': 1}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] creating volume v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] create volume {'name': 'v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:38 user cinder-volume[73792]: INFO cinder.action_track [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-480452382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8968475e-513f-49f9-92ff-005661d44c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Flow 'volume_create_manager' (8f92d5e9-26c0-4e11-9e08-3a23eb8c15db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32764ba2-dfdd-4bf6-88d9-7633ae818abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32764ba2-dfdd-4bf6-88d9-7633ae818abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-480452382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8968475e-513f-49f9-92ff-005661d44c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:23:39Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adee008d-16e3-488f-823e-9671ffc22060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adee008d-16e3-488f-823e-9671ffc22060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90e8f85-df40-4556-bf4c-7c871fe0e400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90e8f85-df40-4556-bf4c-7c871fe0e400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8968475e-513f-49f9-92ff-005661d44c30', 'volume_name': 'volume-8968475e-513f-49f9-92ff-005661d44c30', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e0e8bb-f3c3-4818-846c-66df198a1b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e0e8bb-f3c3-4818-846c-66df198a1b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5f4679-864d-42bf-ab5b-cf2cbd9c222d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:38 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume 8968475e-513f-49f9-92ff-005661d44c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8968475e-513f-49f9-92ff-005661d44c30', 'volume_size': 1}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] creating volume v_8968475e-513f-49f9-92ff-005661d44c30. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] create volume {'name': 'v_8968475e-513f-49f9-92ff-005661d44c30', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.action_track [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1150068156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=b3291873-2e2e-4d0b-91b8-351575184128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Flow 'volume_create_manager' (15c4c4f2-1b47-4c53-8378-1a2392c23102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e35f41-8bf7-4ed1-a9f8-87fd798db749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e35f41-8bf7-4ed1-a9f8-87fd798db749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1150068156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=b3291873-2e2e-4d0b-91b8-351575184128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:23:39Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bf5972-fdc1-44bd-b52b-407b1ef65cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bf5972-fdc1-44bd-b52b-407b1ef65cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de4b04cd-7d0b-40e1-9a89-cb8d428f6fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de4b04cd-7d0b-40e1-9a89-cb8d428f6fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3291873-2e2e-4d0b-91b8-351575184128', 'volume_name': 'volume-b3291873-2e2e-4d0b-91b8-351575184128', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e81d16-2ece-49fc-81c0-4cba6d6dd085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e81d16-2ece-49fc-81c0-4cba6d6dd085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c03222-3b37-48a2-8c8f-9b8a6dbd155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume b3291873-2e2e-4d0b-91b8-351575184128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3291873-2e2e-4d0b-91b8-351575184128', 'volume_size': 1}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] creating volume v_b3291873-2e2e-4d0b-91b8-351575184128. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] create volume {'name': 'v_b3291873-2e2e-4d0b-91b8-351575184128', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b', 'is_clone': False, 'name': 'v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7809b7e-2439-4759-abf9-e15c8ec86831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4525f3-9637-4b97-a857-351fba1a423f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume volume-1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b (1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b): created successfully
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4525f3-9637-4b97-a857-351fba1a423f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Flow 'volume_create_manager' (782be1a2-fdf8-482b-9c90-c65c41ebacf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.action_track [None req-6082ec13-1fab-49b5-bbe0-cc9721e89c92 tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2059729214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b,launched_at=2023-04-12T06:23:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth='CHAP VjmLnAEw 2lyBXMWAsnEH85',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:38Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:23:38Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.action_track [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-72267981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc6abfcd-2056-4ae6-a4d3-a20b324333a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e474b11e55eb45ff91f140aae7e2981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Flow 'volume_create_manager' (112684c9-37c7-45b2-92f9-42fd7f0b1f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be7b8ac-141c-4a71-b4a9-557d190944b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8968475e-513f-49f9-92ff-005661d44c30', 'is_clone': False, 'name': 'v_8968475e-513f-49f9-92ff-005661d44c30'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be7b8ac-141c-4a71-b4a9-557d190944b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-72267981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc6abfcd-2056-4ae6-a4d3-a20b324333a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e474b11e55eb45ff91f140aae7e2981d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:23:39Z,use_quota=True,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5974e814-17a6-4231-b345-91a61d8deada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5974e814-17a6-4231-b345-91a61d8deada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e4b65c-080e-4d5e-a3a1-588801008a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e4b65c-080e-4d5e-a3a1-588801008a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'volume_name': 'volume-fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e35fdd1-4f17-4054-be0a-7d7b420ae9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e35fdd1-4f17-4054-be0a-7d7b420ae9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10816e1a-cd85-441b-8857-1f104b676598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Volume fc6abfcd-2056-4ae6-a4d3-a20b324333a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'volume_size': 1}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] creating volume v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] create volume {'name': 'v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5f4679-864d-42bf-ab5b-cf2cbd9c222d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8968475e-513f-49f9-92ff-005661d44c30', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d90f44-7411-47d7-aac5-f393a3b55c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.action_track [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-436062288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=88226165-6d74-4c62-9ef3-fd4a6ed9542e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume volume-8968475e-513f-49f9-92ff-005661d44c30 (8968475e-513f-49f9-92ff-005661d44c30): created successfully
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d90f44-7411-47d7-aac5-f393a3b55c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Flow 'volume_create_manager' (8f92d5e9-26c0-4e11-9e08-3a23eb8c15db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Flow 'volume_create_manager' (e42e3b4a-8470-4333-99a1-e7117d08e04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07787ac-b4f1-45dd-ae98-909c76b3c7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.action_track [None req-2eec5b32-8ec8-4da9-8073-416cb24c2f0e tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-480452382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8968475e-513f-49f9-92ff-005661d44c30,launched_at=2023-04-12T06:23:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth='CHAP ZEpsrfLS RtoLZSaHrQdTgX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:23:39Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07787ac-b4f1-45dd-ae98-909c76b3c7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-436062288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=88226165-6d74-4c62-9ef3-fd4a6ed9542e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:23:39Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f23de3d-0e7e-4dc4-831b-4429e9ad5d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f23de3d-0e7e-4dc4-831b-4429e9ad5d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fedd1945-a4fa-4fb3-9eca-4e5d2cc185f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fedd1945-a4fa-4fb3-9eca-4e5d2cc185f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88226165-6d74-4c62-9ef3-fd4a6ed9542e', 'volume_name': 'volume-88226165-6d74-4c62-9ef3-fd4a6ed9542e', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c3f7e7-86bf-40ee-825a-d74706fc16b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c3f7e7-86bf-40ee-825a-d74706fc16b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c120ad25-291c-4734-bf08-03ef91b90dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume 88226165-6d74-4c62-9ef3-fd4a6ed9542e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88226165-6d74-4c62-9ef3-fd4a6ed9542e', 'volume_size': 1}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] creating volume v_88226165-6d74-4c62-9ef3-fd4a6ed9542e. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] create volume {'name': 'v_88226165-6d74-4c62-9ef3-fd4a6ed9542e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.action_track [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1974323973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9945b3bf-d833-4fff-812e-9bac15c3ea1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=28,cinder:SELECT=62,cinder:INSERT=6,cinder:DELETE=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Flow 'volume_create_manager' (1697b2be-b959-4745-86af-1d2cd5cf3fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73bbe35-4202-45ed-a3b9-a49d5328fca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73bbe35-4202-45ed-a3b9-a49d5328fca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1974323973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9945b3bf-d833-4fff-812e-9bac15c3ea1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:23:40Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ca1c2a-9293-46f5-b072-309050ed7845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ca1c2a-9293-46f5-b072-309050ed7845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4cdcdd-ffec-42c7-94e1-007a99dfe3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4cdcdd-ffec-42c7-94e1-007a99dfe3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9945b3bf-d833-4fff-812e-9bac15c3ea1b', 'volume_name': 'volume-9945b3bf-d833-4fff-812e-9bac15c3ea1b', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afd188b-e8ff-4de6-8feb-d37bf72ac8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afd188b-e8ff-4de6-8feb-d37bf72ac8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a551f1-ccf6-4872-b5c0-429d112f5d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume 9945b3bf-d833-4fff-812e-9bac15c3ea1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9945b3bf-d833-4fff-812e-9bac15c3ea1b', 'volume_size': 1}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] creating volume v_9945b3bf-d833-4fff-812e-9bac15c3ea1b. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] create volume {'name': 'v_9945b3bf-d833-4fff-812e-9bac15c3ea1b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b3291873-2e2e-4d0b-91b8-351575184128', 'is_clone': False, 'name': 'v_b3291873-2e2e-4d0b-91b8-351575184128'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c03222-3b37-48a2-8c8f-9b8a6dbd155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3291873-2e2e-4d0b-91b8-351575184128', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6082ef38-50c4-48d4-9d5a-a6552710b2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume volume-b3291873-2e2e-4d0b-91b8-351575184128 (b3291873-2e2e-4d0b-91b8-351575184128): created successfully
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6082ef38-50c4-48d4-9d5a-a6552710b2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Flow 'volume_create_manager' (15c4c4f2-1b47-4c53-8378-1a2392c23102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:39 user cinder-volume[73792]: INFO cinder.action_track [None req-b04e8379-0403-4e22-9e54-606deee3ef21 tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1150068156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=b3291873-2e2e-4d0b-91b8-351575184128,launched_at=2023-04-12T06:23:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth='CHAP jLxgsBbA bi9lW6HOd8KPp3',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:23:39Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'is_clone': False, 'name': 'v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10816e1a-cd85-441b-8857-1f104b676598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d19299b-7548-4bfa-bc2c-2e6dd5a4991c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Volume volume-fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (fc6abfcd-2056-4ae6-a4d3-a20b324333a0): created successfully
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d19299b-7548-4bfa-bc2c-2e6dd5a4991c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] Flow 'volume_create_manager' (112684c9-37c7-45b2-92f9-42fd7f0b1f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:40 user cinder-volume[73792]: INFO cinder.action_track [None req-836d3f5c-a960-4436-af96-e255bfe5bd9d tempest-DeleteServersTestJSON-1256853091 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-72267981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc6abfcd-2056-4ae6-a4d3-a20b324333a0,launched_at=2023-04-12T06:23:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e474b11e55eb45ff91f140aae7e2981d',provider_auth='CHAP mUPcrIFu nlZAifhR2PqbCE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:23:39Z,use_quota=True,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e', 'is_clone': False, 'name': 'v_88226165-6d74-4c62-9ef3-fd4a6ed9542e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c120ad25-291c-4734-bf08-03ef91b90dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88226165-6d74-4c62-9ef3-fd4a6ed9542e', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6045bc1e-4b68-4e3d-a392-e50461b57e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume volume-88226165-6d74-4c62-9ef3-fd4a6ed9542e (88226165-6d74-4c62-9ef3-fd4a6ed9542e): created successfully
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6045bc1e-4b68-4e3d-a392-e50461b57e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] Flow 'volume_create_manager' (e42e3b4a-8470-4333-99a1-e7117d08e04b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=55,cinder:UPDATE=39,cinder:INSERT=4,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:23:40 user cinder-volume[73792]: INFO cinder.action_track [None req-95743072-ba77-42ce-a094-4f89ad19679e tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-436062288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=88226165-6d74-4c62-9ef3-fd4a6ed9542e,launched_at=2023-04-12T06:23:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth='CHAP KTBRdIvs mPpdoR153U4yaE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:23:39Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:40 user cinder-volume[73792]: INFO cinder.action_track [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-980997373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=34023a39-bbf4-4afb-948b-0bff9f563bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Flow 'volume_create_manager' (64ef6cf5-5962-41d1-9103-72ff3c6168d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36cff26-8f50-4767-8d54-f6e7c64f4912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b', 'is_clone': False, 'name': 'v_9945b3bf-d833-4fff-812e-9bac15c3ea1b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a551f1-ccf6-4872-b5c0-429d112f5d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9945b3bf-d833-4fff-812e-9bac15c3ea1b', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8c3d08-78fb-4388-8c83-7854303e4081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36cff26-8f50-4767-8d54-f6e7c64f4912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-980997373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=34023a39-bbf4-4afb-948b-0bff9f563bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:23:40Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8e9dbc-94ae-461e-b897-2506e8519750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8e9dbc-94ae-461e-b897-2506e8519750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d082ad-bf93-412b-bbbf-3501f0aeb2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d082ad-bf93-412b-bbbf-3501f0aeb2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34023a39-bbf4-4afb-948b-0bff9f563bb8', 'volume_name': 'volume-34023a39-bbf4-4afb-948b-0bff9f563bb8', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f6c8b9-6f0e-4c66-99b5-84b4a7bb3d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f6c8b9-6f0e-4c66-99b5-84b4a7bb3d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86a4e08-04fd-42bf-a250-3beaf93eba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Volume 34023a39-bbf4-4afb-948b-0bff9f563bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34023a39-bbf4-4afb-948b-0bff9f563bb8', 'volume_size': 1}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] creating volume v_34023a39-bbf4-4afb-948b-0bff9f563bb8. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] create volume {'name': 'v_34023a39-bbf4-4afb-948b-0bff9f563bb8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Volume volume-9945b3bf-d833-4fff-812e-9bac15c3ea1b (9945b3bf-d833-4fff-812e-9bac15c3ea1b): created successfully
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8c3d08-78fb-4388-8c83-7854303e4081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Flow 'volume_create_manager' (1697b2be-b959-4745-86af-1d2cd5cf3fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:40 user cinder-volume[73792]: INFO cinder.action_track [None req-e61afdcf-d1a6-4ae4-9480-d022ba171726 tempest-CreateVolumesFromSnapshotTest-1453955547 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1974323973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9945b3bf-d833-4fff-812e-9bac15c3ea1b,launched_at=2023-04-12T06:23:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth='CHAP AWVLYygZ S6Djligw8YMWR3',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:23:40Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_34023a39-bbf4-4afb-948b-0bff9f563bb8', 'is_clone': False, 'name': 'v_34023a39-bbf4-4afb-948b-0bff9f563bb8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86a4e08-04fd-42bf-a250-3beaf93eba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34023a39-bbf4-4afb-948b-0bff9f563bb8', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a52d6ba-f118-4e38-8ae0-dc402e2b0f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:23:41 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Volume volume-34023a39-bbf4-4afb-948b-0bff9f563bb8 (34023a39-bbf4-4afb-948b-0bff9f563bb8): created successfully
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a52d6ba-f118-4e38-8ae0-dc402e2b0f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] Flow 'volume_create_manager' (64ef6cf5-5962-41d1-9103-72ff3c6168d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:23:41 user cinder-volume[73792]: INFO cinder.action_track [None req-dbfdf5be-547e-43a1-b8dc-0182e31252cb tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-980997373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=34023a39-bbf4-4afb-948b-0bff9f563bb8,launched_at=2023-04-12T06:23:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP vmJGqRkQ XLiQfzbosBCMga',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:23:40Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:41 user cinder-volume[73792]: INFO cinder.action_track [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-72267981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc6abfcd-2056-4ae6-a4d3-a20b324333a0,launched_at=2023-04-12T06:23:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e474b11e55eb45ff91f140aae7e2981d',provider_auth='CHAP mUPcrIFu nlZAifhR2PqbCE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:23:41Z,use_quota=True,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:41 user cinder-volume[73792]: INFO cinder.action_track [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-72267981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc6abfcd-2056-4ae6-a4d3-a20b324333a0,launched_at=2023-04-12T06:23:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e474b11e55eb45ff91f140aae7e2981d',provider_auth='CHAP mUPcrIFu nlZAifhR2PqbCE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:23:41Z,use_quota=True,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] create export for volume: fc6abfcd-2056-4ae6-a4d3-a20b324333a0. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] ensure volume fc6abfcd-2056-4ae6-a4d3-a20b324333a0 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] check if targe iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] create target and attach volume fc6abfcd-2056-4ae6-a4d3-a20b324333a0 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] create target iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Acquiring lock "cinder-9945b3bf-d833-4fff-812e-9bac15c3ea1b-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-9945b3bf-d833-4fff-812e-9bac15c3ea1b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] remove_export for volume: 9945b3bf-d833-4fff-812e-9bac15c3ea1b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1974323973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9945b3bf-d833-4fff-812e-9bac15c3ea1b,launched_at=2023-04-12T06:23:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth='CHAP AWVLYygZ S6Djligw8YMWR3',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:23:41Z,updated_at=2023-04-12T06:23:41Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] detach volume v_9945b3bf-d833-4fff-812e-9bac15c3ea1b from target iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b/luns/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b/luns/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b/luns/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b/luns/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] failed to remove resource iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b because of JDSS resource v_9945b3bf-d833-4fff-812e-9bac15c3ea1b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete target: iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete target iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] failed to remove resource iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b because of JDSS resource iqn.2010-10.org.openstack:9945b3bf-d833-4fff-812e-9bac15c3ea1b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] deleating volume v_9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] get snapshots for volume v_9945b3bf-d833-4fff-812e-9bac15c3ea1b  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] get volume v_9945b3bf-d833-4fff-812e-9bac15c3ea1b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282037', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59958', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6559978025871664128', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cb82ffb7259d9b10', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763689984', 'san:volume_id': 'cb82ffb7259d9b10e42d95b0cbc3627d996c6102', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '35442', 'name': 'v_9945b3bf-d833-4fff-812e-9bac15c3ea1b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete volume:v_9945b3bf-d833-4fff-812e-9bac15c3ea1b recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:42 user cinder-volume[73792]: INFO cinder.action_track [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-980997373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=34023a39-bbf4-4afb-948b-0bff9f563bb8,launched_at=2023-04-12T06:23:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP vmJGqRkQ XLiQfzbosBCMga',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:23:42Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:42 user cinder-volume[73792]: INFO cinder.action_track [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-980997373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=34023a39-bbf4-4afb-948b-0bff9f563bb8,launched_at=2023-04-12T06:23:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP vmJGqRkQ XLiQfzbosBCMga',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:23:42Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] create export for volume: 34023a39-bbf4-4afb-948b-0bff9f563bb8. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] ensure volume 34023a39-bbf4-4afb-948b-0bff9f563bb8 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] check if targe iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] create target and attach volume 34023a39-bbf4-4afb-948b-0bff9f563bb8 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] create target iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9945b3bf-d833-4fff-812e-9bac15c3ea1b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] volume v_9945b3bf-d833-4fff-812e-9bac15c3ea1b deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:23:42 user cinder-volume[73792]: DEBUG cinder.quota [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Created reservations ['551a5601-99e0-4b09-9f4a-9d212e2fa1f7', '14a76372-56fe-4c84-88b8-d7b5a773bbbc', '3a91b71d-43a0-4e97-86c0-b0721aa3d0c6', '089754a4-c448-4f7c-881d-95d8201424a9'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Acquiring lock "cinder-88226165-6d74-4c62-9ef3-fd4a6ed9542e-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-88226165-6d74-4c62-9ef3-fd4a6ed9542e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] remove_export for volume: 88226165-6d74-4c62-9ef3-fd4a6ed9542e. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-436062288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=88226165-6d74-4c62-9ef3-fd4a6ed9542e,launched_at=2023-04-12T06:23:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth='CHAP KTBRdIvs mPpdoR153U4yaE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:23:43Z,updated_at=2023-04-12T06:23:43Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] detach volume v_88226165-6d74-4c62-9ef3-fd4a6ed9542e from target iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e/luns/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e/luns/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e/luns/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e/luns/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] failed to remove resource iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e because of JDSS resource v_88226165-6d74-4c62-9ef3-fd4a6ed9542e DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete target: iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete target iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] failed to remove resource iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e because of JDSS resource iqn.2010-10.org.openstack:88226165-6d74-4c62-9ef3-fd4a6ed9542e DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] deleating volume v_88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] get snapshots for volume v_88226165-6d74-4c62-9ef3-fd4a6ed9542e  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763771904', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.manager [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:23:43 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Deleted volume successfully.
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c18958ad-1ab1-45d6-a7eb-0e54eba0e9a2 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-9945b3bf-d833-4fff-812e-9bac15c3ea1b-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] get volume v_88226165-6d74-4c62-9ef3-fd4a6ed9542e info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282037', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59954', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14918328248569250614', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd11427be901ebd9d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763771904', 'san:volume_id': 'd11427be901ebd9d49289d9f0b1a86b310dfa7f0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36715', 'name': 'v_88226165-6d74-4c62-9ef3-fd4a6ed9542e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete volume:v_88226165-6d74-4c62-9ef3-fd4a6ed9542e recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] atach volume v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 to target iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:23:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_88226165-6d74-4c62-9ef3-fd4a6ed9542e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] volume v_88226165-6d74-4c62-9ef3-fd4a6ed9542e deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.quota [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Created reservations ['949e8c9c-8bbd-4b3b-8a2f-e68308c0db8f', '93d2cb91-6c3b-4e0a-b163-09ae9e2ab990', '28a77b35-f2f4-4782-9b38-4b0f4a1c42ce', '7f9452da-9c70-48da-a163-6cca9eb36a5d'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] atach volume v_34023a39-bbf4-4afb-948b-0bff9f563bb8 to target iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3739666263393431', 'lun': 0, 'mode': 'wt', 'name': 'v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'prod_id': 'Storage', 'scsi_id': '79fbc9414e543762'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] add credentails to target iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 201, 'error': None, 'data': {'name': 'mUPcrIFu'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] initialize_connection for fc6abfcd-2056-4ae6-a4d3-a20b324333a0 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:23:45 user cinder-volume[73792]: INFO cinder.action_track [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUPcrIFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '6855b323-c038-4f0e-bc5f-103929619271'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-72267981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc6abfcd-2056-4ae6-a4d3-a20b324333a0,launched_at=2023-04-12T06:23:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e474b11e55eb45ff91f140aae7e2981d',provider_auth='CHAP mUPcrIFu nlZAifhR2PqbCE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:23:41Z,use_quota=True,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Acquiring lock "cinder-b3291873-2e2e-4d0b-91b8-351575184128-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763853824', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.manager [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:23:45 user cinder-volume[73792]: INFO cinder.volume.manager [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Deleted volume successfully.
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-b3291873-2e2e-4d0b-91b8-351575184128-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6910a9f3-d156-4963-ba04-4ea044448db4 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-88226165-6d74-4c62-9ef3-fd4a6ed9542e-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] remove_export for volume: b3291873-2e2e-4d0b-91b8-351575184128. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1150068156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=b3291873-2e2e-4d0b-91b8-351575184128,launched_at=2023-04-12T06:23:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth='CHAP jLxgsBbA bi9lW6HOd8KPp3',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:23:46Z,updated_at=2023-04-12T06:23:46Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] detach volume v_b3291873-2e2e-4d0b-91b8-351575184128 from target iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128/luns/v_b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128/luns/v_b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:45 user cinder-volume[73792]: INFO cinder.action_track [req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 req-1c3b5335-01a6-4f50-aa15-72156c121708 tempest-DeleteServersTestJSON-1256853091 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-72267981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc6abfcd-2056-4ae6-a4d3-a20b324333a0,launched_at=2023-04-12T06:23:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e474b11e55eb45ff91f140aae7e2981d',provider_auth='CHAP mUPcrIFu nlZAifhR2PqbCE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:23:46Z,use_quota=True,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128/luns/v_b3291873-2e2e-4d0b-91b8-351575184128'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128/luns/v_b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] failed to remove resource iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 because of JDSS resource v_b3291873-2e2e-4d0b-91b8-351575184128 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete target: iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete target iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] failed to remove resource iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 because of JDSS resource iqn.2010-10.org.openstack:b3291873-2e2e-4d0b-91b8-351575184128 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] deleating volume v_b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] get snapshots for volume v_b3291873-2e2e-4d0b-91b8-351575184128  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3291873-2e2e-4d0b-91b8-351575184128/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3291873-2e2e-4d0b-91b8-351575184128/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3291873-2e2e-4d0b-91b8-351575184128/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] get volume v_b3291873-2e2e-4d0b-91b8-351575184128 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b3291873-2e2e-4d0b-91b8-351575184128', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282036', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59947', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10887571586278099692', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e53558d17f1fe742', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763853824', 'san:volume_id': 'e53558d17f1fe7427811fdfd1a74c85b5e4f0f05', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36698', 'name': 'v_b3291873-2e2e-4d0b-91b8-351575184128', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete volume:v_b3291873-2e2e-4d0b-91b8-351575184128 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6233643335623338', 'lun': 0, 'mode': 'wt', 'name': 'v_34023a39-bbf4-4afb-948b-0bff9f563bb8', 'prod_id': 'Storage', 'scsi_id': 'b3d35b389c2a9ff3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] add credentails to target iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 201, 'error': None, 'data': {'name': 'vmJGqRkQ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] initialize_connection for 34023a39-bbf4-4afb-948b-0bff9f563bb8 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:23:47 user cinder-volume[73792]: INFO cinder.action_track [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmJGqRkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '89896312-6c7c-4a65-a4f5-fd99ee079f77'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-980997373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=34023a39-bbf4-4afb-948b-0bff9f563bb8,launched_at=2023-04-12T06:23:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP vmJGqRkQ XLiQfzbosBCMga',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:23:42Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:47 user cinder-volume[73792]: INFO cinder.action_track [req-38432502-1e7d-4807-866d-b82956d29761 req-526938d1-9450-4563-a705-965834cde45a tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-980997373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=34023a39-bbf4-4afb-948b-0bff9f563bb8,launched_at=2023-04-12T06:23:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP vmJGqRkQ XLiQfzbosBCMga',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:23:47Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b3291873-2e2e-4d0b-91b8-351575184128 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] volume v_b3291873-2e2e-4d0b-91b8-351575184128 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:23:47 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=68,cinder:UPDATE=25,cinder:DELETE=5,cinder:INSERT=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:23:47 user cinder-volume[73792]: DEBUG cinder.quota [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Created reservations ['789000ce-a083-4a10-8046-70dd7ec7bf01', 'f02829d3-4c42-4cbb-853a-d8088b757ce1', 'c65854ae-e890-40b5-81e3-6c77f709e65e', '4534f892-6674-45db-9cfc-c31049216552'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:47 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=61,cinder:UPDATE=29,cinder:DELETE=1,cinder:INSERT=9 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:23:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:23:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:23:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.coordination [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Acquiring lock "cinder-8968475e-513f-49f9-92ff-005661d44c30-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.coordination [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-8968475e-513f-49f9-92ff-005661d44c30-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] remove_export for volume: 8968475e-513f-49f9-92ff-005661d44c30. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-480452382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8968475e-513f-49f9-92ff-005661d44c30,launched_at=2023-04-12T06:23:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth='CHAP ZEpsrfLS RtoLZSaHrQdTgX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:23:48Z,updated_at=2023-04-12T06:23:48Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] detach volume v_8968475e-513f-49f9-92ff-005661d44c30 from target iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30/luns/v_8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30/luns/v_8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30/luns/v_8968475e-513f-49f9-92ff-005661d44c30'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30/luns/v_8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] failed to remove resource iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 because of JDSS resource v_8968475e-513f-49f9-92ff-005661d44c30 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete target: iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete target iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763923456', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.manager [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] failed to remove resource iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 because of JDSS resource iqn.2010-10.org.openstack:8968475e-513f-49f9-92ff-005661d44c30 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] deleating volume v_8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] get snapshots for volume v_8968475e-513f-49f9-92ff-005661d44c30  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8968475e-513f-49f9-92ff-005661d44c30/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8968475e-513f-49f9-92ff-005661d44c30/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:48 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Deleted volume successfully.
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c4c2a2e9-9b9d-4011-85ea-5e1fe4c4f532 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-b3291873-2e2e-4d0b-91b8-351575184128-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8968475e-513f-49f9-92ff-005661d44c30/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] get volume v_8968475e-513f-49f9-92ff-005661d44c30 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8968475e-513f-49f9-92ff-005661d44c30', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282036', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59942', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13339591542299309319', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a650a006dd71683e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763923456', 'san:volume_id': 'a650a006dd71683efac79616462f62ef026409b5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36688', 'name': 'v_8968475e-513f-49f9-92ff-005661d44c30', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete volume:v_8968475e-513f-49f9-92ff-005661d44c30 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8968475e-513f-49f9-92ff-005661d44c30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] volume v_8968475e-513f-49f9-92ff-005661d44c30 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:23:49 user cinder-volume[73792]: DEBUG cinder.quota [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Created reservations ['1b403dab-3c56-455b-bb6a-2ae346a77814', '9bc66bb8-a72f-45c9-822f-528646a79160', '13ae2005-7a0f-4ba0-a69a-a19a7f68bd29', 'd82d7d14-2c11-4648-a3c2-7a515502cf0e'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:23:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:23:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763993088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.manager [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:23:50 user cinder-volume[73792]: INFO cinder.volume.manager [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Deleted volume successfully.
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-20347998-8758-4826-8b4e-d741f191146c tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-8968475e-513f-49f9-92ff-005661d44c30-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Acquiring lock "cinder-1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] remove_export for volume: 1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2059729214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b,launched_at=2023-04-12T06:23:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth='CHAP VjmLnAEw 2lyBXMWAsnEH85',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:38Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:23:50Z,updated_at=2023-04-12T06:23:50Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] detach volume v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b from target iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b/luns/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b/luns/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b/luns/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b/luns/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] failed to remove resource iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b because of JDSS resource v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete target: iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete target iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] failed to remove resource iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b because of JDSS resource iqn.2010-10.org.openstack:1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] deleating volume v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] get snapshots for volume v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] get volume v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282036', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59939', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5001217612145094795', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8a5828986c4bc93c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763993088', 'san:volume_id': '8a5828986c4bc93caf3ce56d2f43cc6ad9a1126f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36680', 'name': 'v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete volume:v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:50 user cinder-volume[73792]: INFO cinder.action_track [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-72267981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc6abfcd-2056-4ae6-a4d3-a20b324333a0,launched_at=2023-04-12T06:23:40Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='e474b11e55eb45ff91f140aae7e2981d',provider_auth='CHAP mUPcrIFu nlZAifhR2PqbCE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:23:48Z,use_quota=True,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] terminate connection for fc6abfcd-2056-4ae6-a4d3-a20b324333a0  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:23:50 user cinder-volume[73792]: INFO cinder.action_track [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-72267981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc6abfcd-2056-4ae6-a4d3-a20b324333a0,launched_at=2023-04-12T06:23:40Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='e474b11e55eb45ff91f140aae7e2981d',provider_auth='CHAP mUPcrIFu nlZAifhR2PqbCE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:23:48Z,use_quota=True,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] Deleting attachment 6855b323-c038-4f0e-bc5f-103929619271. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] remove_export for volume: fc6abfcd-2056-4ae6-a4d3-a20b324333a0. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-72267981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc6abfcd-2056-4ae6-a4d3-a20b324333a0,launched_at=2023-04-12T06:23:40Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='e474b11e55eb45ff91f140aae7e2981d',provider_auth='CHAP mUPcrIFu nlZAifhR2PqbCE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:23:48Z,use_quota=True,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] detach volume v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 from target iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/luns/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/luns/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/luns/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] delete target: iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] delete target iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-98a0af24-2e9b-4f40-a718-960bd610795c req-3ff7ad65-d0c8-47fe-bda2-87e952c8944c tempest-DeleteServersTestJSON-1256853091 None] target iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] volume v_1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.quota [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Created reservations ['f4b5fb43-6900-4bea-b2ea-ffc1ab47ff6a', 'cda12461-9968-4e56-ba2f-634871147841', 'fd7f4379-6867-44f9-95be-6d92175a55a8', '9ceb152f-fb31-4d67-84cc-bb22dd7322a0'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764075008', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.manager [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:23:52 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Deleted volume successfully.
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a3f1b2e9-210a-4a13-a886-c31c9ac1d037 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-1a8dc2cb-aca7-4e28-9f0e-3765bb53f58b-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Acquiring lock "cinder-c0976155-6548-4906-bd79-097038df2193-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-c0976155-6548-4906-bd79-097038df2193-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] deleating snapshot s_c0976155-6548-4906-bd79-097038df2193. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] get snapshots for volume s_c0976155-6548-4906-bd79-097038df2193  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c0976155-6548-4906-bd79-097038df2193/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c0976155-6548-4906-bd79-097038df2193/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c0976155-6548-4906-bd79-097038df2193/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] get volume s_c0976155-6548-4906-bd79-097038df2193 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c0976155-6548-4906-bd79-097038df2193 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c0976155-6548-4906-bd79-097038df2193 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_da0a34c6-afba-41f9-ae60-aef7ce680752@s_c0976155-6548-4906-bd79-097038df2193', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c0976155-6548-4906-bd79-097038df2193', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282033', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59935', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9811599726195449886', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'aa3f8e745b4ed568', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114764075008', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '36541', 'name': 's_c0976155-6548-4906-bd79-097038df2193', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c0976155-6548-4906-bd79-097038df2193 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete snapshot s_c0976155-6548-4906-bd79-097038df2193 of volume v_da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752/snapshots/s_c0976155-6548-4906-bd79-097038df2193 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752/snapshots/s_c0976155-6548-4906-bd79-097038df2193 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752/snapshots/s_c0976155-6548-4906-bd79-097038df2193 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] snapshot s_c0976155-6548-4906-bd79-097038df2193 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:23:53 user cinder-volume[73792]: DEBUG cinder.quota [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Created reservations ['87ecf22e-6f34-44ee-a197-8bdbdbe0f434', 'a6dd0ba3-1dfe-4c3b-b105-45c432afb72f', '0df05e31-098f-469a-ac68-3b4a9c138310', '5179452b-1dba-48a0-8fc6-108abe1573db'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:53 user cinder-volume[73792]: INFO cinder.volume.manager [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Delete snapshot completed successfully.
Apr 12 06:23:53 user cinder-volume[73792]: DEBUG cinder.coordination [None req-553b984d-5df3-41c3-b2f3-b31eb172d456 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-c0976155-6548-4906-bd79-097038df2193-delete_snapshot" released by "delete_snapshot" :: held 1.083s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.coordination [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Acquiring lock "cinder-da0a34c6-afba-41f9-ae60-aef7ce680752-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.coordination [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-da0a34c6-afba-41f9-ae60-aef7ce680752-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] remove_export for volume: da0a34c6-afba-41f9-ae60-aef7ce680752. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1239204604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=da0a34c6-afba-41f9-ae60-aef7ce680752,launched_at=2023-04-12T06:23:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f4d5c40f784a68ae186281d42b31c0',provider_auth='CHAP EjFhwOer 6QvcPXCVhBFJsi',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:23:55Z,updated_at=2023-04-12T06:23:55Z,use_quota=True,user_id='5f36a5c806074bc29be5a0ebe9ed6760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] detach volume v_da0a34c6-afba-41f9-ae60-aef7ce680752 from target iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752/luns/v_da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752/luns/v_da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752/luns/v_da0a34c6-afba-41f9-ae60-aef7ce680752'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752/luns/v_da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] failed to remove resource iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 because of JDSS resource v_da0a34c6-afba-41f9-ae60-aef7ce680752 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete target: iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete target iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] failed to remove resource iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 because of JDSS resource iqn.2010-10.org.openstack:da0a34c6-afba-41f9-ae60-aef7ce680752 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] deleating volume v_da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] get snapshots for volume v_da0a34c6-afba-41f9-ae60-aef7ce680752  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] get volume v_da0a34c6-afba-41f9-ae60-aef7ce680752 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_da0a34c6-afba-41f9-ae60-aef7ce680752', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282031', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59929', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5477594186658895917', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ca0da146623646e4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114764087296', 'san:volume_id': 'ca0da146623646e4ec281b02e03e3d87a4cae195', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37516', 'name': 'v_da0a34c6-afba-41f9-ae60-aef7ce680752', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] delete volume:v_da0a34c6-afba-41f9-ae60-aef7ce680752 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da0a34c6-afba-41f9-ae60-aef7ce680752 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] volume v_da0a34c6-afba-41f9-ae60-aef7ce680752 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:23:55 user cinder-volume[73792]: DEBUG cinder.quota [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Created reservations ['ae2774a9-0f84-4644-bd14-780060da2d36', '42a54e21-05d7-468e-8fc2-9ae87a9953a5', 'd319374d-2006-45c0-abcd-ee402f7342e7', 'ba8cfb5d-85db-419a-9108-8b5735ddfce1'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:23:56 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=57,cinder:INSERT=10,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:23:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:23:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:23:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:23:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:23:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764193792', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:23:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:23:56 user cinder-volume[73792]: DEBUG cinder.manager [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:23:56 user cinder-volume[73792]: INFO cinder.volume.manager [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Deleted volume successfully.
Apr 12 06:23:56 user cinder-volume[73792]: DEBUG cinder.coordination [None req-fb19fa24-86c2-4a11-8c21-3bed5f324b91 tempest-CreateVolumesFromSnapshotTest-1453955547 None] Lock "cinder-da0a34c6-afba-41f9-ae60-aef7ce680752-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:24:04 user cinder-volume[73792]: INFO cinder.action_track [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1099547734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e858dd17-43f2-4bb6-9d13-6f151b01bd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e95975f26a4677b628411ddb18c68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='de02e22a24944fdf952fd302b608a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=50,cinder:UPDATE=42,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Flow 'volume_create_manager' (a2f8cd9d-e894-4a74-b9c5-8770cb2f96b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae33423-7a4e-46f5-94d5-73433e706444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae33423-7a4e-46f5-94d5-73433e706444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1099547734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e858dd17-43f2-4bb6-9d13-6f151b01bd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e95975f26a4677b628411ddb18c68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:24:04Z,use_quota=True,user_id='de02e22a24944fdf952fd302b608a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41137d17-2ccc-4a86-9840-bb46c4550794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41137d17-2ccc-4a86-9840-bb46c4550794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85b89ab-9974-4351-8401-4776a522cafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85b89ab-9974-4351-8401-4776a522cafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'volume_name': 'volume-e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f959c3-eff6-4c16-bc39-b1c4627905c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f959c3-eff6-4c16-bc39-b1c4627905c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c706b4a-c3a6-4e46-8c27-63af3800dda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:24:04 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Volume e858dd17-43f2-4bb6-9d13-6f151b01bd2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'volume_size': 1}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] creating volume v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] create volume {'name': 'v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'is_clone': False, 'name': 'v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c706b4a-c3a6-4e46-8c27-63af3800dda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:24:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edc4f28-0292-4d59-811e-87a7bbbf2682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:24:05 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Volume volume-e858dd17-43f2-4bb6-9d13-6f151b01bd2d (e858dd17-43f2-4bb6-9d13-6f151b01bd2d): created successfully
Apr 12 06:24:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edc4f28-0292-4d59-811e-87a7bbbf2682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:24:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] Flow 'volume_create_manager' (a2f8cd9d-e894-4a74-b9c5-8770cb2f96b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:24:05 user cinder-volume[73792]: INFO cinder.action_track [None req-9995edaa-e16d-48a3-b8b8-92396528a69d tempest-AttachSCSIVolumeTestJSON-480153316 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1099547734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e858dd17-43f2-4bb6-9d13-6f151b01bd2d,launched_at=2023-04-12T06:24:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e95975f26a4677b628411ddb18c68c',provider_auth='CHAP mlSGupMO Wyx0eDjPJLRko4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:24:04Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:24:04Z,use_quota=True,user_id='de02e22a24944fdf952fd302b608a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:06 user cinder-volume[73792]: INFO cinder.action_track [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1099547734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e858dd17-43f2-4bb6-9d13-6f151b01bd2d,launched_at=2023-04-12T06:24:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e95975f26a4677b628411ddb18c68c',provider_auth='CHAP mlSGupMO Wyx0eDjPJLRko4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:24:04Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:06Z,use_quota=True,user_id='de02e22a24944fdf952fd302b608a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:06 user cinder-volume[73792]: INFO cinder.action_track [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1099547734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e858dd17-43f2-4bb6-9d13-6f151b01bd2d,launched_at=2023-04-12T06:24:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e95975f26a4677b628411ddb18c68c',provider_auth='CHAP mlSGupMO Wyx0eDjPJLRko4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:24:04Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:06Z,use_quota=True,user_id='de02e22a24944fdf952fd302b608a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] create export for volume: e858dd17-43f2-4bb6-9d13-6f151b01bd2d. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:24:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] ensure volume e858dd17-43f2-4bb6-9d13-6f151b01bd2d assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:24:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] check if targe iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:24:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] create target and attach volume e858dd17-43f2-4bb6-9d13-6f151b01bd2d to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:24:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] create target iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:24:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:09 user cinder-volume[73792]: INFO cinder.action_track [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1995203384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d2470870-a46d-44c2-98dc-448e98ab0866,launched_at=2023-04-12T06:22:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d2a1b102d54e8194741137e193436f',provider_auth='CHAP cDzhwJUi Qx3CKFLliXdOGU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:09Z,use_quota=True,user_id='896e1c5d0edd4a1d9d122115f02dfef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:09 user cinder-volume[73792]: INFO cinder.action_track [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1995203384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d2470870-a46d-44c2-98dc-448e98ab0866,launched_at=2023-04-12T06:22:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d2a1b102d54e8194741137e193436f',provider_auth='CHAP cDzhwJUi Qx3CKFLliXdOGU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:09Z,use_quota=True,user_id='896e1c5d0edd4a1d9d122115f02dfef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] create export for volume: d2470870-a46d-44c2-98dc-448e98ab0866. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] ensure volume d2470870-a46d-44c2-98dc-448e98ab0866 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] check if targe iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] create target and attach volume d2470870-a46d-44c2-98dc-448e98ab0866 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] create target iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] atach volume v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d to target iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:09 user cinder-volume[73792]: INFO cinder.action_track [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:09Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:09 user cinder-volume[73792]: INFO cinder.action_track [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:09Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] create export for volume: 1872667c-83a2-4de7-a347-cc3fd70bf901. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] ensure volume 1872667c-83a2-4de7-a347-cc3fd70bf901 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] check if targe iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] create target and attach volume 1872667c-83a2-4de7-a347-cc3fd70bf901 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] create target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6161323764326564', 'lun': 0, 'mode': 'wt', 'name': 'v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'prod_id': 'Storage', 'scsi_id': 'aa27d2edad931207'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] add credentails to target iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:24:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 201, 'error': None, 'data': {'name': 'mlSGupMO'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] initialize_connection for e858dd17-43f2-4bb6-9d13-6f151b01bd2d 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:24:10 user cinder-volume[73792]: INFO cinder.action_track [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mlSGupMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '4e26ccf1-d6d2-449c-ade9-f11720bb961f'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1099547734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e858dd17-43f2-4bb6-9d13-6f151b01bd2d,launched_at=2023-04-12T06:24:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e95975f26a4677b628411ddb18c68c',provider_auth='CHAP mlSGupMO Wyx0eDjPJLRko4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:24:04Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:06Z,use_quota=True,user_id='de02e22a24944fdf952fd302b608a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:10 user cinder-volume[73792]: INFO cinder.action_track [req-297cd81b-9557-4cdf-9913-1585affeb837 req-b501b3c6-ed9a-48ca-a068-59631437c906 tempest-AttachSCSIVolumeTestJSON-480153316 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1099547734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e858dd17-43f2-4bb6-9d13-6f151b01bd2d,launched_at=2023-04-12T06:24:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e95975f26a4677b628411ddb18c68c',provider_auth='CHAP mlSGupMO Wyx0eDjPJLRko4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:24:04Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:24:11Z,use_quota=True,user_id='de02e22a24944fdf952fd302b608a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] atach volume v_d2470870-a46d-44c2-98dc-448e98ab0866 to target iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:24:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] atach volume v_1872667c-83a2-4de7-a347-cc3fd70bf901 to target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:24:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3262393863306364', 'lun': 0, 'mode': 'wt', 'name': 'v_d2470870-a46d-44c2-98dc-448e98ab0866', 'prod_id': 'Storage', 'scsi_id': '2b98c0cdee985905'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] add credentails to target iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:24:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 201, 'error': None, 'data': {'name': 'cDzhwJUi'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] initialize_connection for d2470870-a46d-44c2-98dc-448e98ab0866 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:24:13 user cinder-volume[73792]: INFO cinder.action_track [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDzhwJUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '65bf6a8b-3e34-49ff-ad75-fd08acf382a0'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1995203384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d2470870-a46d-44c2-98dc-448e98ab0866,launched_at=2023-04-12T06:22:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d2a1b102d54e8194741137e193436f',provider_auth='CHAP cDzhwJUi Qx3CKFLliXdOGU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:09Z,use_quota=True,user_id='896e1c5d0edd4a1d9d122115f02dfef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:13 user cinder-volume[73792]: INFO cinder.action_track [req-853d814b-c68d-484c-86df-84cc64c70cbe req-d1e2d381-a3cb-437b-9acc-59118f669825 tempest-TaggedAttachmentsTest-1179204824 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1995203384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d2470870-a46d-44c2-98dc-448e98ab0866,launched_at=2023-04-12T06:22:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d2a1b102d54e8194741137e193436f',provider_auth='CHAP cDzhwJUi Qx3CKFLliXdOGU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:24:13Z,use_quota=True,user_id='896e1c5d0edd4a1d9d122115f02dfef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3362623935356437', 'lun': 0, 'mode': 'wt', 'name': 'v_1872667c-83a2-4de7-a347-cc3fd70bf901', 'prod_id': 'Storage', 'scsi_id': '3bb955d72e5b826a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] add credentails to target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:24:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] Geting {'code': 201, 'error': None, 'data': {'name': 'HXLxNfBv'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] initialize_connection for 1872667c-83a2-4de7-a347-cc3fd70bf901 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:24:13 user cinder-volume[73792]: INFO cinder.action_track [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXLxNfBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '0f6f8df0-a8b1-4e5f-94a8-645b131c04ed'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:09Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:13 user cinder-volume[73792]: INFO cinder.action_track [req-a210ba39-91ce-4939-a498-f86eb5a21793 req-82067a9a-33d8-405a-b075-78283d0e0bb0 tempest-TestVolumeSwap-1856443697 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:24:14Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:16 user cinder-volume[73792]: INFO cinder.action_track [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1099547734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e858dd17-43f2-4bb6-9d13-6f151b01bd2d,launched_at=2023-04-12T06:24:05Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='94e95975f26a4677b628411ddb18c68c',provider_auth='CHAP mlSGupMO Wyx0eDjPJLRko4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:24:04Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:13Z,use_quota=True,user_id='de02e22a24944fdf952fd302b608a293',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] terminate connection for e858dd17-43f2-4bb6-9d13-6f151b01bd2d  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:24:16 user cinder-volume[73792]: INFO cinder.action_track [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1099547734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e858dd17-43f2-4bb6-9d13-6f151b01bd2d,launched_at=2023-04-12T06:24:05Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='94e95975f26a4677b628411ddb18c68c',provider_auth='CHAP mlSGupMO Wyx0eDjPJLRko4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:24:04Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:13Z,use_quota=True,user_id='de02e22a24944fdf952fd302b608a293',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] Deleting attachment 4e26ccf1-d6d2-449c-ade9-f11720bb961f. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] remove_export for volume: e858dd17-43f2-4bb6-9d13-6f151b01bd2d. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1099547734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e858dd17-43f2-4bb6-9d13-6f151b01bd2d,launched_at=2023-04-12T06:24:05Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='94e95975f26a4677b628411ddb18c68c',provider_auth='CHAP mlSGupMO Wyx0eDjPJLRko4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:24:04Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:13Z,use_quota=True,user_id='de02e22a24944fdf952fd302b608a293',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] detach volume v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d from target iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/luns/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/luns/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/luns/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] delete target: iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] delete target iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a253831f-2d2d-4930-936f-5db6092509f3 req-89ca7635-a2b0-4b0e-8fc3-98869ab957e0 tempest-AttachSCSIVolumeTestJSON-480153316 None] target iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:24:17 user cinder-volume[73792]: INFO cinder.action_track [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1995203384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d2470870-a46d-44c2-98dc-448e98ab0866,launched_at=2023-04-12T06:22:08Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='96d2a1b102d54e8194741137e193436f',provider_auth='CHAP cDzhwJUi Qx3CKFLliXdOGU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:17Z,use_quota=True,user_id='896e1c5d0edd4a1d9d122115f02dfef7',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] terminate connection for d2470870-a46d-44c2-98dc-448e98ab0866  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:24:17 user cinder-volume[73792]: INFO cinder.action_track [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1995203384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d2470870-a46d-44c2-98dc-448e98ab0866,launched_at=2023-04-12T06:22:08Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='96d2a1b102d54e8194741137e193436f',provider_auth='CHAP cDzhwJUi Qx3CKFLliXdOGU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:17Z,use_quota=True,user_id='896e1c5d0edd4a1d9d122115f02dfef7',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] Deleting attachment 65bf6a8b-3e34-49ff-ad75-fd08acf382a0. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:24:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] remove_export for volume: d2470870-a46d-44c2-98dc-448e98ab0866. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:24:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:24:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1995203384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d2470870-a46d-44c2-98dc-448e98ab0866,launched_at=2023-04-12T06:22:08Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='96d2a1b102d54e8194741137e193436f',provider_auth='CHAP cDzhwJUi Qx3CKFLliXdOGU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:17Z,use_quota=True,user_id='896e1c5d0edd4a1d9d122115f02dfef7',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:24:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] detach volume v_d2470870-a46d-44c2-98dc-448e98ab0866 from target iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:24:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/luns/v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/luns/v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/luns/v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] delete target: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] delete target iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:18 user cinder-volume[73792]: INFO cinder.action_track [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-2016549375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a0819b26-7af7-426a-8242-84954c0851f5,launched_at=2023-04-12T06:22:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP uYNAnVgZ w1iTt2v9XKO8Dd',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:18Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:18 user cinder-volume[73792]: INFO cinder.action_track [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-2016549375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a0819b26-7af7-426a-8242-84954c0851f5,launched_at=2023-04-12T06:22:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP uYNAnVgZ w1iTt2v9XKO8Dd',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:18Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] create export for volume: a0819b26-7af7-426a-8242-84954c0851f5. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] ensure volume a0819b26-7af7-426a-8242-84954c0851f5 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] check if targe iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] create target and attach volume a0819b26-7af7-426a-8242-84954c0851f5 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] create target iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 req-511b6835-9136-4e83-936a-dee22d2525ab tempest-TaggedAttachmentsTest-1179204824 None] target iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:24:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] atach volume v_a0819b26-7af7-426a-8242-84954c0851f5 to target iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:24:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3366356431306161', 'lun': 0, 'mode': 'wt', 'name': 'v_a0819b26-7af7-426a-8242-84954c0851f5', 'prod_id': 'Storage', 'scsi_id': '3f5d10aa20534d95'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] add credentails to target iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:24:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] Geting {'code': 201, 'error': None, 'data': {'name': 'uYNAnVgZ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] initialize_connection for a0819b26-7af7-426a-8242-84954c0851f5 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:24:22 user cinder-volume[73792]: INFO cinder.action_track [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYNAnVgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'e287a0c7-28c8-418b-94f8-e9b79604e049'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-2016549375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a0819b26-7af7-426a-8242-84954c0851f5,launched_at=2023-04-12T06:22:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP uYNAnVgZ w1iTt2v9XKO8Dd',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:18Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:22 user cinder-volume[73792]: INFO cinder.action_track [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-4b6affe4-a43a-45dc-a14a-a41e0aebbdca tempest-TestVolumeSwap-1770819984 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata={},attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-2016549375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a0819b26-7af7-426a-8242-84954c0851f5,launched_at=2023-04-12T06:22:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP uYNAnVgZ w1iTt2v9XKO8Dd',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:24:23Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:28 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=15,cinder:SELECT=63,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:24:28 user cinder-volume[73792]: INFO cinder.action_track [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:18Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] terminate connection for 1872667c-83a2-4de7-a347-cc3fd70bf901  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:24:28 user cinder-volume[73792]: INFO cinder.action_track [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:18Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] Deleting attachment 0f6f8df0-a8b1-4e5f-94a8-645b131c04ed. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:24:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] remove_export for volume: 1872667c-83a2-4de7-a347-cc3fd70bf901. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:24:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:24:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:18Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:24:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] detach volume v_1872667c-83a2-4de7-a347-cc3fd70bf901 from target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:24:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] delete target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:24:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] delete target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:24:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f8b153b-6a1e-4c84-92c8-435007fe8589 req-76392f36-4bc8-4fb6-9c4b-7a8b48b151a0 tempest-TestVolumeSwap-1770819984 None] target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114764099584', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:24:30 user cinder-volume[73792]: INFO cinder.action_track [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:30Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:30 user cinder-volume[73792]: INFO cinder.action_track [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:30Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] create export for volume: 1872667c-83a2-4de7-a347-cc3fd70bf901. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] ensure volume 1872667c-83a2-4de7-a347-cc3fd70bf901 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] check if targe iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] create target and attach volume 1872667c-83a2-4de7-a347-cc3fd70bf901 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] create target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] atach volume v_1872667c-83a2-4de7-a347-cc3fd70bf901 to target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:24:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3362623935356437', 'lun': 0, 'mode': 'wt', 'name': 'v_1872667c-83a2-4de7-a347-cc3fd70bf901', 'prod_id': 'Storage', 'scsi_id': '3bb955d72e5b826a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] add credentails to target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:24:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] Geting {'code': 201, 'error': None, 'data': {'name': 'HXLxNfBv'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] initialize_connection for 1872667c-83a2-4de7-a347-cc3fd70bf901 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:24:34 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=58,cinder:UPDATE=11 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:24:34 user cinder-volume[73792]: INFO cinder.action_track [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXLxNfBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '9146e0f6-f10b-4b14-83c6-bbd8b649a807'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:30Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:34 user cinder-volume[73792]: INFO cinder.action_track [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-ffc50021-76bc-4d6e-b696-6e3f217bebc9 tempest-TestVolumeSwap-1770819984 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata={},attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:24:35Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:35 user cinder-volume[73792]: INFO cinder.action_track [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-673748094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7b336ad6-910c-4dd4-8ef4-c16d440e9881,launched_at=2023-04-12T06:22:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP zvpZhPcJ YTkzhvPCfoUt58',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:41Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:35Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:35 user cinder-volume[73792]: INFO cinder.action_track [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-673748094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7b336ad6-910c-4dd4-8ef4-c16d440e9881,launched_at=2023-04-12T06:22:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP zvpZhPcJ YTkzhvPCfoUt58',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:41Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:35Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] create export for volume: 7b336ad6-910c-4dd4-8ef4-c16d440e9881. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:24:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] ensure volume 7b336ad6-910c-4dd4-8ef4-c16d440e9881 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:24:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] check if targe iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:24:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] create target and attach volume 7b336ad6-910c-4dd4-8ef4-c16d440e9881 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:24:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] create target iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:24:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:39 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Acquiring lock "cinder-fc6abfcd-2056-4ae6-a4d3-a20b324333a0-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:24:39 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Lock "cinder-fc6abfcd-2056-4ae6-a4d3-a20b324333a0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:24:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] atach volume v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 to target iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:24:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] remove_export for volume: fc6abfcd-2056-4ae6-a4d3-a20b324333a0. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:24:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:24:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-72267981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc6abfcd-2056-4ae6-a4d3-a20b324333a0,launched_at=2023-04-12T06:23:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e474b11e55eb45ff91f140aae7e2981d',provider_auth='CHAP mUPcrIFu nlZAifhR2PqbCE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:39Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:24:40Z,updated_at=2023-04-12T06:24:40Z,use_quota=True,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:24:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] detach volume v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 from target iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:24:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/luns/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/luns/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6262343537313665', 'lun': 0, 'mode': 'wt', 'name': 'v_7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'prod_id': 'Storage', 'scsi_id': 'bb45716e1bdaad9b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] add credentails to target iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/luns/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0/luns/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] failed to remove resource iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 because of JDSS resource v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] delete target: iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] delete target iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] Geting {'code': 201, 'error': None, 'data': {'name': 'zvpZhPcJ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] initialize_connection for 7b336ad6-910c-4dd4-8ef4-c16d440e9881 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:24:41 user cinder-volume[73792]: INFO cinder.action_track [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvpZhPcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '073792bc-2ca3-491d-969b-0732a67f3a76'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-673748094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7b336ad6-910c-4dd4-8ef4-c16d440e9881,launched_at=2023-04-12T06:22:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP zvpZhPcJ YTkzhvPCfoUt58',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:41Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:35Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] failed to remove resource iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 because of JDSS resource iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] deleating volume v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] get snapshots for volume v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:41 user cinder-volume[73792]: INFO cinder.action_track [req-918cfc24-30a6-48a9-af17-37fdf86e8e21 req-c5a1ba2c-4468-4606-bf03-b2c2ee28d7aa tempest-TestStampPattern-1782553765 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-673748094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7b336ad6-910c-4dd4-8ef4-c16d440e9881,launched_at=2023-04-12T06:22:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP zvpZhPcJ YTkzhvPCfoUt58',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:41Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:24:41Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:41 user cinder-volume[73792]: INFO cinder.action_track [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-2016549375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a0819b26-7af7-426a-8242-84954c0851f5,launched_at=2023-04-12T06:22:13Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP uYNAnVgZ w1iTt2v9XKO8Dd',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:30Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] terminate connection for a0819b26-7af7-426a-8242-84954c0851f5  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:24:41 user cinder-volume[73792]: INFO cinder.action_track [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-2016549375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a0819b26-7af7-426a-8242-84954c0851f5,launched_at=2023-04-12T06:22:13Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP uYNAnVgZ w1iTt2v9XKO8Dd',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:30Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] Deleting attachment e287a0c7-28c8-418b-94f8-e9b79604e049. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] remove_export for volume: a0819b26-7af7-426a-8242-84954c0851f5. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-2016549375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a0819b26-7af7-426a-8242-84954c0851f5,launched_at=2023-04-12T06:22:13Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP uYNAnVgZ w1iTt2v9XKO8Dd',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:30Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] detach volume v_a0819b26-7af7-426a-8242-84954c0851f5 from target iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/luns/v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/luns/v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] get volume v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/luns/v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] delete target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] delete target iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282037', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59950', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7473394113831018340', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '79fbc9414e543762', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114764124160', 'san:volume_id': '79fbc9414e5437621500d07afbb93e5bfb15a57d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36706', 'name': 'v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] delete volume:v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3aaad2c5-4254-4054-807b-446ec3d6a4bf req-4c27e9ee-5c52-42d9-b594-ba8b485f1044 tempest-TestVolumeSwap-1770819984 None] target iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:24:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] volume v_fc6abfcd-2056-4ae6-a4d3-a20b324333a0 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:24:43 user cinder-volume[73792]: DEBUG cinder.quota [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Created reservations ['6392b2a1-8137-49ca-965c-c3ab47616077', '32e155b8-d63a-4f85-a5b9-b0bba4952a95', '00cb0d45-e872-41bb-8121-24c5b2019c0f', '8a548e41-4cbb-4a3d-85f5-887a06c667bf'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:24:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:24:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:24:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764218368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:24:43 user cinder-volume[73792]: DEBUG cinder.manager [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:24:43 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Deleted volume successfully.
Apr 12 06:24:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b7526601-0f23-41ed-b851-6ebfcf1dc865 tempest-DeleteServersTestJSON-1256853091 None] Lock "cinder-fc6abfcd-2056-4ae6-a4d3-a20b324333a0-delete_volume" released by "delete_volume" :: held 4.344s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:24:44 user cinder-volume[73792]: INFO cinder.action_track [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:43Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] terminate connection for 1872667c-83a2-4de7-a347-cc3fd70bf901  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:24:44 user cinder-volume[73792]: INFO cinder.action_track [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:43Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] Deleting attachment 9146e0f6-f10b-4b14-83c6-bbd8b649a807. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] remove_export for volume: 1872667c-83a2-4de7-a347-cc3fd70bf901. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:43Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] detach volume v_1872667c-83a2-4de7-a347-cc3fd70bf901 from target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] delete target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] delete target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 req-fce9acd8-8c50-4107-81b5-22ecbfb7da1e tempest-TestVolumeSwap-1856443697 None] target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:24:45 user cinder-volume[73792]: INFO cinder.action_track [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1929876138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6938de6c-91d6-44b2-af51-33e34e241f29,launched_at=2023-04-12T06:22:28Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP PptcCjqG n4SbVxr1tOhfIX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:22:53Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] terminate connection for 6938de6c-91d6-44b2-af51-33e34e241f29  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:24:45 user cinder-volume[73792]: INFO cinder.action_track [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1929876138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6938de6c-91d6-44b2-af51-33e34e241f29,launched_at=2023-04-12T06:22:28Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP PptcCjqG n4SbVxr1tOhfIX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:22:53Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] Deleting attachment 7de96b37-b23a-4ffb-a822-75cc529fde57. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] remove_export for volume: 6938de6c-91d6-44b2-af51-33e34e241f29. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1929876138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6938de6c-91d6-44b2-af51-33e34e241f29,launched_at=2023-04-12T06:22:28Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP PptcCjqG n4SbVxr1tOhfIX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:22:53Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume v_6938de6c-91d6-44b2-af51-33e34e241f29 from target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns/v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns/v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns/v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-3d7d1470-9928-4137-b80e-1dcd509dec7a tempest-TaggedBootDevicesTest_v242-1197354508 None] target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:24:46 user cinder-volume[73792]: INFO cinder.action_track [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-15452148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3d1bda7d-311d-45ff-9270-f1f4126818f3,launched_at=2023-04-12T06:22:29Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP TjSIiUbK 5crgQLCAMJSOev',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:29Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:22:58Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] terminate connection for 3d1bda7d-311d-45ff-9270-f1f4126818f3  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:24:46 user cinder-volume[73792]: INFO cinder.action_track [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-15452148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3d1bda7d-311d-45ff-9270-f1f4126818f3,launched_at=2023-04-12T06:22:29Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP TjSIiUbK 5crgQLCAMJSOev',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:29Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:22:58Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] Deleting attachment 261ff49c-2a93-46e3-9267-ec53612a848a. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] remove_export for volume: 3d1bda7d-311d-45ff-9270-f1f4126818f3. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-15452148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3d1bda7d-311d-45ff-9270-f1f4126818f3,launched_at=2023-04-12T06:22:29Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP TjSIiUbK 5crgQLCAMJSOev',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:29Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:22:58Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume v_3d1bda7d-311d-45ff-9270-f1f4126818f3 from target iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/luns/v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/luns/v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/luns/v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-338d8c5d-71f8-4fb0-b56f-4cde8ef63d34 tempest-TaggedBootDevicesTest_v242-1197354508 None] target iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:24:47 user cinder-volume[73792]: INFO cinder.action_track [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-779396692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19059339-d01d-43bc-9939-181649d28bc6,launched_at=2023-04-12T06:22:31Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP CdTKAgwm 5vYsn74DwoPgT8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:23:03Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] terminate connection for 19059339-d01d-43bc-9939-181649d28bc6  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:24:47 user cinder-volume[73792]: INFO cinder.action_track [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-779396692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19059339-d01d-43bc-9939-181649d28bc6,launched_at=2023-04-12T06:22:31Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP CdTKAgwm 5vYsn74DwoPgT8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:23:03Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] Deleting attachment 0da574b5-fbcf-4265-9cd4-d6fc0a79d05c. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] remove_export for volume: 19059339-d01d-43bc-9939-181649d28bc6. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-779396692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19059339-d01d-43bc-9939-181649d28bc6,launched_at=2023-04-12T06:22:31Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP CdTKAgwm 5vYsn74DwoPgT8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:23:03Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume v_19059339-d01d-43bc-9939-181649d28bc6 from target iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/luns/v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/luns/v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:47 user cinder-volume[73792]: INFO cinder.action_track [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-673748094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7b336ad6-910c-4dd4-8ef4-c16d440e9881,launched_at=2023-04-12T06:22:41Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP zvpZhPcJ YTkzhvPCfoUt58',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:41Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:46Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] terminate connection for 7b336ad6-910c-4dd4-8ef4-c16d440e9881  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:24:47 user cinder-volume[73792]: INFO cinder.action_track [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-673748094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7b336ad6-910c-4dd4-8ef4-c16d440e9881,launched_at=2023-04-12T06:22:41Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP zvpZhPcJ YTkzhvPCfoUt58',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:41Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:46Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] Deleting attachment 073792bc-2ca3-491d-969b-0732a67f3a76. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] remove_export for volume: 7b336ad6-910c-4dd4-8ef4-c16d440e9881. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-673748094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7b336ad6-910c-4dd4-8ef4-c16d440e9881,launched_at=2023-04-12T06:22:41Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP zvpZhPcJ YTkzhvPCfoUt58',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:41Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:24:46Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] detach volume v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 from target iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/luns/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/luns/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/luns/v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/luns/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] delete target: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:24:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] delete target iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:24:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-051dbca6-f4f8-4890-8481-44ef8788e05e req-4289893a-3675-4e9d-a87c-9f9f714cd5ec tempest-TaggedBootDevicesTest_v242-1197354508 None] target iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:24:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 req-56f9b847-1d6f-4462-8b76-6a9aaea70ca9 tempest-TestStampPattern-1782553765 None] target iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:24:56 user cinder-volume[73792]: INFO cinder.action_track [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:23:06Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] terminate connection for d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:24:56 user cinder-volume[73792]: INFO cinder.action_track [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:23:06Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:24:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] Deleting attachment 49b30f8f-e996-4b85-8960-ff1be3fb4a63. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:24:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] remove_export for volume: d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:24:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:24:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:23:06Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:24:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] detach volume v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a from target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:24:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] delete target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:24:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] delete target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:24:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:24:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:24:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:24:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-15ece6bd-f56e-4507-ad84-8b4720aafb86 req-1ccf5c06-af7a-4a99-9468-b56d6b40d32e tempest-TestShelveInstance-735091148 None] target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:25:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=51,cinder:UPDATE=16,cinder:INSERT=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:25:03 user cinder-volume[73792]: INFO cinder.action_track [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1584093948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=43ddfeaf-9407-49e8-abb1-f5c9d23dab3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Flow 'volume_create_manager' (1249a27c-c248-4c51-a417-399df78a21af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98eb104-1225-4a13-bdbb-05d28ba5446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98eb104-1225-4a13-bdbb-05d28ba5446e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1584093948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=43ddfeaf-9407-49e8-abb1-f5c9d23dab3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:25:03Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff472861-9f73-4b1b-987a-8d4c892a4bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff472861-9f73-4b1b-987a-8d4c892a4bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c81686-d44a-431b-a606-e68ad6bd45c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c81686-d44a-431b-a606-e68ad6bd45c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'volume_name': 'volume-43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769eb7f70>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2043482-62eb-406f-9077-466fdec01f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2043482-62eb-406f-9077-466fdec01f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47945bb-14b6-4776-ba86-7c3022a99058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:03 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Volume 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769eb7f70>}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Cloning 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 25, 3, 700181)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Found cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 25, 3, 719361)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Creating from source image-volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] cloned volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] cloning v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] create snapshot v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] create volume v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f from snapshot v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'is_clone': True, 'full_name': 'Pool-0/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'name': 'v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] get volume v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282121', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60053', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8427304700371082766', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1f987664b5cb627e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114764066816', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '35710', 'name': 'v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Marking volume 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Creating volume glance metadata for volume 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=64,cinder:UPDATE=13,cinder:INSERT=9,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47945bb-14b6-4776-ba86-7c3022a99058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769eb7f70>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98b9a58-48b2-418d-be56-44de2e212b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:04 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Volume volume-43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (43ddfeaf-9407-49e8-abb1-f5c9d23dab3f): created successfully
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98b9a58-48b2-418d-be56-44de2e212b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] Flow 'volume_create_manager' (1249a27c-c248-4c51-a417-399df78a21af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:04 user cinder-volume[73792]: INFO cinder.action_track [None req-6d10a3e7-4ecd-41cb-9b48-c3407a6d1b8c tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1584093948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=43ddfeaf-9407-49e8-abb1-f5c9d23dab3f,launched_at=2023-04-12T06:25:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP PFGiWOnX FlOn5UNY7QBarM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:25:03Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:05 user cinder-volume[73792]: INFO cinder.action_track [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1465684657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8c9b01f5-884d-4f16-b344-ea6facab9090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Flow 'volume_create_manager' (645b8698-aa53-4d8c-9f1d-3f79599ead1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6337a79b-e839-4afb-af94-2628b820aad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6337a79b-e839-4afb-af94-2628b820aad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1465684657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8c9b01f5-884d-4f16-b344-ea6facab9090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:25:06Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ed7620-1f45-4e8d-918e-282478b6a451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ed7620-1f45-4e8d-918e-282478b6a451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c238c6-621b-427a-8df5-38c2b119a69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c238c6-621b-427a-8df5-38c2b119a69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c9b01f5-884d-4f16-b344-ea6facab9090', 'volume_name': 'volume-8c9b01f5-884d-4f16-b344-ea6facab9090', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e921dd6a-cbdc-4c14-80c3-1521c9ab3e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e921dd6a-cbdc-4c14-80c3-1521c9ab3e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575f47ab-59f0-47ee-95be-0052fcd911e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:05 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Volume 8c9b01f5-884d-4f16-b344-ea6facab9090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c9b01f5-884d-4f16-b344-ea6facab9090', 'volume_size': 1}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] creating volume v_8c9b01f5-884d-4f16-b344-ea6facab9090. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] create volume {'name': 'v_8c9b01f5-884d-4f16-b344-ea6facab9090', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8c9b01f5-884d-4f16-b344-ea6facab9090', 'is_clone': False, 'name': 'v_8c9b01f5-884d-4f16-b344-ea6facab9090'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575f47ab-59f0-47ee-95be-0052fcd911e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c9b01f5-884d-4f16-b344-ea6facab9090', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69add34a-f67e-4560-a59b-cb2a244a37aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:06 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Volume volume-8c9b01f5-884d-4f16-b344-ea6facab9090 (8c9b01f5-884d-4f16-b344-ea6facab9090): created successfully
Apr 12 06:25:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69add34a-f67e-4560-a59b-cb2a244a37aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:06 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] Flow 'volume_create_manager' (645b8698-aa53-4d8c-9f1d-3f79599ead1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:06 user cinder-volume[73792]: INFO cinder.action_track [None req-0627f3a1-5081-4c80-a0ae-83085c816759 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1465684657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8c9b01f5-884d-4f16-b344-ea6facab9090,launched_at=2023-04-12T06:25:06Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP hOloYSmd xanDwu5vPEdmGt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:06Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:25:06Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:07 user cinder-volume[73792]: INFO cinder.action_track [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1357256481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6c75bc08-5a02-4b60-9201-616a5a4f1d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Flow 'volume_create_manager' (0bbde40d-c2b3-47e9-ac94-c350fb1198f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce25cd53-659e-448b-a06b-920316b3b032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce25cd53-659e-448b-a06b-920316b3b032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1357256481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6c75bc08-5a02-4b60-9201-616a5a4f1d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:25:07Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca8c185-8263-46d4-bba5-f1d2e4e8827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca8c185-8263-46d4-bba5-f1d2e4e8827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec0d25b-f9f0-4dfd-85b3-e0a5be2ab787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec0d25b-f9f0-4dfd-85b3-e0a5be2ab787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'volume_name': 'volume-6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d60205-17ca-4a36-bf30-9632ab3d8a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d60205-17ca-4a36-bf30-9632ab3d8a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd25c311-e574-4605-8a4d-a61fda8302e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:07 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Volume 6c75bc08-5a02-4b60-9201-616a5a4f1d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'volume_size': 1}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] creating volume v_6c75bc08-5a02-4b60-9201-616a5a4f1d88. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] create volume {'name': 'v_6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'is_clone': False, 'name': 'v_6c75bc08-5a02-4b60-9201-616a5a4f1d88'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd25c311-e574-4605-8a4d-a61fda8302e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8262bcb8-c998-4760-97ab-1cf286b3eb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:07 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Volume volume-6c75bc08-5a02-4b60-9201-616a5a4f1d88 (6c75bc08-5a02-4b60-9201-616a5a4f1d88): created successfully
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8262bcb8-c998-4760-97ab-1cf286b3eb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] Flow 'volume_create_manager' (0bbde40d-c2b3-47e9-ac94-c350fb1198f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:07 user cinder-volume[73792]: INFO cinder.action_track [None req-261bfbcd-325a-4c00-ae05-ce8ae3928338 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1357256481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6c75bc08-5a02-4b60-9201-616a5a4f1d88,launched_at=2023-04-12T06:25:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP vIhHWXGq UlnXiCJ0kMKt7f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:25:07Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.coordination [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Acquiring lock "cinder-e858dd17-43f2-4bb6-9d13-6f151b01bd2d-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.coordination [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Lock "cinder-e858dd17-43f2-4bb6-9d13-6f151b01bd2d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] remove_export for volume: e858dd17-43f2-4bb6-9d13-6f151b01bd2d. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1099547734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e858dd17-43f2-4bb6-9d13-6f151b01bd2d,launched_at=2023-04-12T06:24:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e95975f26a4677b628411ddb18c68c',provider_auth='CHAP mlSGupMO Wyx0eDjPJLRko4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:24:04Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:25:10Z,updated_at=2023-04-12T06:25:10Z,use_quota=True,user_id='de02e22a24944fdf952fd302b608a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] detach volume v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d from target iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/luns/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/luns/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/luns/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d/luns/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] failed to remove resource iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d because of JDSS resource v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] delete target: iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] delete target iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] failed to remove resource iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d because of JDSS resource iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] deleating volume v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] get snapshots for volume v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] get volume v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:25:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282062', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59986', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16249515407302271652', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'aa27d2edad931207', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763878400', 'san:volume_id': 'aa27d2edad931207c14eb3cce048234767f2ef8a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37889', 'name': 'v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] delete volume:v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:25:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] volume v_e858dd17-43f2-4bb6-9d13-6f151b01bd2d deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:25:11 user cinder-volume[73792]: DEBUG cinder.quota [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Created reservations ['e2a8595f-b0a3-4a64-a6ef-eded83a5ac0a', 'd4cf2eef-d64e-4ee7-bb68-8df399c5762e', '9c3f06f1-9768-4e83-8311-375c102ba5d5', 'eb607f49-d5d1-49cb-90ff-c327c3983cb0'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:25:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:25:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763984896', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:25:11 user cinder-volume[73792]: DEBUG cinder.manager [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:25:12 user cinder-volume[73792]: INFO cinder.volume.manager [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Deleted volume successfully.
Apr 12 06:25:12 user cinder-volume[73792]: DEBUG cinder.coordination [None req-efbe125c-006b-4fca-ba85-d2c0a9d1c366 tempest-AttachSCSIVolumeTestJSON-480153316 None] Lock "cinder-e858dd17-43f2-4bb6-9d13-6f151b01bd2d-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:25:19 user cinder-volume[73792]: INFO cinder.action_track [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1584093948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=43ddfeaf-9407-49e8-abb1-f5c9d23dab3f,launched_at=2023-04-12T06:25:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP PFGiWOnX FlOn5UNY7QBarM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:17Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:19 user cinder-volume[73792]: INFO cinder.action_track [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1584093948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=43ddfeaf-9407-49e8-abb1-f5c9d23dab3f,launched_at=2023-04-12T06:25:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP PFGiWOnX FlOn5UNY7QBarM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:17Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] create export for volume: 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:25:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] ensure volume 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:25:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] check if targe iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:25:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] create target and attach volume 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:25:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] create target iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:25:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:20 user cinder-volume[73792]: INFO cinder.action_track [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-392335257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=2339c95f-8a41-4d6a-87ce-0a2dad7cac97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='163648de01af4f63ae99b74830e90f00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='4cd015d7680442619d7cece839dc095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Flow 'volume_create_manager' (71396d10-6f30-49b4-b49c-aa06edc59554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210a8a00-3eba-41c4-b7aa-89b81555becb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210a8a00-3eba-41c4-b7aa-89b81555becb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-392335257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=2339c95f-8a41-4d6a-87ce-0a2dad7cac97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='163648de01af4f63ae99b74830e90f00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:25:21Z,use_quota=True,user_id='4cd015d7680442619d7cece839dc095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8052afbf-f104-4a1d-8822-02b9e86a62bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8052afbf-f104-4a1d-8822-02b9e86a62bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f62517a-0ccf-4a20-9545-fe108488cf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f62517a-0ccf-4a20-9545-fe108488cf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2339c95f-8a41-4d6a-87ce-0a2dad7cac97', 'volume_name': 'volume-2339c95f-8a41-4d6a-87ce-0a2dad7cac97', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f179b0-cfec-41cc-95a9-e8559bf491b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f179b0-cfec-41cc-95a9-e8559bf491b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ebb74c-a8e2-42ba-929d-8b0886e9a786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:20 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Volume 2339c95f-8a41-4d6a-87ce-0a2dad7cac97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2339c95f-8a41-4d6a-87ce-0a2dad7cac97', 'volume_size': 1}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] creating volume v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] create volume {'name': 'v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97', 'is_clone': False, 'name': 'v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ebb74c-a8e2-42ba-929d-8b0886e9a786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2339c95f-8a41-4d6a-87ce-0a2dad7cac97', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309c9f28-da4d-4277-ba2c-c9507ac0fbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:21 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Volume volume-2339c95f-8a41-4d6a-87ce-0a2dad7cac97 (2339c95f-8a41-4d6a-87ce-0a2dad7cac97): created successfully
Apr 12 06:25:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309c9f28-da4d-4277-ba2c-c9507ac0fbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] Flow 'volume_create_manager' (71396d10-6f30-49b4-b49c-aa06edc59554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:21 user cinder-volume[73792]: INFO cinder.action_track [None req-6b97b848-ac9f-4f5b-863a-32ca81605de3 tempest-SnapshotsActionsTest-280375524 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-392335257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=2339c95f-8a41-4d6a-87ce-0a2dad7cac97,launched_at=2023-04-12T06:25:21Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='163648de01af4f63ae99b74830e90f00',provider_auth='CHAP owMnuqXe NrFMPq7B9gJkTG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:21Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:25:21Z,use_quota=True,user_id='4cd015d7680442619d7cece839dc095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:21 user cinder-volume[73792]: INFO cinder.action_track [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Snapshot-2139644386',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=2f94f603-60a1-4239-872d-fd524924fa0b,metadata={},progress='0%',project_id='163648de01af4f63ae99b74830e90f00',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='4cd015d7680442619d7cece839dc095b',volume=<?>,volume_id=2339c95f-8a41-4d6a-87ce-0a2dad7cac97,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] create snapshot 2f94f603-60a1-4239-872d-fd524924fa0b for volume 2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:25:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] cloning v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 to s_2f94f603-60a1-4239-872d-fd524924fa0b {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:25:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] create snapshot s_2f94f603-60a1-4239-872d-fd524924fa0b {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:25:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] atach volume v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f to target iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_2f94f603-60a1-4239-872d-fd524924fa0b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] create volume s_2f94f603-60a1-4239-872d-fd524924fa0b from snapshot s_2f94f603-60a1-4239-872d-fd524924fa0b {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97@s_2f94f603-60a1-4239-872d-fd524924fa0b', 'is_clone': True, 'full_name': 'Pool-0/s_2f94f603-60a1-4239-872d-fd524924fa0b', 'name': 's_2f94f603-60a1-4239-872d-fd524924fa0b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2f94f603-60a1-4239-872d-fd524924fa0b/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2f94f603-60a1-4239-872d-fd524924fa0b/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2f94f603-60a1-4239-872d-fd524924fa0b/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] volume s_2f94f603-60a1-4239-872d-fd524924fa0b properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:25:22 user cinder-volume[73792]: INFO cinder.volume.manager [None req-140457cc-5406-4109-937c-e0c5df5dcd6c tempest-SnapshotsActionsTest-280375524 None] Create snapshot completed successfully
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3166393837363634', 'lun': 0, 'mode': 'wt', 'name': 'v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'prod_id': 'Storage', 'scsi_id': '1f987664b5cb627e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] add credentails to target iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 201, 'error': None, 'data': {'name': 'PFGiWOnX'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] initialize_connection for 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:25:23 user cinder-volume[73792]: INFO cinder.action_track [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFGiWOnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '2ed55170-1be1-4564-8950-0a3ec073e131'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1584093948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=43ddfeaf-9407-49e8-abb1-f5c9d23dab3f,launched_at=2023-04-12T06:25:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP PFGiWOnX FlOn5UNY7QBarM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:17Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:23 user cinder-volume[73792]: INFO cinder.action_track [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Snapshot-434007687',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=cdc102db-c277-4d4d-a6ef-0be3e68d2d12,metadata={},progress='0%',project_id='163648de01af4f63ae99b74830e90f00',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='4cd015d7680442619d7cece839dc095b',volume=<?>,volume_id=2339c95f-8a41-4d6a-87ce-0a2dad7cac97,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] create snapshot cdc102db-c277-4d4d-a6ef-0be3e68d2d12 for volume 2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] cloning v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 to s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] create snapshot s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:23 user cinder-volume[73792]: INFO cinder.action_track [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-b8316c4b-5be1-48dc-81a7-2e5b8e4f5d60 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1584093948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=43ddfeaf-9407-49e8-abb1-f5c9d23dab3f,launched_at=2023-04-12T06:25:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP PFGiWOnX FlOn5UNY7QBarM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:25:23Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:23 user cinder-volume[73792]: INFO cinder.action_track [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1465684657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8c9b01f5-884d-4f16-b344-ea6facab9090,launched_at=2023-04-12T06:25:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP hOloYSmd xanDwu5vPEdmGt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:06Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:17Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:23 user cinder-volume[73792]: INFO cinder.action_track [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1465684657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8c9b01f5-884d-4f16-b344-ea6facab9090,launched_at=2023-04-12T06:25:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP hOloYSmd xanDwu5vPEdmGt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:06Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:17Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] create export for volume: 8c9b01f5-884d-4f16-b344-ea6facab9090. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] ensure volume 8c9b01f5-884d-4f16-b344-ea6facab9090 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] check if targe iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] create target and attach volume 8c9b01f5-884d-4f16-b344-ea6facab9090 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] create target iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_cdc102db-c277-4d4d-a6ef-0be3e68d2d12'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] create volume s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 from snapshot s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:25:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97@s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12', 'is_clone': True, 'full_name': 'Pool-0/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12', 'name': 's_cdc102db-c277-4d4d-a6ef-0be3e68d2d12'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] volume s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:25:24 user cinder-volume[73792]: INFO cinder.volume.manager [None req-af64942e-3546-4e2b-a55e-71a29f40ee8b tempest-SnapshotsActionsTest-280375524 None] Create snapshot completed successfully
Apr 12 06:25:25 user cinder-volume[73792]: DEBUG cinder.coordination [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Acquiring lock "cinder-cdc102db-c277-4d4d-a6ef-0be3e68d2d12-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:25:25 user cinder-volume[73792]: DEBUG cinder.coordination [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Lock "cinder-cdc102db-c277-4d4d-a6ef-0be3e68d2d12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:25:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] deleating snapshot s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:25:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] get snapshots for volume s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:25:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] get volume s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97@s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282141', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60084', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '362563877776930413', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dee4ba766316e16b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763841536', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38077', 'name': 's_cdc102db-c277-4d4d-a6ef-0be3e68d2d12', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] delete snapshot s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 of volume v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] atach volume v_8c9b01f5-884d-4f16-b344-ea6facab9090 to target iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] snapshot s_cdc102db-c277-4d4d-a6ef-0be3e68d2d12 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=67,cinder:UPDATE=22,cinder:INSERT=8,cinder:DELETE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.quota [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Created reservations ['e817ad6b-ce66-4e77-b2b7-4c1115c21da3', '3aaacea3-a3b2-4de4-9b1f-371e3b9b57df', '68cb9e41-567a-405b-8c23-28649f4c465f', 'e5979dec-87aa-4070-9fbc-ad9ef15c00e7'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:26 user cinder-volume[73792]: INFO cinder.volume.manager [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Delete snapshot completed successfully.
Apr 12 06:25:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-84fc2d5b-97c0-4ff8-9dd9-8c940876c203 tempest-SnapshotsActionsTest-926000799 None] Lock "cinder-cdc102db-c277-4d4d-a6ef-0be3e68d2d12-delete_snapshot" released by "delete_snapshot" :: held 1.189s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3462373531336534', 'lun': 0, 'mode': 'wt', 'name': 'v_8c9b01f5-884d-4f16-b344-ea6facab9090', 'prod_id': 'Storage', 'scsi_id': '4b7513e4d47a5126'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] add credentails to target iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:28 user cinder-volume[73792]: INFO cinder.action_track [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Snapshot-1094941925',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=b2cf5b7b-b469-4c1e-9ddb-a942152ac859,metadata={},progress='0%',project_id='163648de01af4f63ae99b74830e90f00',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='4cd015d7680442619d7cece839dc095b',volume=<?>,volume_id=2339c95f-8a41-4d6a-87ce-0a2dad7cac97,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] create snapshot b2cf5b7b-b469-4c1e-9ddb-a942152ac859 for volume 2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] cloning v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 to s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] create snapshot s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 201, 'error': None, 'data': {'name': 'hOloYSmd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=64,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] initialize_connection for 8c9b01f5-884d-4f16-b344-ea6facab9090 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:25:28 user cinder-volume[73792]: INFO cinder.action_track [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOloYSmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '2a42ffb3-97fa-4aad-b096-c50387e5cab7'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1465684657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8c9b01f5-884d-4f16-b344-ea6facab9090,launched_at=2023-04-12T06:25:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP hOloYSmd xanDwu5vPEdmGt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:06Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:17Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:28 user cinder-volume[73792]: INFO cinder.action_track [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-e213e9e0-9590-4623-aa04-8cdc9dc8ac84 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1465684657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8c9b01f5-884d-4f16-b344-ea6facab9090,launched_at=2023-04-12T06:25:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP hOloYSmd xanDwu5vPEdmGt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:06Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:25:28Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_b2cf5b7b-b469-4c1e-9ddb-a942152ac859'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] create volume s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 from snapshot s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:28 user cinder-volume[73792]: INFO cinder.action_track [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1357256481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6c75bc08-5a02-4b60-9201-616a5a4f1d88,launched_at=2023-04-12T06:25:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP vIhHWXGq UlnXiCJ0kMKt7f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:18Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:28 user cinder-volume[73792]: INFO cinder.action_track [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1357256481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6c75bc08-5a02-4b60-9201-616a5a4f1d88,launched_at=2023-04-12T06:25:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP vIhHWXGq UlnXiCJ0kMKt7f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:18Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] create export for volume: 6c75bc08-5a02-4b60-9201-616a5a4f1d88. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] ensure volume 6c75bc08-5a02-4b60-9201-616a5a4f1d88 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] check if targe iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] create target and attach volume 6c75bc08-5a02-4b60-9201-616a5a4f1d88 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] create target iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97@s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859', 'is_clone': True, 'full_name': 'Pool-0/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859', 'name': 's_b2cf5b7b-b469-4c1e-9ddb-a942152ac859'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] volume s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:25:29 user cinder-volume[73792]: INFO cinder.volume.manager [None req-5f4a6250-c8b0-488c-ab1e-d5ff24d28e5e tempest-SnapshotsActionsTest-280375524 None] Create snapshot completed successfully
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Acquiring lock "cinder-b2cf5b7b-b469-4c1e-9ddb-a942152ac859-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Lock "cinder-b2cf5b7b-b469-4c1e-9ddb-a942152ac859-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] deleating snapshot s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] get snapshots for volume s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] get volume s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97@s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282146', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60098', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12849080717688342679', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bcdec0e5266a906c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763804672', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '36551', 'name': 's_b2cf5b7b-b469-4c1e-9ddb-a942152ac859', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] delete snapshot s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 of volume v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114763804672', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:25:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] snapshot s_b2cf5b7b-b469-4c1e-9ddb-a942152ac859 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.quota [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Created reservations ['85079975-dcaf-4e94-96e6-8128014b463d', '54333a3d-938d-438a-9f6c-80a29368577f', '4612efdf-88b9-480c-8641-3a4217f3df79', 'a707ca0b-de9e-4f3f-8a3f-335d9e84a25d'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:31 user cinder-volume[73792]: INFO cinder.volume.manager [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Delete snapshot completed successfully.
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6130ca1a-bc4d-4ba0-9b73-943948cb7eb6 tempest-SnapshotsActionsTest-926000799 None] Lock "cinder-b2cf5b7b-b469-4c1e-9ddb-a942152ac859-delete_snapshot" released by "delete_snapshot" :: held 1.202s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] atach volume v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 to target iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.coordination [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Acquiring lock "cinder-19059339-d01d-43bc-9939-181649d28bc6-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.coordination [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "cinder-19059339-d01d-43bc-9939-181649d28bc6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] remove_export for volume: 19059339-d01d-43bc-9939-181649d28bc6. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-779396692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19059339-d01d-43bc-9939-181649d28bc6,launched_at=2023-04-12T06:22:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP CdTKAgwm 5vYsn74DwoPgT8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:25:32Z,updated_at=2023-04-12T06:25:32Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume v_19059339-d01d-43bc-9939-181649d28bc6 from target iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/luns/v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/luns/v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/luns/v_19059339-d01d-43bc-9939-181649d28bc6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6/luns/v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] failed to remove resource iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 because of JDSS resource v_19059339-d01d-43bc-9939-181649d28bc6 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] failed to remove resource iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 because of JDSS resource iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] deleating volume v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] get snapshots for volume v_19059339-d01d-43bc-9939-181649d28bc6  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19059339-d01d-43bc-9939-181649d28bc6/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19059339-d01d-43bc-9939-181649d28bc6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19059339-d01d-43bc-9939-181649d28bc6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] get volume v_19059339-d01d-43bc-9939-181649d28bc6 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_19059339-d01d-43bc-9939-181649d28bc6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281968', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59826', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5077057683103105903', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '64cf8e3082c6a0fb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763816960', 'san:volume_id': '64cf8e3082c6a0fbc56ed8f518db061fbde1d990', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37411', 'name': 'v_19059339-d01d-43bc-9939-181649d28bc6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] delete volume:v_19059339-d01d-43bc-9939-181649d28bc6 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:32 user cinder-volume[73792]: INFO cinder.action_track [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Snapshot-1863008560',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=6e2dfebd-98a0-4fea-91e2-392be70196d7,metadata={},progress='0%',project_id='163648de01af4f63ae99b74830e90f00',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='4cd015d7680442619d7cece839dc095b',volume=<?>,volume_id=2339c95f-8a41-4d6a-87ce-0a2dad7cac97,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] create snapshot 6e2dfebd-98a0-4fea-91e2-392be70196d7 for volume 2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] cloning v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 to s_6e2dfebd-98a0-4fea-91e2-392be70196d7 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] create snapshot s_6e2dfebd-98a0-4fea-91e2-392be70196d7 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6265636266383237', 'lun': 0, 'mode': 'wt', 'name': 'v_6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'prod_id': 'Storage', 'scsi_id': 'becbf82791519806'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] add credentails to target iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 201, 'error': None, 'data': {'name': 'vIhHWXGq'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19059339-d01d-43bc-9939-181649d28bc6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] volume v_19059339-d01d-43bc-9939-181649d28bc6 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] initialize_connection for 6c75bc08-5a02-4b60-9201-616a5a4f1d88 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_6e2dfebd-98a0-4fea-91e2-392be70196d7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] create volume s_6e2dfebd-98a0-4fea-91e2-392be70196d7 from snapshot s_6e2dfebd-98a0-4fea-91e2-392be70196d7 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:33 user cinder-volume[73792]: INFO cinder.action_track [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIhHWXGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '5660e0e3-8e7d-473b-b61c-f8ea9e68e3a4'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1357256481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6c75bc08-5a02-4b60-9201-616a5a4f1d88,launched_at=2023-04-12T06:25:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP vIhHWXGq UlnXiCJ0kMKt7f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:18Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.quota [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Created reservations ['3e8b07e6-3ff9-4b26-bdcd-98811573095e', 'fe482ffc-6f80-4525-a8fa-8b2339e634c3', '634d8c5d-8a90-4586-921a-2e3af2e6f140', 'b0b2e383-f509-4752-81e4-9011a375f3c1'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:33 user cinder-volume[73792]: INFO cinder.action_track [req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a req-a1a85fdf-c207-458d-80b8-d18bba98bacb tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1357256481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6c75bc08-5a02-4b60-9201-616a5a4f1d88,launched_at=2023-04-12T06:25:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP vIhHWXGq UlnXiCJ0kMKt7f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:25:33Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97@s_6e2dfebd-98a0-4fea-91e2-392be70196d7', 'is_clone': True, 'full_name': 'Pool-0/s_6e2dfebd-98a0-4fea-91e2-392be70196d7', 'name': 's_6e2dfebd-98a0-4fea-91e2-392be70196d7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e2dfebd-98a0-4fea-91e2-392be70196d7/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e2dfebd-98a0-4fea-91e2-392be70196d7/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e2dfebd-98a0-4fea-91e2-392be70196d7/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] volume s_6e2dfebd-98a0-4fea-91e2-392be70196d7 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:25:33 user cinder-volume[73792]: INFO cinder.volume.manager [None req-d907877b-4fa6-4104-8e2e-3ac1ea2492af tempest-SnapshotsActionsTest-280375524 None] Create snapshot completed successfully
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763874304', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.manager [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:25:33 user cinder-volume[73792]: INFO cinder.volume.manager [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Deleted volume successfully.
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.coordination [None req-48eb0d4d-0502-4501-8206-5536891dd1a8 tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "cinder-19059339-d01d-43bc-9939-181649d28bc6-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.coordination [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Acquiring lock "cinder-3d1bda7d-311d-45ff-9270-f1f4126818f3-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:25:33 user cinder-volume[73792]: DEBUG cinder.coordination [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "cinder-3d1bda7d-311d-45ff-9270-f1f4126818f3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] remove_export for volume: 3d1bda7d-311d-45ff-9270-f1f4126818f3. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-15452148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3d1bda7d-311d-45ff-9270-f1f4126818f3,launched_at=2023-04-12T06:22:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP TjSIiUbK 5crgQLCAMJSOev',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:29Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:25:34Z,updated_at=2023-04-12T06:25:34Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume v_3d1bda7d-311d-45ff-9270-f1f4126818f3 from target iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/luns/v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/luns/v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/luns/v_3d1bda7d-311d-45ff-9270-f1f4126818f3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3/luns/v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] failed to remove resource iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 because of JDSS resource v_3d1bda7d-311d-45ff-9270-f1f4126818f3 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] failed to remove resource iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 because of JDSS resource iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] deleating volume v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] get snapshots for volume v_3d1bda7d-311d-45ff-9270-f1f4126818f3  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d1bda7d-311d-45ff-9270-f1f4126818f3/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d1bda7d-311d-45ff-9270-f1f4126818f3/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d1bda7d-311d-45ff-9270-f1f4126818f3/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] get volume v_3d1bda7d-311d-45ff-9270-f1f4126818f3 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3d1bda7d-311d-45ff-9270-f1f4126818f3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281966', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59817', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9940449277221564392', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd6000f59555ff928', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763874304', 'san:volume_id': 'd6000f59555ff928d279a70a7157d3f13ffa4ce4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37505', 'name': 'v_3d1bda7d-311d-45ff-9270-f1f4126818f3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] delete volume:v_3d1bda7d-311d-45ff-9270-f1f4126818f3 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Acquiring lock "cinder-6e2dfebd-98a0-4fea-91e2-392be70196d7-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Lock "cinder-6e2dfebd-98a0-4fea-91e2-392be70196d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] deleating snapshot s_6e2dfebd-98a0-4fea-91e2-392be70196d7. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] get snapshots for volume s_6e2dfebd-98a0-4fea-91e2-392be70196d7  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e2dfebd-98a0-4fea-91e2-392be70196d7/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e2dfebd-98a0-4fea-91e2-392be70196d7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e2dfebd-98a0-4fea-91e2-392be70196d7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] get volume s_6e2dfebd-98a0-4fea-91e2-392be70196d7 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e2dfebd-98a0-4fea-91e2-392be70196d7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e2dfebd-98a0-4fea-91e2-392be70196d7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97@s_6e2dfebd-98a0-4fea-91e2-392be70196d7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_6e2dfebd-98a0-4fea-91e2-392be70196d7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282150', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60113', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '843609344072135908', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '543f863faa59dfbe', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763956224', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '36179', 'name': 's_6e2dfebd-98a0-4fea-91e2-392be70196d7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6e2dfebd-98a0-4fea-91e2-392be70196d7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] delete snapshot s_6e2dfebd-98a0-4fea-91e2-392be70196d7 of volume v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_6e2dfebd-98a0-4fea-91e2-392be70196d7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_6e2dfebd-98a0-4fea-91e2-392be70196d7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d1bda7d-311d-45ff-9270-f1f4126818f3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] volume v_3d1bda7d-311d-45ff-9270-f1f4126818f3 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=66,cinder:INSERT=8,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.quota [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Created reservations ['27d8ca85-bc5a-4929-9438-c5bdafa77710', 'b1fc1721-acb6-471c-b6ca-4a74290355e9', 'dd9e45ac-76c0-48d4-8288-467aa1cebf9e', '14f58681-93bb-4ac2-96b0-9bea267e3637'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763943936', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.manager [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:25:35 user cinder-volume[73792]: INFO cinder.volume.manager [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Deleted volume successfully.
Apr 12 06:25:35 user cinder-volume[73792]: DEBUG cinder.coordination [None req-49667113-93b6-4daa-b9f0-269fc77ee34f tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "cinder-3d1bda7d-311d-45ff-9270-f1f4126818f3-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_6e2dfebd-98a0-4fea-91e2-392be70196d7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] snapshot s_6e2dfebd-98a0-4fea-91e2-392be70196d7 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.coordination [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Acquiring lock "cinder-6938de6c-91d6-44b2-af51-33e34e241f29-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.coordination [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "cinder-6938de6c-91d6-44b2-af51-33e34e241f29-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=62,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=7 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] remove_export for volume: 6938de6c-91d6-44b2-af51-33e34e241f29. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1929876138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6938de6c-91d6-44b2-af51-33e34e241f29,launched_at=2023-04-12T06:22:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e313922ba234462285d20a4f1f2d88d0',provider_auth='CHAP PptcCjqG n4SbVxr1tOhfIX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:25:36Z,updated_at=2023-04-12T06:25:36Z,use_quota=True,user_id='977b800fab264446b0492c93b0dc12d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] detach volume v_6938de6c-91d6-44b2-af51-33e34e241f29 from target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns/v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns/v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.quota [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Created reservations ['2f6f42d8-a131-4249-9fed-e179c96266e9', '807cc5a4-b737-4d4c-b830-b189caff5a53', '0ea4b155-bd16-4c55-ac27-4b4a3668ce3e', '2a44da22-5c64-487f-839d-2c2765957894'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns/v_6938de6c-91d6-44b2-af51-33e34e241f29'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29/luns/v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] failed to remove resource iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 because of JDSS resource v_6938de6c-91d6-44b2-af51-33e34e241f29 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] delete target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:36 user cinder-volume[73792]: INFO cinder.volume.manager [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Delete snapshot completed successfully.
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1119bf02-74e5-411f-80a0-44fbd6efc078 tempest-SnapshotsActionsTest-926000799 None] Lock "cinder-6e2dfebd-98a0-4fea-91e2-392be70196d7-delete_snapshot" released by "delete_snapshot" :: held 1.363s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] failed to remove resource iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 because of JDSS resource iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] deleating volume v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] get snapshots for volume v_6938de6c-91d6-44b2-af51-33e34e241f29  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6938de6c-91d6-44b2-af51-33e34e241f29/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6938de6c-91d6-44b2-af51-33e34e241f29/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '16285696', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-12 08:46:04', 'volsize': '1073741824', 'createtxg': '59801', 'guid': '3712742937224178844', 'compressratio': '1.17', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '16285696', 'type': 'snapshot', 'secondarycache': 'all', 'used': '307200', 'refcompressratio': '1.17', 'fscontext': 'none', 'clones': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'objsetid': '37025', 'name': 'v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'defer_destroy': 'off', 'san:volume_id': 'f54a79d648b60efe7b1cde9af5f5555b3580b85c', 'mlslabel': 'none', 'logicalreferenced': '19042304', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6938de6c-91d6-44b2-af51-33e34e241f29/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:36 user cinder-volume[73792]: INFO cinder.action_track [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Flow 'volume_create_manager' (5204550a-6f2b-44c2-90e3-14eb1e91a9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f274dde7-61e8-4ad4-9de3-d5c18892175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:36 user cinder-volume[73792]: INFO cinder.action_track [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-snapshot-356540542',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=a2733057-27d3-4034-9b97-aaa88c74593e,metadata={},progress='0%',project_id='5a7d74130d4d417a93de352381229948',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume=<?>,volume_id=7b336ad6-910c-4dd4-8ef4-c16d440e9881,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f274dde7-61e8-4ad4-9de3-d5c18892175d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:25:37Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6012b26-ec58-4f37-a0bc-ffb5fdb4f384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6012b26-ec58-4f37-a0bc-ffb5fdb4f384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5cfca9-6573-4398-9b9f-30d1e7f88839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5cfca9-6573-4398-9b9f-30d1e7f88839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd96a84d2-2151-4f60-a72b-25e84b80c975', 'volume_name': 'volume-d96a84d2-2151-4f60-a72b-25e84b80c975', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442b7b83-c704-4955-b6db-a21e01810d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442b7b83-c704-4955-b6db-a21e01810d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8892b3a-1990-474f-a24b-c1f8cddd3d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:36 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Volume d96a84d2-2151-4f60-a72b-25e84b80c975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d96a84d2-2151-4f60-a72b-25e84b80c975', 'volume_size': 1}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] creating volume v_d96a84d2-2151-4f60-a72b-25e84b80c975. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] create volume {'name': 'v_d96a84d2-2151-4f60-a72b-25e84b80c975', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] create snapshot a2733057-27d3-4034-9b97-aaa88c74593e for volume 7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] cloning v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 to s_a2733057-27d3-4034-9b97-aaa88c74593e {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] create snapshot s_a2733057-27d3-4034-9b97-aaa88c74593e {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_a2733057-27d3-4034-9b97-aaa88c74593e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] create volume s_a2733057-27d3-4034-9b97-aaa88c74593e from snapshot s_a2733057-27d3-4034-9b97-aaa88c74593e {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:37 user cinder-volume[73792]: INFO cinder.action_track [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Snapshot-497076990',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=27ef0b13-1fa3-41de-9e40-36ca8ce9052d,metadata={},progress='0%',project_id='163648de01af4f63ae99b74830e90f00',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='4cd015d7680442619d7cece839dc095b',volume=<?>,volume_id=2339c95f-8a41-4d6a-87ce-0a2dad7cac97,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] create snapshot 27ef0b13-1fa3-41de-9e40-36ca8ce9052d for volume 2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] cloning v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 to s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] create snapshot s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d96a84d2-2151-4f60-a72b-25e84b80c975', 'is_clone': False, 'name': 'v_d96a84d2-2151-4f60-a72b-25e84b80c975'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8892b3a-1990-474f-a24b-c1f8cddd3d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d96a84d2-2151-4f60-a72b-25e84b80c975', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65075f9-9cc6-49bf-910b-710a7b45714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:37 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Volume volume-d96a84d2-2151-4f60-a72b-25e84b80c975 (d96a84d2-2151-4f60-a72b-25e84b80c975): created successfully
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65075f9-9cc6-49bf-910b-710a7b45714b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] Flow 'volume_create_manager' (5204550a-6f2b-44c2-90e3-14eb1e91a9e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:37 user cinder-volume[73792]: INFO cinder.action_track [None req-1cb09e19-da6d-4dc8-8fc9-579a1013f945 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:25:37Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6938de6c-91d6-44b2-af51-33e34e241f29 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] volume v_6938de6c-91d6-44b2-af51-33e34e241f29 updated {{(pid=73792) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}}
Apr 12 06:25:37 user cinder-volume[73792]: DEBUG cinder.quota [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Created reservations ['1fa11058-e5f1-44bf-8800-137f90c3aea9', '00467745-86b9-4c2a-bd8d-99eec1ce67d5', '7e87147a-666a-4da3-82f5-a306c9baffa8', 'e7900b10-2d5e-402d-b9f8-1c29a6074b11'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881@s_a2733057-27d3-4034-9b97-aaa88c74593e', 'is_clone': True, 'full_name': 'Pool-0/s_a2733057-27d3-4034-9b97-aaa88c74593e', 'name': 's_a2733057-27d3-4034-9b97-aaa88c74593e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] volume s_a2733057-27d3-4034-9b97-aaa88c74593e properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:25:38 user cinder-volume[73792]: INFO cinder.volume.manager [None req-9a25e3bb-e37c-4b48-b958-cd405f2d32c5 tempest-TestStampPattern-1782553765 None] Create snapshot completed successfully
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_27ef0b13-1fa3-41de-9e40-36ca8ce9052d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] create volume s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d from snapshot s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763816960', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.manager [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:25:38 user cinder-volume[73792]: INFO cinder.volume.manager [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Deleted volume successfully.
Apr 12 06:25:38 user cinder-volume[73792]: DEBUG cinder.coordination [None req-03dd6dfb-f690-4fff-8559-bd57ea59a24f tempest-TaggedBootDevicesTest_v242-1197354508 None] Lock "cinder-6938de6c-91d6-44b2-af51-33e34e241f29-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97@s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d', 'is_clone': True, 'full_name': 'Pool-0/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d', 'name': 's_27ef0b13-1fa3-41de-9e40-36ca8ce9052d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] volume s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:25:39 user cinder-volume[73792]: INFO cinder.volume.manager [None req-4cf94747-2c07-4179-a296-2e75a71d03be tempest-SnapshotsActionsTest-280375524 None] Create snapshot completed successfully
Apr 12 06:25:39 user cinder-volume[73792]: INFO cinder.action_track [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:39Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:39 user cinder-volume[73792]: INFO cinder.action_track [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:39Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] create export for volume: d96a84d2-2151-4f60-a72b-25e84b80c975. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] ensure volume d96a84d2-2151-4f60-a72b-25e84b80c975 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] check if targe iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] create target and attach volume d96a84d2-2151-4f60-a72b-25e84b80c975 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] create target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Acquiring lock "cinder-27ef0b13-1fa3-41de-9e40-36ca8ce9052d-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Lock "cinder-27ef0b13-1fa3-41de-9e40-36ca8ce9052d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] deleating snapshot s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] get snapshots for volume s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] atach volume v_d96a84d2-2151-4f60-a72b-25e84b80c975 to target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:25:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] get volume s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:25:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3830653063646534', 'lun': 0, 'mode': 'wt', 'name': 'v_d96a84d2-2151-4f60-a72b-25e84b80c975', 'prod_id': 'Storage', 'scsi_id': '80e0cde4d5d119c9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] add credentails to target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:25:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97@s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282156', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60134', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7464707930478052928', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '27c6f312f5f233c9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763780096', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38150', 'name': 's_27ef0b13-1fa3-41de-9e40-36ca8ce9052d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] delete snapshot s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d of volume v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:25:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'name': 'AoTzegHP'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] initialize_connection for d96a84d2-2151-4f60-a72b-25e84b80c975 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:25:45 user cinder-volume[73792]: INFO cinder.action_track [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoTzegHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '79834751-8c5e-444f-af12-08bbec4e7de5'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:39Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:45 user cinder-volume[73792]: INFO cinder.action_track [req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a req-a89edad6-191d-4a8d-91d6-230f32c3f715 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:25:45Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] snapshot s_27ef0b13-1fa3-41de-9e40-36ca8ce9052d deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.quota [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Created reservations ['b82a547c-dbe5-442f-a28f-a5fe660c280c', '9190d78b-f610-4014-8af1-351c6881cefb', '08e04740-6a45-427d-904e-32fb257eeb57', 'fca569cb-777c-44f8-a109-75de625cacb5'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=30,cinder:SELECT=61,cinder:DELETE=4,cinder:INSERT=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:25:46 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Delete snapshot completed successfully.
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b968a775-a154-4906-9ccb-24d7b2367dcf tempest-SnapshotsActionsTest-926000799 None] Lock "cinder-27ef0b13-1fa3-41de-9e40-36ca8ce9052d-delete_snapshot" released by "delete_snapshot" :: held 6.267s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Acquiring lock "cinder-2f94f603-60a1-4239-872d-fd524924fa0b-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Lock "cinder-2f94f603-60a1-4239-872d-fd524924fa0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] deleating snapshot s_2f94f603-60a1-4239-872d-fd524924fa0b. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] get snapshots for volume s_2f94f603-60a1-4239-872d-fd524924fa0b  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2f94f603-60a1-4239-872d-fd524924fa0b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2f94f603-60a1-4239-872d-fd524924fa0b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:46 user cinder-volume[73792]: INFO cinder.action_track [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-588781848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff8cf913-7198-47e1-adda-fe9fff61c36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a2733057-27d3-4034-9b97-aaa88c74593e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Flow 'volume_create_manager' (023db559-04e5-4c8e-8326-aae6566e0e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da59c0a-dd25-4bf4-875c-968a44efd9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da59c0a-dd25-4bf4-875c-968a44efd9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-588781848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff8cf913-7198-47e1-adda-fe9fff61c36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a2733057-27d3-4034-9b97-aaa88c74593e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:25:47Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cb4d1a-8223-460c-a6d5-c074fcee17c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cb4d1a-8223-460c-a6d5-c074fcee17c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14efeb9c-08cd-4416-abc5-bcdbc7549ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14efeb9c-08cd-4416-abc5-bcdbc7549ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ff8cf913-7198-47e1-adda-fe9fff61c36b', 'volume_name': 'volume-ff8cf913-7198-47e1-adda-fe9fff61c36b', 'volume_size': 1, 'snapshot_id': 'a2733057-27d3-4034-9b97-aaa88c74593e'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c12eb76-e597-4179-9069-fc20ec616f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c12eb76-e597-4179-9069-fc20ec616f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6b86f4-ef5c-496f-9402-0387c56685c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:47 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Volume ff8cf913-7198-47e1-adda-fe9fff61c36b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ff8cf913-7198-47e1-adda-fe9fff61c36b', 'volume_size': 1, 'snapshot_id': 'a2733057-27d3-4034-9b97-aaa88c74593e'}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] create volume ff8cf913-7198-47e1-adda-fe9fff61c36b from snapshot a2733057-27d3-4034-9b97-aaa88c74593e {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] cloning s_a2733057-27d3-4034-9b97-aaa88c74593e to v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] create snapshot v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2f94f603-60a1-4239-872d-fd524924fa0b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] get volume s_2f94f603-60a1-4239-872d-fd524924fa0b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2f94f603-60a1-4239-872d-fd524924fa0b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2f94f603-60a1-4239-872d-fd524924fa0b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_ff8cf913-7198-47e1-adda-fe9fff61c36b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] create volume v_ff8cf913-7198-47e1-adda-fe9fff61c36b from snapshot v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97@s_2f94f603-60a1-4239-872d-fd524924fa0b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_2f94f603-60a1-4239-872d-fd524924fa0b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282139', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60074', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3150191267311268604', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '78e34a185398e9a6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763829248', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38060', 'name': 's_2f94f603-60a1-4239-872d-fd524924fa0b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2f94f603-60a1-4239-872d-fd524924fa0b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] delete snapshot s_2f94f603-60a1-4239-872d-fd524924fa0b of volume v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_2f94f603-60a1-4239-872d-fd524924fa0b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_2f94f603-60a1-4239-872d-fd524924fa0b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_a2733057-27d3-4034-9b97-aaa88c74593e@v_ff8cf913-7198-47e1-adda-fe9fff61c36b', 'is_clone': True, 'full_name': 'Pool-0/v_ff8cf913-7198-47e1-adda-fe9fff61c36b', 'name': 'v_ff8cf913-7198-47e1-adda-fe9fff61c36b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] get volume v_ff8cf913-7198-47e1-adda-fe9fff61c36b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:25:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots/s_2f94f603-60a1-4239-872d-fd524924fa0b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] snapshot s_2f94f603-60a1-4239-872d-fd524924fa0b deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:25:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_a2733057-27d3-4034-9b97-aaa88c74593e@v_ff8cf913-7198-47e1-adda-fe9fff61c36b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ff8cf913-7198-47e1-adda-fe9fff61c36b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282165', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '60149', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6948250895300505224', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '50d4aebf354e72ef', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763829248', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37780', 'name': 'v_ff8cf913-7198-47e1-adda-fe9fff61c36b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:49 user cinder-volume[73792]: DEBUG cinder.quota [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Created reservations ['8e6481f7-3f5d-42c4-a468-ccde1985f37f', 'f7f72076-6330-4cd6-b1d8-7c5c412440ce', '650e029e-4407-410f-950f-fa64b4bb72bd', '86b88fd8-452d-4a30-84cb-683f92f2c674'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:49 user cinder-volume[73792]: INFO cinder.volume.manager [None req-69dbe5af-3757-4204-a373-dc3874309067 tempest-GroupsTest-310445197 None] Group tempest-Group1-1445813103: creating
Apr 12 06:25:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6b86f4-ef5c-496f-9402-0387c56685c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8cf913-7198-47e1-adda-fe9fff61c36b', 'volume_size': 1, 'snapshot_id': 'a2733057-27d3-4034-9b97-aaa88c74593e'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d73461-de1b-426c-956c-ef220765bf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:49 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=61,cinder:UPDATE=30,cinder:DELETE=1,cinder:INSERT=8 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:25:49 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Volume volume-ff8cf913-7198-47e1-adda-fe9fff61c36b (ff8cf913-7198-47e1-adda-fe9fff61c36b): created successfully
Apr 12 06:25:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d73461-de1b-426c-956c-ef220765bf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] Flow 'volume_create_manager' (023db559-04e5-4c8e-8326-aae6566e0e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:49 user cinder-volume[73792]: INFO cinder.action_track [None req-4899323d-b836-4502-8a99-70f2451e9a6f tempest-TestStampPattern-1782553765 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-588781848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff8cf913-7198-47e1-adda-fe9fff61c36b,launched_at=2023-04-12T06:25:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP kSFTbZuW TUW7zRdYNlbn4B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:47Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=a2733057-27d3-4034-9b97-aaa88c74593e,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:25:47Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:49 user cinder-volume[73792]: INFO cinder.volume.manager [None req-69dbe5af-3757-4204-a373-dc3874309067 tempest-GroupsTest-310445197 None] Group tempest-Group1-1445813103: created successfully
Apr 12 06:25:49 user cinder-volume[73792]: INFO cinder.volume.manager [None req-69dbe5af-3757-4204-a373-dc3874309067 tempest-GroupsTest-310445197 None] Create group completed successfully.
Apr 12 06:25:49 user cinder-volume[73792]: INFO cinder.volume.manager [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Delete snapshot completed successfully.
Apr 12 06:25:49 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cf9b8f71-ac9d-470c-b8bc-1efcf0f15963 tempest-SnapshotsActionsTest-280375524 None] Lock "cinder-2f94f603-60a1-4239-872d-fd524924fa0b-delete_snapshot" released by "delete_snapshot" :: held 2.359s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Acquiring lock "cinder-2339c95f-8a41-4d6a-87ce-0a2dad7cac97-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Lock "cinder-2339c95f-8a41-4d6a-87ce-0a2dad7cac97-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] remove_export for volume: 2339c95f-8a41-4d6a-87ce-0a2dad7cac97. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-392335257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=2339c95f-8a41-4d6a-87ce-0a2dad7cac97,launched_at=2023-04-12T06:25:21Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='163648de01af4f63ae99b74830e90f00',provider_auth='CHAP owMnuqXe NrFMPq7B9gJkTG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:21Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:25:50Z,updated_at=2023-04-12T06:25:50Z,use_quota=True,user_id='4cd015d7680442619d7cece839dc095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] detach volume v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 from target iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97/luns/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97/luns/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97/luns/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97/luns/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] failed to remove resource iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 because of JDSS resource v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] delete target: iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] delete target iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:50 user cinder-volume[73792]: INFO cinder.volume.manager [None req-538ad244-425e-4b07-b155-6b88e0871350 tempest-GroupsTest-310445197 None] Group tempest-Group2-1217633119: creating
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] failed to remove resource iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 because of JDSS resource iqn.2010-10.org.openstack:2339c95f-8a41-4d6a-87ce-0a2dad7cac97 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] deleating volume v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] get snapshots for volume v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:50 user cinder-volume[73792]: INFO cinder.volume.manager [None req-538ad244-425e-4b07-b155-6b88e0871350 tempest-GroupsTest-310445197 None] Group tempest-Group2-1217633119: created successfully
Apr 12 06:25:50 user cinder-volume[73792]: INFO cinder.volume.manager [None req-538ad244-425e-4b07-b155-6b88e0871350 tempest-GroupsTest-310445197 None] Create group completed successfully.
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] get volume v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282138', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60068', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12769338344864487625', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0a041161719eb554', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763804672', 'san:volume_id': '0a041161719eb5542334d8d5e34fef97630c97e8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38047', 'name': 'v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] delete volume:v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:50 user cinder-volume[73792]: INFO cinder.action_track [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:25:48Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] terminate connection for d96a84d2-2151-4f60-a72b-25e84b80c975  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:25:50 user cinder-volume[73792]: INFO cinder.action_track [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:25:48Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] Deleting attachment 79834751-8c5e-444f-af12-08bbec4e7de5. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] remove_export for volume: d96a84d2-2151-4f60-a72b-25e84b80c975. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:25:48Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] detach volume v_d96a84d2-2151-4f60-a72b-25e84b80c975 from target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:51 user cinder-volume[73792]: INFO cinder.action_track [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2096801596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5c47c346-0066-4374-8bf8-a12e77fa6694,host='user@joviandss-2#joviandss-2',id=7f244dae-f5e8-40e5-83d4-e1924baa66de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a4db314324e988bb9e6868d55f97e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='a8bdcf2bdcea4c31abf0e85212c68bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e7ac9f3-95f4-4adb-a454-0d6e9d8c3117),volume_type_id=6e7ac9f3-95f4-4adb-a454-0d6e9d8c3117) 
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Flow 'volume_create_manager' (195ed590-e9c1-4f07-b0cd-75aab435440e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1546ee6c-64f3-4274-9eea-049036943c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1546ee6c-64f3-4274-9eea-049036943c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2096801596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5c47c346-0066-4374-8bf8-a12e77fa6694,host='user@joviandss-2#joviandss-2',id=7f244dae-f5e8-40e5-83d4-e1924baa66de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a4db314324e988bb9e6868d55f97e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:25:52Z,use_quota=True,user_id='a8bdcf2bdcea4c31abf0e85212c68bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e7ac9f3-95f4-4adb-a454-0d6e9d8c3117),volume_type_id=6e7ac9f3-95f4-4adb-a454-0d6e9d8c3117)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e4a403-b8e9-4974-bc46-0888c9ff5768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e4a403-b8e9-4974-bc46-0888c9ff5768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174b1c3e-889f-4ea4-97ae-a1b179794916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174b1c3e-889f-4ea4-97ae-a1b179794916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f244dae-f5e8-40e5-83d4-e1924baa66de', 'volume_name': 'volume-7f244dae-f5e8-40e5-83d4-e1924baa66de', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4461ed5f-4c41-4f29-a6db-e9aa2ffaa279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4461ed5f-4c41-4f29-a6db-e9aa2ffaa279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ad986b-ded7-4b34-81c9-abff26414d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:51 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Volume 7f244dae-f5e8-40e5-83d4-e1924baa66de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f244dae-f5e8-40e5-83d4-e1924baa66de', 'volume_size': 1}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] creating volume v_7f244dae-f5e8-40e5-83d4-e1924baa66de. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] create volume {'name': 'v_7f244dae-f5e8-40e5-83d4-e1924baa66de', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] volume v_2339c95f-8a41-4d6a-87ce-0a2dad7cac97 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.quota [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Created reservations ['6d515df3-28cc-47da-9ba5-b4ba8c1bdcf1', '63dbb973-f8c1-449c-8c98-27f36d0d2c55', '4b557896-2be5-4dba-9e5e-03aa817acf47', '9d91ec75-eb0e-45da-aff2-c305fc093ce4'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7f244dae-f5e8-40e5-83d4-e1924baa66de', 'is_clone': False, 'name': 'v_7f244dae-f5e8-40e5-83d4-e1924baa66de'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ad986b-ded7-4b34-81c9-abff26414d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f244dae-f5e8-40e5-83d4-e1924baa66de', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cf8af6-d9c3-4bdb-bb83-833be3279876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:52 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Volume volume-7f244dae-f5e8-40e5-83d4-e1924baa66de (7f244dae-f5e8-40e5-83d4-e1924baa66de): created successfully
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cf8af6-d9c3-4bdb-bb83-833be3279876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] Flow 'volume_create_manager' (195ed590-e9c1-4f07-b0cd-75aab435440e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:52 user cinder-volume[73792]: INFO cinder.action_track [None req-a4a5a9d5-05c0-43e4-a54c-f0c8f49f00f5 tempest-GroupsTest-310445197 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2096801596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5c47c346-0066-4374-8bf8-a12e77fa6694,host='user@joviandss-2#joviandss-2',id=7f244dae-f5e8-40e5-83d4-e1924baa66de,launched_at=2023-04-12T06:25:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a4db314324e988bb9e6868d55f97e',provider_auth='CHAP RZgUAHTW kbxlmaTiCfB9uH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:25:52Z,use_quota=True,user_id='a8bdcf2bdcea4c31abf0e85212c68bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e7ac9f3-95f4-4adb-a454-0d6e9d8c3117),volume_type_id=6e7ac9f3-95f4-4adb-a454-0d6e9d8c3117) 
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] delete target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] delete target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763816960', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.manager [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:25:52 user cinder-volume[73792]: INFO cinder.volume.manager [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Deleted volume successfully.
Apr 12 06:25:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ab3daff8-5fe0-4dba-9dda-6df718bae739 tempest-SnapshotsActionsTest-280375524 None] Lock "cinder-2339c95f-8a41-4d6a-87ce-0a2dad7cac97-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-2dd8531b-d6b2-43f0-9561-ff51884e0bd6 tempest-ServerActionsTestJSON-752347644 None] target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] remove_export for volume: 7f244dae-f5e8-40e5-83d4-e1924baa66de. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2096801596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5c47c346-0066-4374-8bf8-a12e77fa6694,host='user@joviandss-2#joviandss-2',id=7f244dae-f5e8-40e5-83d4-e1924baa66de,launched_at=2023-04-12T06:25:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a4db314324e988bb9e6868d55f97e',provider_auth='CHAP RZgUAHTW kbxlmaTiCfB9uH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-12T06:25:53Z,use_quota=True,user_id='a8bdcf2bdcea4c31abf0e85212c68bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e7ac9f3-95f4-4adb-a454-0d6e9d8c3117),volume_type_id=6e7ac9f3-95f4-4adb-a454-0d6e9d8c3117) from target:iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] detach volume v_7f244dae-f5e8-40e5-83d4-e1924baa66de from target iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de/luns/v_7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de/luns/v_7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de/luns/v_7f244dae-f5e8-40e5-83d4-e1924baa66de'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de/luns/v_7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] failed to remove resource iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de because of JDSS resource v_7f244dae-f5e8-40e5-83d4-e1924baa66de DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] delete target: iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] delete target iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] failed to remove resource iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de because of JDSS resource iqn.2010-10.org.openstack:7f244dae-f5e8-40e5-83d4-e1924baa66de DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] deleating volume v_7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] get snapshots for volume v_7f244dae-f5e8-40e5-83d4-e1924baa66de  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7f244dae-f5e8-40e5-83d4-e1924baa66de/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7f244dae-f5e8-40e5-83d4-e1924baa66de/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7f244dae-f5e8-40e5-83d4-e1924baa66de/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] get volume v_7f244dae-f5e8-40e5-83d4-e1924baa66de info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7f244dae-f5e8-40e5-83d4-e1924baa66de', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282169', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60157', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3178837419193116182', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4e12d7cfd439b4f8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763816960', 'san:volume_id': '4e12d7cfd439b4f81039f074d3ca69b16a4b6714', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37798', 'name': 'v_7f244dae-f5e8-40e5-83d4-e1924baa66de', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] delete volume:v_7f244dae-f5e8-40e5-83d4-e1924baa66de recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:54 user cinder-volume[73792]: INFO cinder.action_track [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='reserved',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:53Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:54 user cinder-volume[73792]: INFO cinder.action_track [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='reserved',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:53Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:25:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] create export for volume: d96a84d2-2151-4f60-a72b-25e84b80c975. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:25:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] ensure volume d96a84d2-2151-4f60-a72b-25e84b80c975 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:25:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] check if targe iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:25:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7f244dae-f5e8-40e5-83d4-e1924baa66de {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] volume v_7f244dae-f5e8-40e5-83d4-e1924baa66de deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] create target and attach volume d96a84d2-2151-4f60-a72b-25e84b80c975 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] create target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.quota [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Created reservations ['23b9bf1b-b9ab-4542-8e52-da5dcf8effc3'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:55 user cinder-volume[73792]: WARNING cinder.quota [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-290272754 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-290272754, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:25:55 user cinder-volume[73792]: WARNING cinder.quota [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-290272754 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-290272754, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.quota [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Created reservations ['6567ac48-afea-4a95-8982-579909fd2bc5', 'be2ab74f-98fa-4db1-83cf-cefa15e5b225', '6fc68007-ee14-4eeb-a26e-2ea9513bb682', 'e796a7b6-117c-40c5-8e4a-65f1d82ad57a'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=64,cinder:INSERT=7,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.quota [None req-085748bc-cbb9-49ef-9cc3-9e247cee13a0 tempest-GroupsTest-310445197 None] Created reservations ['49c4fec0-0f07-4de5-8b54-b514f8979771'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-085748bc-cbb9-49ef-9cc3-9e247cee13a0 tempest-GroupsTest-310445197 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-085748bc-cbb9-49ef-9cc3-9e247cee13a0 tempest-GroupsTest-310445197 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-085748bc-cbb9-49ef-9cc3-9e247cee13a0 tempest-GroupsTest-310445197 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-085748bc-cbb9-49ef-9cc3-9e247cee13a0 tempest-GroupsTest-310445197 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-085748bc-cbb9-49ef-9cc3-9e247cee13a0 tempest-GroupsTest-310445197 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763898880', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-085748bc-cbb9-49ef-9cc3-9e247cee13a0 tempest-GroupsTest-310445197 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:25:56 user cinder-volume[73792]: DEBUG cinder.manager [None req-085748bc-cbb9-49ef-9cc3-9e247cee13a0 tempest-GroupsTest-310445197 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:25:56 user cinder-volume[73792]: INFO cinder.volume.manager [None req-085748bc-cbb9-49ef-9cc3-9e247cee13a0 tempest-GroupsTest-310445197 None] Delete group completed successfully.
Apr 12 06:25:57 user cinder-volume[73792]: INFO cinder.volume.manager [None req-33813e73-6c98-4ba3-98e1-3719133eed9f tempest-GroupsTest-310445197 None] Group tempest-GroupsTest-Group-1023000182: creating
Apr 12 06:25:57 user cinder-volume[73792]: INFO cinder.volume.manager [None req-33813e73-6c98-4ba3-98e1-3719133eed9f tempest-GroupsTest-310445197 None] Group tempest-GroupsTest-Group-1023000182: created successfully
Apr 12 06:25:57 user cinder-volume[73792]: INFO cinder.volume.manager [None req-33813e73-6c98-4ba3-98e1-3719133eed9f tempest-GroupsTest-310445197 None] Create group completed successfully.
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] atach volume v_d96a84d2-2151-4f60-a72b-25e84b80c975 to target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763898880', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.manager [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:25:58 user cinder-volume[73792]: INFO cinder.volume.manager [None req-af8f89c8-9fdb-4283-96aa-87ecc3ffcd20 tempest-GroupsTest-310445197 None] Delete group completed successfully.
Apr 12 06:25:58 user cinder-volume[73792]: INFO cinder.action_track [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1737866498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d1a9bff-388a-4c85-86f8-82128c2e4266,host='user@joviandss-2#joviandss-2',id=a38631b9-d123-42e2-878c-135927d4de2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a4db314324e988bb9e6868d55f97e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='a8bdcf2bdcea4c31abf0e85212c68bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26e60237-de0a-4d7d-a175-ba42c012428f),volume_type_id=26e60237-de0a-4d7d-a175-ba42c012428f) 
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Flow 'volume_create_manager' (346f1f92-f00b-44c3-be87-4e61e377e71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e825475-c4cf-4c81-bd86-313e53e2f3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e825475-c4cf-4c81-bd86-313e53e2f3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1737866498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d1a9bff-388a-4c85-86f8-82128c2e4266,host='user@joviandss-2#joviandss-2',id=a38631b9-d123-42e2-878c-135927d4de2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a4db314324e988bb9e6868d55f97e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:25:59Z,use_quota=True,user_id='a8bdcf2bdcea4c31abf0e85212c68bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26e60237-de0a-4d7d-a175-ba42c012428f),volume_type_id=26e60237-de0a-4d7d-a175-ba42c012428f)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a92904-9512-493f-a27b-a145844911bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a92904-9512-493f-a27b-a145844911bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5ea274-3db0-487e-9987-ede8a2aaa5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5ea274-3db0-487e-9987-ede8a2aaa5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a38631b9-d123-42e2-878c-135927d4de2d', 'volume_name': 'volume-a38631b9-d123-42e2-878c-135927d4de2d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad3a5f3-f62f-4ee7-a544-ad32d151e3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad3a5f3-f62f-4ee7-a544-ad32d151e3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:25:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44d870b-7ca7-4df1-b4e6-d276cc582cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:25:59 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Volume a38631b9-d123-42e2-878c-135927d4de2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a38631b9-d123-42e2-878c-135927d4de2d', 'volume_size': 1}
Apr 12 06:25:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] creating volume v_a38631b9-d123-42e2-878c-135927d4de2d. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:25:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] create volume {'name': 'v_a38631b9-d123-42e2-878c-135927d4de2d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:25:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:25:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3830653063646534', 'lun': 0, 'mode': 'wt', 'name': 'v_d96a84d2-2151-4f60-a72b-25e84b80c975', 'prod_id': 'Storage', 'scsi_id': '80e0cde4d5d119c9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] add credentails to target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:26:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a38631b9-d123-42e2-878c-135927d4de2d', 'is_clone': False, 'name': 'v_a38631b9-d123-42e2-878c-135927d4de2d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44d870b-7ca7-4df1-b4e6-d276cc582cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a38631b9-d123-42e2-878c-135927d4de2d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec510031-8bb0-45e5-b970-1e670458def4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:01 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Volume volume-a38631b9-d123-42e2-878c-135927d4de2d (a38631b9-d123-42e2-878c-135927d4de2d): created successfully
Apr 12 06:26:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec510031-8bb0-45e5-b970-1e670458def4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] Flow 'volume_create_manager' (346f1f92-f00b-44c3-be87-4e61e377e71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:26:01 user cinder-volume[73792]: INFO cinder.action_track [None req-235aaa21-eb3f-478e-ba71-c4b331529ce0 tempest-GroupsTest-310445197 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1737866498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d1a9bff-388a-4c85-86f8-82128c2e4266,host='user@joviandss-2#joviandss-2',id=a38631b9-d123-42e2-878c-135927d4de2d,launched_at=2023-04-12T06:26:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a4db314324e988bb9e6868d55f97e',provider_auth='CHAP csaTUItO Na3Oyc8F52LbkG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:59Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:25:59Z,use_quota=True,user_id='a8bdcf2bdcea4c31abf0e85212c68bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26e60237-de0a-4d7d-a175-ba42c012428f),volume_type_id=26e60237-de0a-4d7d-a175-ba42c012428f) 
Apr 12 06:26:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=64,cinder:UPDATE=30,cinder:INSERT=4,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:26:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'name': 'AoTzegHP'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] initialize_connection for d96a84d2-2151-4f60-a72b-25e84b80c975 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:26:02 user cinder-volume[73792]: INFO cinder.action_track [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoTzegHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '14e8b92f-dc90-46e2-bc83-3ab6e56643a2'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='reserved',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:25:53Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:26:02 user cinder-volume[73792]: INFO cinder.action_track [req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 req-d6a14d7e-c7cd-437e-9858-41cc344b6bd0 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:26:02Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:26:02 user cinder-volume[73792]: INFO cinder.action_track [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-819439978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d1a9bff-388a-4c85-86f8-82128c2e4266,host='user@joviandss-2#joviandss-2',id=82c7a1fe-92f1-4305-bf5d-7a3023816b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a4db314324e988bb9e6868d55f97e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='a8bdcf2bdcea4c31abf0e85212c68bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26e60237-de0a-4d7d-a175-ba42c012428f),volume_type_id=26e60237-de0a-4d7d-a175-ba42c012428f) 
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Flow 'volume_create_manager' (5af67a2d-70e5-4fdd-b59e-b4367bce8430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498b56e2-9161-4b9b-b1b2-bb247db14bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498b56e2-9161-4b9b-b1b2-bb247db14bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-819439978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d1a9bff-388a-4c85-86f8-82128c2e4266,host='user@joviandss-2#joviandss-2',id=82c7a1fe-92f1-4305-bf5d-7a3023816b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a4db314324e988bb9e6868d55f97e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:26:03Z,use_quota=True,user_id='a8bdcf2bdcea4c31abf0e85212c68bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26e60237-de0a-4d7d-a175-ba42c012428f),volume_type_id=26e60237-de0a-4d7d-a175-ba42c012428f)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef6ee5c-4ac2-4b8a-88ba-0ba1542f8b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef6ee5c-4ac2-4b8a-88ba-0ba1542f8b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa40890-06b8-4c4b-824f-d41d13262453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa40890-06b8-4c4b-824f-d41d13262453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82c7a1fe-92f1-4305-bf5d-7a3023816b80', 'volume_name': 'volume-82c7a1fe-92f1-4305-bf5d-7a3023816b80', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6b63c4-4d64-496f-b733-0d545a44cb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6b63c4-4d64-496f-b733-0d545a44cb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3e55c1-9ed8-4cb8-b4d9-a569186af779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:02 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Volume 82c7a1fe-92f1-4305-bf5d-7a3023816b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82c7a1fe-92f1-4305-bf5d-7a3023816b80', 'volume_size': 1}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] creating volume v_82c7a1fe-92f1-4305-bf5d-7a3023816b80. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] create volume {'name': 'v_82c7a1fe-92f1-4305-bf5d-7a3023816b80', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Acquiring lock "cinder-d2470870-a46d-44c2-98dc-448e98ab0866-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:26:02 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Lock "cinder-d2470870-a46d-44c2-98dc-448e98ab0866-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] remove_export for volume: d2470870-a46d-44c2-98dc-448e98ab0866. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1995203384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d2470870-a46d-44c2-98dc-448e98ab0866,launched_at=2023-04-12T06:22:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d2a1b102d54e8194741137e193436f',provider_auth='CHAP cDzhwJUi Qx3CKFLliXdOGU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:26:03Z,updated_at=2023-04-12T06:26:03Z,use_quota=True,user_id='896e1c5d0edd4a1d9d122115f02dfef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] detach volume v_d2470870-a46d-44c2-98dc-448e98ab0866 from target iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/luns/v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/luns/v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80', 'is_clone': False, 'name': 'v_82c7a1fe-92f1-4305-bf5d-7a3023816b80'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3e55c1-9ed8-4cb8-b4d9-a569186af779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c7a1fe-92f1-4305-bf5d-7a3023816b80', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4180c7f-0d90-4c04-a9f2-7dc8ad5a9d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/luns/v_d2470870-a46d-44c2-98dc-448e98ab0866'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866/luns/v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] failed to remove resource iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 because of JDSS resource v_d2470870-a46d-44c2-98dc-448e98ab0866 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] delete target: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] delete target iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:03 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Volume volume-82c7a1fe-92f1-4305-bf5d-7a3023816b80 (82c7a1fe-92f1-4305-bf5d-7a3023816b80): created successfully
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4180c7f-0d90-4c04-a9f2-7dc8ad5a9d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] Flow 'volume_create_manager' (5af67a2d-70e5-4fdd-b59e-b4367bce8430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] failed to remove resource iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 because of JDSS resource iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] deleating volume v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] get snapshots for volume v_d2470870-a46d-44c2-98dc-448e98ab0866  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d2470870-a46d-44c2-98dc-448e98ab0866/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d2470870-a46d-44c2-98dc-448e98ab0866/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:03 user cinder-volume[73792]: INFO cinder.action_track [None req-09e2ee17-0061-41d3-af0d-65e98edeb6e4 tempest-GroupsTest-310445197 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-819439978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d1a9bff-388a-4c85-86f8-82128c2e4266,host='user@joviandss-2#joviandss-2',id=82c7a1fe-92f1-4305-bf5d-7a3023816b80,launched_at=2023-04-12T06:26:03Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a4db314324e988bb9e6868d55f97e',provider_auth='CHAP zLUBYAGg HP1mOTv2GULnf9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:26:03Z,use_quota=True,user_id='a8bdcf2bdcea4c31abf0e85212c68bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26e60237-de0a-4d7d-a175-ba42c012428f),volume_type_id=26e60237-de0a-4d7d-a175-ba42c012428f) 
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d2470870-a46d-44c2-98dc-448e98ab0866/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] get volume v_d2470870-a46d-44c2-98dc-448e98ab0866 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d2470870-a46d-44c2-98dc-448e98ab0866', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281945', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59750', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7474250226151290288', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2b98c0cdee985905', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753593344', 'san:volume_id': '2b98c0cdee9859059f35f629326f032ca9080921', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36446', 'name': 'v_d2470870-a46d-44c2-98dc-448e98ab0866', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] delete volume:v_d2470870-a46d-44c2-98dc-448e98ab0866 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:03 user cinder-volume[73792]: INFO cinder.volume.manager [None req-f091a115-9120-482e-98b7-181d4c52f73a tempest-GroupsTest-310445197 None] Update group completed successfully.
Apr 12 06:26:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d2470870-a46d-44c2-98dc-448e98ab0866 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] volume v_d2470870-a46d-44c2-98dc-448e98ab0866 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:26:04 user cinder-volume[73792]: DEBUG cinder.quota [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Created reservations ['62fcbe75-a84a-4b4a-a81e-2763d31340cc', '8efb05ef-d078-4dbb-b46f-753e22d8be49', '5304aaec-873d-4c2c-99f3-43e306e6bc3b', '332b9684-f67a-43b9-865c-07636ef398f0'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:26:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:26:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:26:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:05 user cinder-volume[73792]: INFO cinder.volume.manager [None req-d087ec12-53d6-475e-a971-72ee1958bac9 tempest-GroupsTest-310445197 None] Update group completed successfully.
Apr 12 06:26:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753593344', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:26:05 user cinder-volume[73792]: DEBUG cinder.manager [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:26:05 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Deleted volume successfully.
Apr 12 06:26:05 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a59752db-5ce9-4bd2-8b08-d6c6b718c12a tempest-TaggedAttachmentsTest-1179204824 None] Lock "cinder-d2470870-a46d-44c2-98dc-448e98ab0866-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] remove_export for volume: 82c7a1fe-92f1-4305-bf5d-7a3023816b80. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-819439978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d1a9bff-388a-4c85-86f8-82128c2e4266,host='user@joviandss-2#joviandss-2',id=82c7a1fe-92f1-4305-bf5d-7a3023816b80,launched_at=2023-04-12T06:26:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a4db314324e988bb9e6868d55f97e',provider_auth='CHAP zLUBYAGg HP1mOTv2GULnf9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-12T06:26:07Z,use_quota=True,user_id='a8bdcf2bdcea4c31abf0e85212c68bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26e60237-de0a-4d7d-a175-ba42c012428f),volume_type_id=26e60237-de0a-4d7d-a175-ba42c012428f) from target:iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] detach volume v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 from target iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80/luns/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80/luns/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80/luns/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80/luns/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] failed to remove resource iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 because of JDSS resource v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] delete target: iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] delete target iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] failed to remove resource iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 because of JDSS resource iqn.2010-10.org.openstack:82c7a1fe-92f1-4305-bf5d-7a3023816b80 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] deleating volume v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] get snapshots for volume v_82c7a1fe-92f1-4305-bf5d-7a3023816b80  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] get volume v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:26:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282180', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60172', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4646761138831853402', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '653b2b2d0738a6f0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753593344', 'san:volume_id': '653b2b2d0738a6f0e15d463e9fa0393b7eef3e90', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37667', 'name': 'v_82c7a1fe-92f1-4305-bf5d-7a3023816b80', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] delete volume:v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:26:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] volume v_82c7a1fe-92f1-4305-bf5d-7a3023816b80 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] remove_export for volume: a38631b9-d123-42e2-878c-135927d4de2d. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1737866498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d1a9bff-388a-4c85-86f8-82128c2e4266,host='user@joviandss-2#joviandss-2',id=a38631b9-d123-42e2-878c-135927d4de2d,launched_at=2023-04-12T06:26:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a4db314324e988bb9e6868d55f97e',provider_auth='CHAP csaTUItO Na3Oyc8F52LbkG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:59Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-12T06:26:07Z,use_quota=True,user_id='a8bdcf2bdcea4c31abf0e85212c68bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26e60237-de0a-4d7d-a175-ba42c012428f),volume_type_id=26e60237-de0a-4d7d-a175-ba42c012428f) from target:iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] detach volume v_a38631b9-d123-42e2-878c-135927d4de2d from target iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d/luns/v_a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d/luns/v_a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d/luns/v_a38631b9-d123-42e2-878c-135927d4de2d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d/luns/v_a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] failed to remove resource iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d because of JDSS resource v_a38631b9-d123-42e2-878c-135927d4de2d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] delete target: iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] delete target iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] failed to remove resource iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d because of JDSS resource iqn.2010-10.org.openstack:a38631b9-d123-42e2-878c-135927d4de2d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] deleating volume v_a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] get snapshots for volume v_a38631b9-d123-42e2-878c-135927d4de2d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a38631b9-d123-42e2-878c-135927d4de2d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a38631b9-d123-42e2-878c-135927d4de2d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a38631b9-d123-42e2-878c-135927d4de2d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] get volume v_a38631b9-d123-42e2-878c-135927d4de2d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a38631b9-d123-42e2-878c-135927d4de2d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282178', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60168', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6886263301620491217', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2a7544df8906cab6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753675264', 'san:volume_id': '2a7544df8906cab646f9e33f60ffc33fb86d1554', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36574', 'name': 'v_a38631b9-d123-42e2-878c-135927d4de2d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] delete volume:v_a38631b9-d123-42e2-878c-135927d4de2d recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a38631b9-d123-42e2-878c-135927d4de2d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] volume v_a38631b9-d123-42e2-878c-135927d4de2d deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:26:10 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=29,cinder:SELECT=65,cinder:INSERT=4,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:26:10 user cinder-volume[73792]: DEBUG cinder.quota [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Created reservations ['fe3e0b72-011b-4b25-a74e-613de5145ebf'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:26:10 user cinder-volume[73792]: WARNING cinder.quota [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-808354003 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-808354003, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:26:10 user cinder-volume[73792]: WARNING cinder.quota [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-808354003 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-808354003, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:26:10 user cinder-volume[73792]: DEBUG cinder.quota [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Created reservations ['e4be5118-a3dd-4e50-bfa6-b4fcccbad78a', '91e7a20e-d1e9-45de-8e56-95b62ea33506', '210f9a67-56ca-4f57-89d4-07360131ab6e', '6c604f4d-3c23-490d-ad55-998ef82b01ad'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:26:10 user cinder-volume[73792]: DEBUG cinder.quota [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Created reservations ['fb988b69-2251-406a-b72e-f00ebf34767c', 'e166e987-9b17-457c-9773-391270b6a4f6', '34f6c9a6-d506-41f7-8cb2-39f194de9f08', '5df31942-8883-4e30-a891-bac3caf4b2b2'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:26:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:26:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:26:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753765376', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:26:10 user cinder-volume[73792]: DEBUG cinder.manager [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:26:10 user cinder-volume[73792]: INFO cinder.volume.manager [None req-33c0e5c0-8882-4d06-82ec-c5bc38b6b14a tempest-GroupsTest-310445197 None] Delete group completed successfully.
Apr 12 06:26:16 user cinder-volume[73792]: INFO cinder.action_track [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-502673102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fb64808b-178a-496b-bf80-868be41d9438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543fc2dfc2e5430db792d903229f434d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='e608e266b04042e185834bad5cbe70c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9a951e3-1663-45f0-addb-113d4e847c39),volume_type_id=e9a951e3-1663-45f0-addb-113d4e847c39) 
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=65,cinder:UPDATE=28,cinder:DELETE=1,cinder:INSERT=6 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Flow 'volume_create_manager' (8a2048e5-9a9f-4ae7-9d33-8f3feb523e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61de1e26-7b33-494f-8068-ed7d442be09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61de1e26-7b33-494f-8068-ed7d442be09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-502673102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fb64808b-178a-496b-bf80-868be41d9438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543fc2dfc2e5430db792d903229f434d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:26:16Z,use_quota=True,user_id='e608e266b04042e185834bad5cbe70c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9a951e3-1663-45f0-addb-113d4e847c39),volume_type_id=e9a951e3-1663-45f0-addb-113d4e847c39)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf5fd24-d0d9-4cfe-a0dd-1ab93a8ead2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf5fd24-d0d9-4cfe-a0dd-1ab93a8ead2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519ef607-7aad-4243-802c-90f45d03f129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519ef607-7aad-4243-802c-90f45d03f129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb64808b-178a-496b-bf80-868be41d9438', 'volume_name': 'volume-fb64808b-178a-496b-bf80-868be41d9438', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3381560-330b-4462-8dc2-7a906b792613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3381560-330b-4462-8dc2-7a906b792613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01378c6-2923-4c12-b932-858418bb9036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:16 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Volume fb64808b-178a-496b-bf80-868be41d9438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb64808b-178a-496b-bf80-868be41d9438', 'volume_size': 1}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] creating volume v_fb64808b-178a-496b-bf80-868be41d9438. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] create volume {'name': 'v_fb64808b-178a-496b-bf80-868be41d9438', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_fb64808b-178a-496b-bf80-868be41d9438', 'is_clone': False, 'name': 'v_fb64808b-178a-496b-bf80-868be41d9438'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01378c6-2923-4c12-b932-858418bb9036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb64808b-178a-496b-bf80-868be41d9438', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01db54e3-9de8-4573-903a-ee1e3ffc1d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:17 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Volume volume-fb64808b-178a-496b-bf80-868be41d9438 (fb64808b-178a-496b-bf80-868be41d9438): created successfully
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01db54e3-9de8-4573-903a-ee1e3ffc1d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] Flow 'volume_create_manager' (8a2048e5-9a9f-4ae7-9d33-8f3feb523e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:26:17 user cinder-volume[73792]: INFO cinder.action_track [None req-1d134cc2-2983-4796-aafc-727f34ab4715 tempest-VolumeTypesAccessTest-1964189374 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-502673102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fb64808b-178a-496b-bf80-868be41d9438,launched_at=2023-04-12T06:26:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543fc2dfc2e5430db792d903229f434d',provider_auth='CHAP JiBhvIVE iCUoerQ7AwnpvH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:16Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:26:16Z,use_quota=True,user_id='e608e266b04042e185834bad5cbe70c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9a951e3-1663-45f0-addb-113d4e847c39),volume_type_id=e9a951e3-1663-45f0-addb-113d4e847c39) 
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Acquiring lock "cinder-fb64808b-178a-496b-bf80-868be41d9438-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Lock "cinder-fb64808b-178a-496b-bf80-868be41d9438-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] remove_export for volume: fb64808b-178a-496b-bf80-868be41d9438. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-502673102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fb64808b-178a-496b-bf80-868be41d9438,launched_at=2023-04-12T06:26:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543fc2dfc2e5430db792d903229f434d',provider_auth='CHAP JiBhvIVE iCUoerQ7AwnpvH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:16Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:26:17Z,updated_at=2023-04-12T06:26:17Z,use_quota=True,user_id='e608e266b04042e185834bad5cbe70c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9a951e3-1663-45f0-addb-113d4e847c39),volume_type_id=e9a951e3-1663-45f0-addb-113d4e847c39) from target:iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] detach volume v_fb64808b-178a-496b-bf80-868be41d9438 from target iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438/luns/v_fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438/luns/v_fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438/luns/v_fb64808b-178a-496b-bf80-868be41d9438'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438/luns/v_fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] failed to remove resource iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 because of JDSS resource v_fb64808b-178a-496b-bf80-868be41d9438 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] delete target: iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] delete target iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] failed to remove resource iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 because of JDSS resource iqn.2010-10.org.openstack:fb64808b-178a-496b-bf80-868be41d9438 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] deleating volume v_fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] get snapshots for volume v_fb64808b-178a-496b-bf80-868be41d9438  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fb64808b-178a-496b-bf80-868be41d9438/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fb64808b-178a-496b-bf80-868be41d9438/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fb64808b-178a-496b-bf80-868be41d9438/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] get volume v_fb64808b-178a-496b-bf80-868be41d9438 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fb64808b-178a-496b-bf80-868be41d9438', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282194', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60180', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18289998682131561854', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '23a8896b1a7a1c86', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753695744', 'san:volume_id': '23a8896b1a7a1c866a71750df7f7389bf4119797', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37680', 'name': 'v_fb64808b-178a-496b-bf80-868be41d9438', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] delete volume:v_fb64808b-178a-496b-bf80-868be41d9438 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fb64808b-178a-496b-bf80-868be41d9438 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] volume v_fb64808b-178a-496b-bf80-868be41d9438 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:26:18 user cinder-volume[73792]: WARNING cinder.quota [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1855482143 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1855482143, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:26:18 user cinder-volume[73792]: WARNING cinder.quota [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1855482143 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1855482143, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:26:19 user cinder-volume[73792]: DEBUG cinder.quota [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Created reservations ['c564cb83-e648-4036-b517-afde965cbe27', '340a5609-8ed1-43ee-a212-29658818da39', '2c1f1ed1-25dd-4767-9117-40cb2dbd32aa', 'c337d370-f650-4b52-bbd8-f88481150b5d'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:26:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:26:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:26:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753777664', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:26:19 user cinder-volume[73792]: DEBUG cinder.manager [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:26:19 user cinder-volume[73792]: INFO cinder.volume.manager [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Deleted volume successfully.
Apr 12 06:26:19 user cinder-volume[73792]: DEBUG cinder.coordination [None req-495b55bd-a283-4ac7-b3eb-daeb4bd22467 tempest-VolumeTypesAccessTest-1964189374 None] Lock "cinder-fb64808b-178a-496b-bf80-868be41d9438-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Acquiring lock "cinder-a0819b26-7af7-426a-8242-84954c0851f5-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Lock "cinder-a0819b26-7af7-426a-8242-84954c0851f5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] remove_export for volume: a0819b26-7af7-426a-8242-84954c0851f5. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-2016549375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a0819b26-7af7-426a-8242-84954c0851f5,launched_at=2023-04-12T06:22:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP uYNAnVgZ w1iTt2v9XKO8Dd',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:26:25Z,updated_at=2023-04-12T06:26:25Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] detach volume v_a0819b26-7af7-426a-8242-84954c0851f5 from target iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/luns/v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/luns/v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/luns/v_a0819b26-7af7-426a-8242-84954c0851f5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5/luns/v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] failed to remove resource iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 because of JDSS resource v_a0819b26-7af7-426a-8242-84954c0851f5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] delete target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] delete target iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] failed to remove resource iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 because of JDSS resource iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] deleating volume v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] get snapshots for volume v_a0819b26-7af7-426a-8242-84954c0851f5  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0819b26-7af7-426a-8242-84954c0851f5/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0819b26-7af7-426a-8242-84954c0851f5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0819b26-7af7-426a-8242-84954c0851f5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] get volume v_a0819b26-7af7-426a-8242-84954c0851f5 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:26:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a0819b26-7af7-426a-8242-84954c0851f5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281950', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59773', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14687322374092838725', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3f5d10aa20534d95', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753777664', 'san:volume_id': '3f5d10aa20534d9585a96e228be670749cc9583a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37397', 'name': 'v_a0819b26-7af7-426a-8242-84954c0851f5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] delete volume:v_a0819b26-7af7-426a-8242-84954c0851f5 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:26:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:26 user cinder-volume[73792]: INFO cinder.action_track [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-127636032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ecae8a11-08d5-44a1-aeef-d8fe36208e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715503b70a204bac9ec7cacbe8c13eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='2cc0a6e2ddf242da80302be4f1ab5542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Flow 'volume_create_manager' (c08fb858-cef7-41d4-872c-307fe78b928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee736f4-272d-4471-bf19-5c0be40c44a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee736f4-272d-4471-bf19-5c0be40c44a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-127636032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ecae8a11-08d5-44a1-aeef-d8fe36208e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715503b70a204bac9ec7cacbe8c13eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:26:26Z,use_quota=True,user_id='2cc0a6e2ddf242da80302be4f1ab5542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d238cf-fce3-44c8-8484-6d07f09600cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d238cf-fce3-44c8-8484-6d07f09600cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8bfddf-35f1-4920-bce3-9b45d53d1afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8bfddf-35f1-4920-bce3-9b45d53d1afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecae8a11-08d5-44a1-aeef-d8fe36208e70', 'volume_name': 'volume-ecae8a11-08d5-44a1-aeef-d8fe36208e70', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f0f2a6-7218-4dcf-884e-dde965a82abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f0f2a6-7218-4dcf-884e-dde965a82abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77dc93d-b3da-4c8d-b456-f4e3094cd244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:26 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Volume ecae8a11-08d5-44a1-aeef-d8fe36208e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecae8a11-08d5-44a1-aeef-d8fe36208e70', 'volume_size': 1}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] creating volume v_ecae8a11-08d5-44a1-aeef-d8fe36208e70. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] create volume {'name': 'v_ecae8a11-08d5-44a1-aeef-d8fe36208e70', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] volume v_a0819b26-7af7-426a-8242-84954c0851f5 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.quota [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Created reservations ['7f667507-85c7-4690-95cc-f5d8f70bb660', 'eefeb7ee-6522-48df-879b-8e213e3e9af8', '38397d7d-ba2b-4fe4-bd22-8ef930dfd77e', '9a154cd9-84b6-498a-8ca2-0f4c5af55e65'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=55,cinder:INSERT=8,cinder:UPDATE=36,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Acquiring lock "cinder-1872667c-83a2-4de7-a347-cc3fd70bf901-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:26:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Lock "cinder-1872667c-83a2-4de7-a347-cc3fd70bf901-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70', 'is_clone': False, 'name': 'v_ecae8a11-08d5-44a1-aeef-d8fe36208e70'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77dc93d-b3da-4c8d-b456-f4e3094cd244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecae8a11-08d5-44a1-aeef-d8fe36208e70', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82547af1-4fd6-4eab-a7a3-3b3c5a7498e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:27 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Volume volume-ecae8a11-08d5-44a1-aeef-d8fe36208e70 (ecae8a11-08d5-44a1-aeef-d8fe36208e70): created successfully
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82547af1-4fd6-4eab-a7a3-3b3c5a7498e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] Flow 'volume_create_manager' (c08fb858-cef7-41d4-872c-307fe78b928e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:26:27 user cinder-volume[73792]: INFO cinder.action_track [None req-506c155b-62f5-4767-a827-826411eb28b5 tempest-VolumesTransfersV355Test-121613893 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-127636032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ecae8a11-08d5-44a1-aeef-d8fe36208e70,launched_at=2023-04-12T06:26:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715503b70a204bac9ec7cacbe8c13eeb',provider_auth='CHAP LFuPmRxl h2vJkbMwAY97yg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:26Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:26:26Z,use_quota=True,user_id='2cc0a6e2ddf242da80302be4f1ab5542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] remove_export for volume: 1872667c-83a2-4de7-a347-cc3fd70bf901. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1391192474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1872667c-83a2-4de7-a347-cc3fd70bf901,launched_at=2023-04-12T06:22:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a846b9e34aada0c72df46d47b77d',provider_auth='CHAP HXLxNfBv axhoiYcwrNkFD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:26:27Z,updated_at=2023-04-12T06:26:27Z,use_quota=True,user_id='f053ed1c99c0480c9d1b0bc466e49e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] detach volume v_1872667c-83a2-4de7-a347-cc3fd70bf901 from target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753777664', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.manager [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:26:27 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Deleted volume successfully.
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0981e104-b689-4268-92d7-58ad92e031ab tempest-TestVolumeSwap-1856443697 None] Lock "cinder-a0819b26-7af7-426a-8242-84954c0851f5-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns/v_1872667c-83a2-4de7-a347-cc3fd70bf901'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901/luns/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] failed to remove resource iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 because of JDSS resource v_1872667c-83a2-4de7-a347-cc3fd70bf901 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] delete target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] delete target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] failed to remove resource iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 because of JDSS resource iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] deleating volume v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] get snapshots for volume v_1872667c-83a2-4de7-a347-cc3fd70bf901  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1872667c-83a2-4de7-a347-cc3fd70bf901/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1872667c-83a2-4de7-a347-cc3fd70bf901/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1872667c-83a2-4de7-a347-cc3fd70bf901/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] get volume v_1872667c-83a2-4de7-a347-cc3fd70bf901 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1872667c-83a2-4de7-a347-cc3fd70bf901', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281947', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59764', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '886046709404481100', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3bb955d72e5b826a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753777664', 'san:volume_id': '3bb955d72e5b826a090d44aaf87dbac2e496a071', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37377', 'name': 'v_1872667c-83a2-4de7-a347-cc3fd70bf901', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] delete volume:v_1872667c-83a2-4de7-a347-cc3fd70bf901 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:27 user cinder-volume[73792]: INFO cinder.volume.manager [None req-d710b84a-7c69-4681-9749-73f12ef5666e tempest-VolumesTransfersV355Test-1860734917 None] Transfer volume completed successfully.
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Acquiring lock "cinder-ecae8a11-08d5-44a1-aeef-d8fe36208e70-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Lock "cinder-ecae8a11-08d5-44a1-aeef-d8fe36208e70-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] remove_export for volume: ecae8a11-08d5-44a1-aeef-d8fe36208e70. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-127636032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ecae8a11-08d5-44a1-aeef-d8fe36208e70,launched_at=2023-04-12T06:26:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4541bc556c4c4423a94dad76534b9533',provider_auth='CHAP LFuPmRxl h2vJkbMwAY97yg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:26Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:26:28Z,updated_at=2023-04-12T06:26:28Z,use_quota=True,user_id='cbe07bc63abb45be9f3020681cbe8043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] detach volume v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 from target iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70/luns/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70/luns/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] volume v_1872667c-83a2-4de7-a347-cc3fd70bf901 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70/luns/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70/luns/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] failed to remove resource iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 because of JDSS resource v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] delete target: iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] delete target iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.quota [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Created reservations ['d9c17586-1703-4213-8e0c-fc9a137dc6f6', '8c1d8c6b-b379-4373-b238-32a7dbbad0da', 'f2a2de4b-a7fa-45df-ae45-2e22836f3512', '105a31de-bb13-4110-8a32-bcddb9d5ddf0'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] failed to remove resource iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 because of JDSS resource iqn.2010-10.org.openstack:ecae8a11-08d5-44a1-aeef-d8fe36208e70 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] deleating volume v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] get snapshots for volume v_ecae8a11-08d5-44a1-aeef-d8fe36208e70  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] get volume v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753884160', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.manager [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:26:29 user cinder-volume[73792]: INFO cinder.volume.manager [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Deleted volume successfully.
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282204', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60187', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9658150625324015769', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4db362f3c9886f4c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753884160', 'san:volume_id': '4db362f3c9886f4c58ac27e84435a5c4e180287e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38108', 'name': 'v_ecae8a11-08d5-44a1-aeef-d8fe36208e70', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] delete volume:v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:29 user cinder-volume[73792]: DEBUG cinder.coordination [None req-31be729f-15c8-42ed-a486-f3be3801dba3 tempest-TestVolumeSwap-1856443697 None] Lock "cinder-1872667c-83a2-4de7-a347-cc3fd70bf901-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:26:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:26:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:26:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:26:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] volume v_ecae8a11-08d5-44a1-aeef-d8fe36208e70 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:26:30 user cinder-volume[73792]: DEBUG cinder.quota [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Created reservations ['304e10f1-31b3-487e-9ca8-6042efe7aed1', '4d7af29e-c743-475d-9241-df3eae57b5cf', '6a6d75b3-9152-4961-91e8-0e36122a1e1e', 'f3933960-ec30-4c17-8427-fa0787b8af41'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:26:30 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=32,cinder:SELECT=58,cinder:DELETE=2,cinder:INSERT=8 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:26:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:26:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:26:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753966080', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:26:31 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:26:31 user cinder-volume[73792]: INFO cinder.action_track [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2007454775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f834e51b-8a4c-49c3-a8eb-5fed00ae50df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715503b70a204bac9ec7cacbe8c13eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='2cc0a6e2ddf242da80302be4f1ab5542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:26:31 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Flow 'volume_create_manager' (513f170e-cf82-4268-aed6-a2c4333e2e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775a2663-4bc3-4ebe-8e55-20f30ab8be6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753966080', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.manager [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:26:32 user cinder-volume[73792]: INFO cinder.volume.manager [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Deleted volume successfully.
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775a2663-4bc3-4ebe-8e55-20f30ab8be6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2007454775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f834e51b-8a4c-49c3-a8eb-5fed00ae50df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715503b70a204bac9ec7cacbe8c13eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:26:32Z,use_quota=True,user_id='2cc0a6e2ddf242da80302be4f1ab5542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e139231d-fe06-4c36-b0d5-a2ade45f8c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e139231d-fe06-4c36-b0d5-a2ade45f8c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623017f3-c3cf-4093-84e2-96a3d702445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623017f3-c3cf-4093-84e2-96a3d702445f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f834e51b-8a4c-49c3-a8eb-5fed00ae50df', 'volume_name': 'volume-f834e51b-8a4c-49c3-a8eb-5fed00ae50df', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8ba8ab-08c9-4a6c-8cee-dbe34a85a29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8ba8ab-08c9-4a6c-8cee-dbe34a85a29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37085b75-f14e-4824-9903-0ec9c4e26b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:32 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Volume f834e51b-8a4c-49c3-a8eb-5fed00ae50df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f834e51b-8a4c-49c3-a8eb-5fed00ae50df', 'volume_size': 1}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] creating volume v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] create volume {'name': 'v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4d7cf213-779b-48ba-bdfb-55d538bc4145 tempest-VolumesTransfersV355Test-1947492227 None] Lock "cinder-ecae8a11-08d5-44a1-aeef-d8fe36208e70-delete_volume" released by "delete_volume" :: held 3.833s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df', 'is_clone': False, 'name': 'v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37085b75-f14e-4824-9903-0ec9c4e26b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f834e51b-8a4c-49c3-a8eb-5fed00ae50df', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ab8fc0-ba94-4a3c-a448-983f4510beb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:32 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Volume volume-f834e51b-8a4c-49c3-a8eb-5fed00ae50df (f834e51b-8a4c-49c3-a8eb-5fed00ae50df): created successfully
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ab8fc0-ba94-4a3c-a448-983f4510beb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] Flow 'volume_create_manager' (513f170e-cf82-4268-aed6-a2c4333e2e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:26:32 user cinder-volume[73792]: INFO cinder.action_track [None req-1762d04e-c38b-4eba-8daa-792c269dce9c tempest-VolumesTransfersV355Test-121613893 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2007454775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f834e51b-8a4c-49c3-a8eb-5fed00ae50df,launched_at=2023-04-12T06:26:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715503b70a204bac9ec7cacbe8c13eeb',provider_auth='CHAP GVPgnHQo zDpcVBkjr1CFgQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:26:32Z,use_quota=True,user_id='2cc0a6e2ddf242da80302be4f1ab5542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Acquiring lock "cinder-f834e51b-8a4c-49c3-a8eb-5fed00ae50df-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Lock "cinder-f834e51b-8a4c-49c3-a8eb-5fed00ae50df-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] remove_export for volume: f834e51b-8a4c-49c3-a8eb-5fed00ae50df. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2007454775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f834e51b-8a4c-49c3-a8eb-5fed00ae50df,launched_at=2023-04-12T06:26:33Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715503b70a204bac9ec7cacbe8c13eeb',provider_auth='CHAP GVPgnHQo zDpcVBkjr1CFgQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:26:33Z,updated_at=2023-04-12T06:26:33Z,use_quota=True,user_id='2cc0a6e2ddf242da80302be4f1ab5542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] detach volume v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df from target iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df/luns/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df/luns/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df/luns/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df/luns/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] failed to remove resource iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df because of JDSS resource v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] delete target: iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] delete target iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] failed to remove resource iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df because of JDSS resource iqn.2010-10.org.openstack:f834e51b-8a4c-49c3-a8eb-5fed00ae50df DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] deleating volume v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] get snapshots for volume v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] get volume v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282209', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60193', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2381379603213284377', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7adeb1bb022e456c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753884160', 'san:volume_id': '7adeb1bb022e456c46fe383dbe284c0aa424de41', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38119', 'name': 'v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] delete volume:v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] volume v_f834e51b-8a4c-49c3-a8eb-5fed00ae50df deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:26:34 user cinder-volume[73792]: DEBUG cinder.quota [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Created reservations ['e3b553c5-0079-4025-b346-0e0c3290c3ff', '4a078635-5ba5-4a91-b43e-00cc19dde33a', '7ea30d6b-845e-4f35-adb9-0e8358eb0eab', '696f3d1f-1d01-4ec3-829f-5754baf6fbb1'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:26:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:26:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:26:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753978368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:26:35 user cinder-volume[73792]: DEBUG cinder.manager [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:26:35 user cinder-volume[73792]: INFO cinder.volume.manager [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Deleted volume successfully.
Apr 12 06:26:35 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4645bc52-b697-4226-9d47-4f787ebaaf5f tempest-VolumesTransfersV355Test-1947492227 None] Lock "cinder-f834e51b-8a4c-49c3-a8eb-5fed00ae50df-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:26:39 user cinder-volume[73792]: INFO cinder.action_track [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1081160982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5c92b72c-025b-4acf-91e7-8ac77122dfd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b37a01c134d4ff4a674f7c4e5929c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='81e8ef88c79d49d1aee289a3295b6d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Flow 'volume_create_manager' (5bacafe6-2191-4573-9949-275df7fa626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a7c075-36d0-4f1c-a0aa-7ebcfbfc48ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a7c075-36d0-4f1c-a0aa-7ebcfbfc48ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1081160982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5c92b72c-025b-4acf-91e7-8ac77122dfd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b37a01c134d4ff4a674f7c4e5929c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:26:40Z,use_quota=True,user_id='81e8ef88c79d49d1aee289a3295b6d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93379153-ef3c-43f8-be07-96255918f4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93379153-ef3c-43f8-be07-96255918f4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0644709a-5a74-40cd-8bf6-432128756250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0644709a-5a74-40cd-8bf6-432128756250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c92b72c-025b-4acf-91e7-8ac77122dfd4', 'volume_name': 'volume-5c92b72c-025b-4acf-91e7-8ac77122dfd4', 'volume_size': 2}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76652f6b-8c58-470d-909f-d54d4673856d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76652f6b-8c58-470d-909f-d54d4673856d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ba5a20-f718-4aa7-8f17-0ebeb9683b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:39 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Volume 5c92b72c-025b-4acf-91e7-8ac77122dfd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c92b72c-025b-4acf-91e7-8ac77122dfd4', 'volume_size': 2}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] creating volume v_5c92b72c-025b-4acf-91e7-8ac77122dfd4. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] create volume {'name': 'v_5c92b72c-025b-4acf-91e7-8ac77122dfd4', 'size': '2147483648', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4', 'is_clone': False, 'name': 'v_5c92b72c-025b-4acf-91e7-8ac77122dfd4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ba5a20-f718-4aa7-8f17-0ebeb9683b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c92b72c-025b-4acf-91e7-8ac77122dfd4', 'volume_size': 2}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eed20bb-e994-4949-911b-17cffc1d0e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:26:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Volume volume-5c92b72c-025b-4acf-91e7-8ac77122dfd4 (5c92b72c-025b-4acf-91e7-8ac77122dfd4): created successfully
Apr 12 06:26:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eed20bb-e994-4949-911b-17cffc1d0e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:26:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Flow 'volume_create_manager' (5bacafe6-2191-4573-9949-275df7fa626d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:26:40 user cinder-volume[73792]: INFO cinder.action_track [None req-8c6ac479-6f58-4cb9-9a3a-298226cb41e7 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1081160982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5c92b72c-025b-4acf-91e7-8ac77122dfd4,launched_at=2023-04-12T06:26:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b37a01c134d4ff4a674f7c4e5929c15',provider_auth='CHAP WzbusOoe gXFy7GkY1wrA89',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:26:40Z,use_quota=True,user_id='81e8ef88c79d49d1aee289a3295b6d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:26:40 user cinder-volume[73792]: INFO cinder.action_track [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Snapshot-2101273751',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=b5860d48-a19e-442d-9c38-1cf39401d251,metadata={},progress='0%',project_id='6b37a01c134d4ff4a674f7c4e5929c15',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='81e8ef88c79d49d1aee289a3295b6d28',volume=<?>,volume_id=5c92b72c-025b-4acf-91e7-8ac77122dfd4,volume_size=2,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:26:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] create snapshot b5860d48-a19e-442d-9c38-1cf39401d251 for volume 5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:26:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] cloning v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 to s_b5860d48-a19e-442d-9c38-1cf39401d251 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:26:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] create snapshot s_b5860d48-a19e-442d-9c38-1cf39401d251 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:26:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_b5860d48-a19e-442d-9c38-1cf39401d251'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] create volume s_b5860d48-a19e-442d-9c38-1cf39401d251 from snapshot s_b5860d48-a19e-442d-9c38-1cf39401d251 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:26:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4@s_b5860d48-a19e-442d-9c38-1cf39401d251', 'is_clone': True, 'full_name': 'Pool-0/s_b5860d48-a19e-442d-9c38-1cf39401d251', 'name': 's_b5860d48-a19e-442d-9c38-1cf39401d251'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b5860d48-a19e-442d-9c38-1cf39401d251/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b5860d48-a19e-442d-9c38-1cf39401d251/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b5860d48-a19e-442d-9c38-1cf39401d251/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] volume s_b5860d48-a19e-442d-9c38-1cf39401d251 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:26:42 user cinder-volume[73792]: INFO cinder.volume.manager [None req-f05b35f7-8b13-411f-8f4f-cf98187ce2fb tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Create snapshot completed successfully
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Acquiring lock "cinder-b5860d48-a19e-442d-9c38-1cf39401d251-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Lock "cinder-b5860d48-a19e-442d-9c38-1cf39401d251-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] deleating snapshot s_b5860d48-a19e-442d-9c38-1cf39401d251. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] get snapshots for volume s_b5860d48-a19e-442d-9c38-1cf39401d251  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b5860d48-a19e-442d-9c38-1cf39401d251/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b5860d48-a19e-442d-9c38-1cf39401d251/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b5860d48-a19e-442d-9c38-1cf39401d251/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] get volume s_b5860d48-a19e-442d-9c38-1cf39401d251 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b5860d48-a19e-442d-9c38-1cf39401d251 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b5860d48-a19e-442d-9c38-1cf39401d251 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4@s_b5860d48-a19e-442d-9c38-1cf39401d251', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_b5860d48-a19e-442d-9c38-1cf39401d251', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282218', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60205', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18008242890588189988', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0014104aa6baf0f2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753896448', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38272', 'name': 's_b5860d48-a19e-442d-9c38-1cf39401d251', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b5860d48-a19e-442d-9c38-1cf39401d251 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] delete snapshot s_b5860d48-a19e-442d-9c38-1cf39401d251 of volume v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4/snapshots/s_b5860d48-a19e-442d-9c38-1cf39401d251 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4/snapshots/s_b5860d48-a19e-442d-9c38-1cf39401d251 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4/snapshots/s_b5860d48-a19e-442d-9c38-1cf39401d251 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] snapshot s_b5860d48-a19e-442d-9c38-1cf39401d251 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:26:44 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=33,cinder:SELECT=56,cinder:DELETE=4,cinder:INSERT=7 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:26:44 user cinder-volume[73792]: DEBUG cinder.quota [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Created reservations ['588a6b81-81a7-4835-a7c7-9a7e312f9258', '0308fe17-af0e-45a5-84d3-8eb04cc46ceb', '8135eca9-78cf-4959-a7a1-a2241649325e', '9149744c-a794-4204-97ef-200718b221b0'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:26:44 user cinder-volume[73792]: INFO cinder.volume.manager [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Delete snapshot completed successfully.
Apr 12 06:26:44 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bb6cff36-bd66-459a-aac0-8c8b5c7c4aa5 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Lock "cinder-b5860d48-a19e-442d-9c38-1cf39401d251-delete_snapshot" released by "delete_snapshot" :: held 1.250s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:26:45 user cinder-volume[73792]: INFO cinder.action_track [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='reserved',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:58Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:26:45 user cinder-volume[73792]: INFO cinder.action_track [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='reserved',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:58Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] create export for volume: d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] ensure volume d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] check if targe iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] create target and attach volume d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] create target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Acquiring lock "cinder-5c92b72c-025b-4acf-91e7-8ac77122dfd4-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Lock "cinder-5c92b72c-025b-4acf-91e7-8ac77122dfd4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] remove_export for volume: 5c92b72c-025b-4acf-91e7-8ac77122dfd4. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1081160982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5c92b72c-025b-4acf-91e7-8ac77122dfd4,launched_at=2023-04-12T06:26:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b37a01c134d4ff4a674f7c4e5929c15',provider_auth='CHAP WzbusOoe gXFy7GkY1wrA89',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:26:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:26:45Z,updated_at=2023-04-12T06:26:45Z,use_quota=True,user_id='81e8ef88c79d49d1aee289a3295b6d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] detach volume v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 from target iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4/luns/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4/luns/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4/luns/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4/luns/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] failed to remove resource iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 because of JDSS resource v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] delete target: iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] delete target iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] failed to remove resource iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 because of JDSS resource iqn.2010-10.org.openstack:5c92b72c-025b-4acf-91e7-8ac77122dfd4 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] deleating volume v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] get snapshots for volume v_5c92b72c-025b-4acf-91e7-8ac77122dfd4  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] get volume v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282217', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60199', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11245887188140668595', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '186e7fbbfa33b444', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753896448', 'san:volume_id': '186e7fbbfa33b4441c5b5dd2d3ddae9ec92cb595', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38131', 'name': 'v_5c92b72c-025b-4acf-91e7-8ac77122dfd4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] delete volume:v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] volume v_5c92b72c-025b-4acf-91e7-8ac77122dfd4 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:26:46 user cinder-volume[73792]: DEBUG cinder.quota [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Created reservations ['af60eac6-5100-45a0-94fd-ed3debeeb7d2', 'c93675fc-7bea-4826-9ef7-82f4a5e36da0', '9b074178-35e0-4df3-b533-ee62521839e7', '3b58ff67-1835-4600-8fb1-ebe5e2293fa5'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:26:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:26:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:26:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753978368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:26:47 user cinder-volume[73792]: DEBUG cinder.manager [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:26:47 user cinder-volume[73792]: INFO cinder.volume.manager [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Deleted volume successfully.
Apr 12 06:26:47 user cinder-volume[73792]: DEBUG cinder.coordination [None req-8210bcaf-bb5b-4b9b-b689-de3260a374f8 tempest-VolumesSnapshotNegativeTestJSON-1510094472 None] Lock "cinder-5c92b72c-025b-4acf-91e7-8ac77122dfd4-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:26:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] atach volume v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a to target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:26:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6434393862343066', 'lun': 0, 'mode': 'wt', 'name': 'v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'prod_id': 'Storage', 'scsi_id': 'd498b40f84436c16'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] add credentails to target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:26:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:26:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:26:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] Geting {'code': 201, 'error': None, 'data': {'name': 'bcOxDrPR'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:26:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] initialize_connection for d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:26:49 user cinder-volume[73792]: INFO cinder.action_track [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOxDrPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '0d6eff84-346f-4147-ab6f-3d248b7d3f04'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='reserved',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:24:58Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:26:49 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=35,cinder:SELECT=54,cinder:DELETE=4,cinder:INSERT=7 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:26:49 user cinder-volume[73792]: INFO cinder.action_track [req-a2982f35-07b7-4f67-8ee0-b1d92496182b req-131038f2-1817-47c7-88df-152b77cd4444 tempest-TestShelveInstance-735091148 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:26:50Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:27:09 user cinder-volume[73792]: INFO cinder.action_track [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1655274161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=859868f9-52cb-46c1-95b8-6ca520e4fae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca90b5b5fb49ca857aa4e215a99e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='e761442395d14d7f82216e3d4174e43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Flow 'volume_create_manager' (8fce1076-1678-4470-be54-33adc1912e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc95df9e-c661-4ef1-bd40-248939325498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc95df9e-c661-4ef1-bd40-248939325498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1655274161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=859868f9-52cb-46c1-95b8-6ca520e4fae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca90b5b5fb49ca857aa4e215a99e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:27:10Z,use_quota=True,user_id='e761442395d14d7f82216e3d4174e43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def65822-e86b-439d-accd-9f3519efde35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def65822-e86b-439d-accd-9f3519efde35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdb15c7-c65f-42b1-9e66-832e2f2af9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdb15c7-c65f-42b1-9e66-832e2f2af9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859868f9-52cb-46c1-95b8-6ca520e4fae3', 'volume_name': 'volume-859868f9-52cb-46c1-95b8-6ca520e4fae3', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaaf841-5ac6-4346-8592-2fd67741d88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaaf841-5ac6-4346-8592-2fd67741d88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd555a3-1539-4b60-bf34-7d24170af7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:27:09 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Volume 859868f9-52cb-46c1-95b8-6ca520e4fae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859868f9-52cb-46c1-95b8-6ca520e4fae3', 'volume_size': 1}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] creating volume v_859868f9-52cb-46c1-95b8-6ca520e4fae3. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] create volume {'name': 'v_859868f9-52cb-46c1-95b8-6ca520e4fae3', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_859868f9-52cb-46c1-95b8-6ca520e4fae3', 'is_clone': False, 'name': 'v_859868f9-52cb-46c1-95b8-6ca520e4fae3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd555a3-1539-4b60-bf34-7d24170af7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859868f9-52cb-46c1-95b8-6ca520e4fae3', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:27:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ac83e2-9e5e-40ad-a51c-39c361a8a7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:27:10 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Volume volume-859868f9-52cb-46c1-95b8-6ca520e4fae3 (859868f9-52cb-46c1-95b8-6ca520e4fae3): created successfully
Apr 12 06:27:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ac83e2-9e5e-40ad-a51c-39c361a8a7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:27:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] Flow 'volume_create_manager' (8fce1076-1678-4470-be54-33adc1912e5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:27:10 user cinder-volume[73792]: INFO cinder.action_track [None req-d00e0192-39f0-4aa8-b83b-8d69fa915c2e tempest-ServersNegativeTestJSON-815999574 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1655274161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=859868f9-52cb-46c1-95b8-6ca520e4fae3,launched_at=2023-04-12T06:27:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca90b5b5fb49ca857aa4e215a99e37',provider_auth='CHAP GxocdDBh 59speTJ71aRCNk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:27:10Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:27:10Z,use_quota=True,user_id='e761442395d14d7f82216e3d4174e43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:18 user cinder-volume[73792]: INFO cinder.action_track [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1584093948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=43ddfeaf-9407-49e8-abb1-f5c9d23dab3f,launched_at=2023-04-12T06:25:05Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP PFGiWOnX FlOn5UNY7QBarM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:25:24Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] terminate connection for 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:27:18 user cinder-volume[73792]: INFO cinder.action_track [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1584093948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=43ddfeaf-9407-49e8-abb1-f5c9d23dab3f,launched_at=2023-04-12T06:25:05Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP PFGiWOnX FlOn5UNY7QBarM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:25:24Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] Deleting attachment 2ed55170-1be1-4564-8950-0a3ec073e131. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] remove_export for volume: 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1584093948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=43ddfeaf-9407-49e8-abb1-f5c9d23dab3f,launched_at=2023-04-12T06:25:05Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP PFGiWOnX FlOn5UNY7QBarM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:25:24Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] detach volume v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f from target iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/luns/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/luns/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/luns/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] delete target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] delete target iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-35a541a4-686e-4602-95fc-ec659cab633e tempest-TaggedBootDevicesTest-1618985724 None] target iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=20,cinder:SELECT=43,cinder:INSERT=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:27:18 user cinder-volume[73792]: INFO cinder.action_track [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1465684657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8c9b01f5-884d-4f16-b344-ea6facab9090,launched_at=2023-04-12T06:25:07Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP hOloYSmd xanDwu5vPEdmGt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:06Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:25:28Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] terminate connection for 8c9b01f5-884d-4f16-b344-ea6facab9090  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:27:18 user cinder-volume[73792]: INFO cinder.action_track [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1465684657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8c9b01f5-884d-4f16-b344-ea6facab9090,launched_at=2023-04-12T06:25:07Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP hOloYSmd xanDwu5vPEdmGt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:06Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:25:28Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] Deleting attachment 2a42ffb3-97fa-4aad-b096-c50387e5cab7. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] remove_export for volume: 8c9b01f5-884d-4f16-b344-ea6facab9090. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1465684657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8c9b01f5-884d-4f16-b344-ea6facab9090,launched_at=2023-04-12T06:25:07Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP hOloYSmd xanDwu5vPEdmGt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:06Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:25:28Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] detach volume v_8c9b01f5-884d-4f16-b344-ea6facab9090 from target iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/luns/v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/luns/v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/luns/v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] delete target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] delete target iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-bb568fb7-e552-4051-9692-91796e354392 tempest-TaggedBootDevicesTest-1618985724 None] target iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:27:19 user cinder-volume[73792]: INFO cinder.action_track [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1357256481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6c75bc08-5a02-4b60-9201-616a5a4f1d88,launched_at=2023-04-12T06:25:08Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP vIhHWXGq UlnXiCJ0kMKt7f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:25:33Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] terminate connection for 6c75bc08-5a02-4b60-9201-616a5a4f1d88  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:27:19 user cinder-volume[73792]: INFO cinder.action_track [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1357256481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6c75bc08-5a02-4b60-9201-616a5a4f1d88,launched_at=2023-04-12T06:25:08Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP vIhHWXGq UlnXiCJ0kMKt7f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:25:33Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] Deleting attachment 5660e0e3-8e7d-473b-b61c-f8ea9e68e3a4. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] remove_export for volume: 6c75bc08-5a02-4b60-9201-616a5a4f1d88. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1357256481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6c75bc08-5a02-4b60-9201-616a5a4f1d88,launched_at=2023-04-12T06:25:08Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP vIhHWXGq UlnXiCJ0kMKt7f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:25:33Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] detach volume v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 from target iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/luns/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/luns/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/luns/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] delete target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] delete target iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a630354e-5c7e-40c9-8549-103fee1dc31c req-2102e13a-86c0-4715-9e16-4ddb02d20dc9 tempest-TaggedBootDevicesTest-1618985724 None] target iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:27:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:27:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:27:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753900544', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:27:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:27:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:27:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:27:32 user cinder-volume[73792]: INFO cinder.action_track [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-980997373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=34023a39-bbf4-4afb-948b-0bff9f563bb8,launched_at=2023-04-12T06:23:41Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP vmJGqRkQ XLiQfzbosBCMga',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:27:32Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] terminate connection for 34023a39-bbf4-4afb-948b-0bff9f563bb8  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:27:32 user cinder-volume[73792]: INFO cinder.action_track [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-980997373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=34023a39-bbf4-4afb-948b-0bff9f563bb8,launched_at=2023-04-12T06:23:41Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP vmJGqRkQ XLiQfzbosBCMga',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:27:32Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] Deleting attachment 89896312-6c7c-4a65-a4f5-fd99ee079f77. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] remove_export for volume: 34023a39-bbf4-4afb-948b-0bff9f563bb8. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-980997373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=34023a39-bbf4-4afb-948b-0bff9f563bb8,launched_at=2023-04-12T06:23:41Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP vmJGqRkQ XLiQfzbosBCMga',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:27:32Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] detach volume v_34023a39-bbf4-4afb-948b-0bff9f563bb8 from target iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/luns/v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/luns/v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/luns/v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] delete target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] delete target iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 req-a5d649f0-600f-4b0e-a29b-8871ca9ed0e8 tempest-AttachVolumeTestJSON-1680327736 None] target iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:27:44 user cinder-volume[73792]: INFO cinder.action_track [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-588781848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff8cf913-7198-47e1-adda-fe9fff61c36b,launched_at=2023-04-12T06:25:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP kSFTbZuW TUW7zRdYNlbn4B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:47Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=a2733057-27d3-4034-9b97-aaa88c74593e,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:27:44Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:44 user cinder-volume[73792]: INFO cinder.action_track [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-588781848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff8cf913-7198-47e1-adda-fe9fff61c36b,launched_at=2023-04-12T06:25:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP kSFTbZuW TUW7zRdYNlbn4B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:47Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=a2733057-27d3-4034-9b97-aaa88c74593e,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:27:44Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] create export for volume: ff8cf913-7198-47e1-adda-fe9fff61c36b. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:27:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] ensure volume ff8cf913-7198-47e1-adda-fe9fff61c36b assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:27:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] check if targe iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:27:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] create target and attach volume ff8cf913-7198-47e1-adda-fe9fff61c36b to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:27:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] create target iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:27:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] atach volume v_ff8cf913-7198-47e1-adda-fe9fff61c36b to target iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:27:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3530643461656266', 'lun': 0, 'mode': 'wt', 'name': 'v_ff8cf913-7198-47e1-adda-fe9fff61c36b', 'prod_id': 'Storage', 'scsi_id': '50d4aebf354e72ef'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] add credentails to target iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:27:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] Geting {'code': 201, 'error': None, 'data': {'name': 'kSFTbZuW'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] initialize_connection for ff8cf913-7198-47e1-adda-fe9fff61c36b 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:27:48 user cinder-volume[73792]: INFO cinder.action_track [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSFTbZuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '15f5189b-bd1f-4810-88b1-d2363abe51ca'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-588781848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff8cf913-7198-47e1-adda-fe9fff61c36b,launched_at=2023-04-12T06:25:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP kSFTbZuW TUW7zRdYNlbn4B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:47Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=a2733057-27d3-4034-9b97-aaa88c74593e,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:27:44Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:48 user cinder-volume[73792]: INFO cinder.action_track [req-cb016b33-298f-42f9-90ac-6ffaea4373d8 req-34fecefa-6f49-41b7-930e-93fad43813a9 tempest-TestStampPattern-1782553765 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-588781848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff8cf913-7198-47e1-adda-fe9fff61c36b,launched_at=2023-04-12T06:25:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP kSFTbZuW TUW7zRdYNlbn4B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:47Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=a2733057-27d3-4034-9b97-aaa88c74593e,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:27:48Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:50 user cinder-volume[73792]: INFO cinder.action_track [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-920794312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e97290a1-81ea-47ba-b4ee-53324a95c860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Flow 'volume_create_manager' (6dca62d4-9e47-4446-8976-25722c2cdbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33904673-919b-4950-aee5-1ea71cc63b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33904673-919b-4950-aee5-1ea71cc63b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-920794312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e97290a1-81ea-47ba-b4ee-53324a95c860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:27:50Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c40f47-20b1-488a-8576-d72c8d42ec42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c40f47-20b1-488a-8576-d72c8d42ec42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0437f6-c5d7-49cf-aa7f-07efff2db98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0437f6-c5d7-49cf-aa7f-07efff2db98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97290a1-81ea-47ba-b4ee-53324a95c860', 'volume_name': 'volume-e97290a1-81ea-47ba-b4ee-53324a95c860', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcb4311-d561-40e9-9700-cc1dd89f1e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcb4311-d561-40e9-9700-cc1dd89f1e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55be81bd-0451-48f3-876b-918650aa1922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:27:50 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Volume e97290a1-81ea-47ba-b4ee-53324a95c860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97290a1-81ea-47ba-b4ee-53324a95c860', 'volume_size': 1}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] creating volume v_e97290a1-81ea-47ba-b4ee-53324a95c860. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] create volume {'name': 'v_e97290a1-81ea-47ba-b4ee-53324a95c860', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e97290a1-81ea-47ba-b4ee-53324a95c860', 'is_clone': False, 'name': 'v_e97290a1-81ea-47ba-b4ee-53324a95c860'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55be81bd-0451-48f3-876b-918650aa1922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97290a1-81ea-47ba-b4ee-53324a95c860', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e057f980-e81e-4f96-b2c6-d3ea33e3e177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:27:50 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Volume volume-e97290a1-81ea-47ba-b4ee-53324a95c860 (e97290a1-81ea-47ba-b4ee-53324a95c860): created successfully
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e057f980-e81e-4f96-b2c6-d3ea33e3e177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:27:50 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] Flow 'volume_create_manager' (6dca62d4-9e47-4446-8976-25722c2cdbb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:27:50 user cinder-volume[73792]: INFO cinder.action_track [None req-1b7630c8-3d5d-4394-8e16-941dfcf7210d tempest-VolumesActionsTest-190731565 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-920794312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e97290a1-81ea-47ba-b4ee-53324a95c860,launched_at=2023-04-12T06:27:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP BQONvrkh Uqmb63yink7fLe',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:27:50Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:27:50Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.coordination [None req-195eb4fa-e104-48c8-9211-ebeae9946290 tempest-VolumesActionsTest-190731565 None] Acquiring lock "cinder-e97290a1-81ea-47ba-b4ee-53324a95c860" by "attach_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.coordination [None req-195eb4fa-e104-48c8-9211-ebeae9946290 tempest-VolumesActionsTest-190731565 None] Lock "cinder-e97290a1-81ea-47ba-b4ee-53324a95c860" acquired by "attach_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:27:51 user cinder-volume[73792]: INFO cinder.volume.manager [None req-195eb4fa-e104-48c8-9211-ebeae9946290 tempest-VolumesActionsTest-190731565 None] Attaching volume e97290a1-81ea-47ba-b4ee-53324a95c860 to instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 at mountpoint /dev/vdb on host None.
Apr 12 06:27:51 user cinder-volume[73792]: INFO cinder.action_track [None req-195eb4fa-e104-48c8-9211-ebeae9946290 tempest-VolumesActionsTest-190731565 None] ACTION:'volume_attach' MSG:'Attach volume completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:1512:attach_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-920794312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e97290a1-81ea-47ba-b4ee-53324a95c860,launched_at=2023-04-12T06:27:51Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP BQONvrkh Uqmb63yink7fLe',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:27:50Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:27:51Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.coordination [None req-195eb4fa-e104-48c8-9211-ebeae9946290 tempest-VolumesActionsTest-190731565 None] Lock "cinder-e97290a1-81ea-47ba-b4ee-53324a95c860" released by "attach_volume" :: held 0.062s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:27:51 user cinder-volume[73792]: INFO cinder.action_track [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] ACTION:'volume_detach' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:None 
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] terminate connection for e97290a1-81ea-47ba-b4ee-53324a95c860  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:27:51 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] Terminate volume connection completed successfully.
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] Acquiring lock "cinder-e97290a1-81ea-47ba-b4ee-53324a95c860-detach_volume" by "detach_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] Lock "cinder-e97290a1-81ea-47ba-b4ee-53324a95c860-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:27:51 user cinder-volume[73792]: INFO cinder.action_track [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] ACTION:'volume_detach' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata={attached_mode='rw',readonly='False'},attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-920794312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e97290a1-81ea-47ba-b4ee-53324a95c860,launched_at=2023-04-12T06:27:51Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP BQONvrkh Uqmb63yink7fLe',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:27:50Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='error',terminated_at=None,updated_at=2023-04-12T06:27:52Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:51 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] Detaching volume e97290a1-81ea-47ba-b4ee-53324a95c860 from instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1.
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] remove_export for volume: e97290a1-81ea-47ba-b4ee-53324a95c860. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] detach volume:Volume(_name_id=None,admin_metadata={attached_mode='rw',readonly='False'},attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-920794312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e97290a1-81ea-47ba-b4ee-53324a95c860,launched_at=2023-04-12T06:27:51Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP BQONvrkh Uqmb63yink7fLe',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:27:50Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='error',terminated_at=None,updated_at=2023-04-12T06:27:52Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] detach volume v_e97290a1-81ea-47ba-b4ee-53324a95c860 from target iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860/luns/v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860/luns/v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:51 user cinder-volume[73792]: INFO cinder.action_track [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-588781848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff8cf913-7198-47e1-adda-fe9fff61c36b,launched_at=2023-04-12T06:25:49Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP kSFTbZuW TUW7zRdYNlbn4B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:47Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=a2733057-27d3-4034-9b97-aaa88c74593e,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:27:51Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] terminate connection for ff8cf913-7198-47e1-adda-fe9fff61c36b  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:27:51 user cinder-volume[73792]: INFO cinder.action_track [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-588781848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff8cf913-7198-47e1-adda-fe9fff61c36b,launched_at=2023-04-12T06:25:49Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP kSFTbZuW TUW7zRdYNlbn4B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:47Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=a2733057-27d3-4034-9b97-aaa88c74593e,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:27:51Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] Deleting attachment 15f5189b-bd1f-4810-88b1-d2363abe51ca. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] remove_export for volume: ff8cf913-7198-47e1-adda-fe9fff61c36b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-588781848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff8cf913-7198-47e1-adda-fe9fff61c36b,launched_at=2023-04-12T06:25:49Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP kSFTbZuW TUW7zRdYNlbn4B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:47Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=a2733057-27d3-4034-9b97-aaa88c74593e,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:27:51Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] detach volume v_ff8cf913-7198-47e1-adda-fe9fff61c36b from target iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/luns/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/luns/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860/luns/v_e97290a1-81ea-47ba-b4ee-53324a95c860'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860/luns/v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] failed to remove resource iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 because of JDSS resource v_e97290a1-81ea-47ba-b4ee-53324a95c860 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] delete target: iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] delete target iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] failed to remove resource iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 because of JDSS resource iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:27:52 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] Detach volume completed successfully.
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b306b6e1-f2f3-4af2-82b0-e3e35fc458a5 tempest-VolumesActionsTest-487909795 None] Lock "cinder-e97290a1-81ea-47ba-b4ee-53324a95c860-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-e6594074-3d95-40da-bbe9-450aaad6c485 tempest-VolumesActionsTest-190731565 None] Acquiring lock "cinder-e97290a1-81ea-47ba-b4ee-53324a95c860-detach_volume" by "detach_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-e6594074-3d95-40da-bbe9-450aaad6c485 tempest-VolumesActionsTest-190731565 None] Lock "cinder-e97290a1-81ea-47ba-b4ee-53324a95c860-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:27:52 user cinder-volume[73792]: INFO cinder.action_track [None req-e6594074-3d95-40da-bbe9-450aaad6c485 tempest-VolumesActionsTest-190731565 None] ACTION:'volume_detach' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-920794312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e97290a1-81ea-47ba-b4ee-53324a95c860,launched_at=2023-04-12T06:27:51Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP BQONvrkh Uqmb63yink7fLe',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:27:50Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:27:52Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:27:52 user cinder-volume[73792]: INFO cinder.volume.manager [None req-e6594074-3d95-40da-bbe9-450aaad6c485 tempest-VolumesActionsTest-190731565 None] Volume detach called, but volume not attached.
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-e6594074-3d95-40da-bbe9-450aaad6c485 tempest-VolumesActionsTest-190731565 None] Lock "cinder-e97290a1-81ea-47ba-b4ee-53324a95c860-detach_volume" released by "detach_volume" :: held 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/luns/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] delete target: iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] delete target iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Acquiring lock "cinder-e97290a1-81ea-47ba-b4ee-53324a95c860-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Lock "cinder-e97290a1-81ea-47ba-b4ee-53324a95c860-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] remove_export for volume: e97290a1-81ea-47ba-b4ee-53324a95c860. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='False'},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-920794312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e97290a1-81ea-47ba-b4ee-53324a95c860,launched_at=2023-04-12T06:27:51Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP BQONvrkh Uqmb63yink7fLe',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:27:50Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:27:52Z,updated_at=2023-04-12T06:27:52Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] detach volume v_e97290a1-81ea-47ba-b4ee-53324a95c860 from target iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860/luns/v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860/luns/v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860/luns/v_e97290a1-81ea-47ba-b4ee-53324a95c860'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860/luns/v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] failed to remove resource iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 because of JDSS resource v_e97290a1-81ea-47ba-b4ee-53324a95c860 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] delete target: iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] delete target iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] failed to remove resource iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 because of JDSS resource iqn.2010-10.org.openstack:e97290a1-81ea-47ba-b4ee-53324a95c860 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] deleating volume v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] get snapshots for volume v_e97290a1-81ea-47ba-b4ee-53324a95c860  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e97290a1-81ea-47ba-b4ee-53324a95c860/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e97290a1-81ea-47ba-b4ee-53324a95c860/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-44811260-e1d1-44d6-820a-920c5c457e7c req-ba223175-f743-40ad-8138-2393bff640b6 tempest-TestStampPattern-1782553765 None] target iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e97290a1-81ea-47ba-b4ee-53324a95c860/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] get volume v_e97290a1-81ea-47ba-b4ee-53324a95c860 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e97290a1-81ea-47ba-b4ee-53324a95c860', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282287', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60240', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7993406840317060730', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4d3b69960c710cb7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753679360', 'san:volume_id': '4d3b69960c710cb7aacc66580ed7a502e80498d8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37375', 'name': 'v_e97290a1-81ea-47ba-b4ee-53324a95c860', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] delete volume:v_e97290a1-81ea-47ba-b4ee-53324a95c860 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e97290a1-81ea-47ba-b4ee-53324a95c860 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] volume v_e97290a1-81ea-47ba-b4ee-53324a95c860 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:27:53 user cinder-volume[73792]: DEBUG cinder.quota [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Created reservations ['5a992ad8-05c7-4a9f-8091-45befa2cc0a3', 'b8d870c7-2e9b-44a0-a538-28b7381873d1', '3157bfa7-bd8b-447f-acb3-774adc7af2fd', 'f936e3b3-e8dd-4d93-bde2-c2f14406ef5d'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:27:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:27:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:27:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:27:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:27:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753761280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:27:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:27:54 user cinder-volume[73792]: DEBUG cinder.manager [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:27:54 user cinder-volume[73792]: INFO cinder.volume.manager [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Deleted volume successfully.
Apr 12 06:27:54 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5b5eb0e7-cee8-445e-8000-c4f080679e8b tempest-VolumesActionsTest-190731565 None] Lock "cinder-e97290a1-81ea-47ba-b4ee-53324a95c860-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:28:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=18,cinder:SELECT=52,cinder:INSERT=4,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.coordination [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Acquiring lock "cinder-6c75bc08-5a02-4b60-9201-616a5a4f1d88-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.coordination [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Lock "cinder-6c75bc08-5a02-4b60-9201-616a5a4f1d88-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=49,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] remove_export for volume: 6c75bc08-5a02-4b60-9201-616a5a4f1d88. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1357256481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6c75bc08-5a02-4b60-9201-616a5a4f1d88,launched_at=2023-04-12T06:25:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP vIhHWXGq UlnXiCJ0kMKt7f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:28:05Z,updated_at=2023-04-12T06:28:05Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] detach volume v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 from target iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/luns/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/luns/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/luns/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88/luns/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] failed to remove resource iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 because of JDSS resource v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] delete target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] delete target iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] failed to remove resource iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 because of JDSS resource iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] deleating volume v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] get snapshots for volume v_6c75bc08-5a02-4b60-9201-616a5a4f1d88  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] get volume v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282124', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60061', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7748275331536541166', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'becbf82791519806', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753773568', 'san:volume_id': 'becbf8279151980612c5a4c02f134f8b77c0cbad', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38034', 'name': 'v_6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] delete volume:v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] volume v_6c75bc08-5a02-4b60-9201-616a5a4f1d88 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:28:06 user cinder-volume[73792]: DEBUG cinder.quota [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Created reservations ['3d9054fd-6a57-4cb5-b71a-d3233fbe1101', 'f5a24b1f-724b-4314-9ffe-58758755eb86', '14799a0e-20bd-4b74-872d-90e04dd98027', 'fde90597-b94d-4fbf-9304-817552c78e47'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:28:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:28:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:28:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753855488', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.manager [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:28:07 user cinder-volume[73792]: INFO cinder.volume.manager [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Deleted volume successfully.
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.coordination [None req-53fc76d2-601c-4b55-a469-75d103197a0a tempest-TaggedBootDevicesTest-1618985724 None] Lock "cinder-6c75bc08-5a02-4b60-9201-616a5a4f1d88-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.coordination [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Acquiring lock "cinder-8c9b01f5-884d-4f16-b344-ea6facab9090-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.coordination [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Lock "cinder-8c9b01f5-884d-4f16-b344-ea6facab9090-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] remove_export for volume: 8c9b01f5-884d-4f16-b344-ea6facab9090. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1465684657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8c9b01f5-884d-4f16-b344-ea6facab9090,launched_at=2023-04-12T06:25:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP hOloYSmd xanDwu5vPEdmGt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:06Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:28:07Z,updated_at=2023-04-12T06:28:07Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] detach volume v_8c9b01f5-884d-4f16-b344-ea6facab9090 from target iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/luns/v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/luns/v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/luns/v_8c9b01f5-884d-4f16-b344-ea6facab9090'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090/luns/v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] failed to remove resource iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 because of JDSS resource v_8c9b01f5-884d-4f16-b344-ea6facab9090 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] delete target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] delete target iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] failed to remove resource iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 because of JDSS resource iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] deleating volume v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] get snapshots for volume v_8c9b01f5-884d-4f16-b344-ea6facab9090  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c9b01f5-884d-4f16-b344-ea6facab9090/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c9b01f5-884d-4f16-b344-ea6facab9090/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c9b01f5-884d-4f16-b344-ea6facab9090/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] get volume v_8c9b01f5-884d-4f16-b344-ea6facab9090 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8c9b01f5-884d-4f16-b344-ea6facab9090', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282123', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60057', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9522818338234647384', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4b7513e4d47a5126', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753855488', 'san:volume_id': '4b7513e4d47a512649d7081fe8173b84a9f49cdc', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38025', 'name': 'v_8c9b01f5-884d-4f16-b344-ea6facab9090', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] delete volume:v_8c9b01f5-884d-4f16-b344-ea6facab9090 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8c9b01f5-884d-4f16-b344-ea6facab9090 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] volume v_8c9b01f5-884d-4f16-b344-ea6facab9090 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:28:08 user cinder-volume[73792]: DEBUG cinder.quota [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Created reservations ['020cce63-1496-4419-8d26-bf447f9fc1ce', 'd3489550-f835-461b-bc8f-8ceb4799a65e', '66daeab7-2e4c-4a93-8032-b98447ce3f78', '8eb3f1f7-4de6-4427-860c-135a0789aada'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:28:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:28:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:28:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753937408', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.manager [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:28:09 user cinder-volume[73792]: INFO cinder.volume.manager [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Deleted volume successfully.
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.coordination [None req-778ed649-e932-4a86-8602-22124c53e73b tempest-TaggedBootDevicesTest-1618985724 None] Lock "cinder-8c9b01f5-884d-4f16-b344-ea6facab9090-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.coordination [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Acquiring lock "cinder-43ddfeaf-9407-49e8-abb1-f5c9d23dab3f-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.coordination [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Lock "cinder-43ddfeaf-9407-49e8-abb1-f5c9d23dab3f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] remove_export for volume: 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1584093948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=43ddfeaf-9407-49e8-abb1-f5c9d23dab3f,launched_at=2023-04-12T06:25:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b22588bca2c46f09b19d28bcf76db06',provider_auth='CHAP PFGiWOnX FlOn5UNY7QBarM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:28:10Z,updated_at=2023-04-12T06:28:10Z,use_quota=True,user_id='38d195bbdaf94ac9bfdba8f76157a10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] detach volume v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f from target iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/luns/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/luns/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/luns/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/luns/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] failed to remove resource iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f because of JDSS resource v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] delete target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] delete target iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] failed to remove resource iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f because of JDSS resource iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] deleating volume v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] get snapshots for volume v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] get volume v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282121', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '60053', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8427304700371082766', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10129408', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '1f987664b5cb627e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753937408', 'san:volume_id': '1f987664b5cb627e37c960b3f829e47c62c311a0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10129408', 'objsetid': '35710', 'name': 'v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10129408', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] delete snapshot v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f of volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] snapshot v_43ddfeaf-9407-49e8-abb1-f5c9d23dab3f deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:28:10 user cinder-volume[73792]: DEBUG cinder.quota [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Created reservations ['bdc28ef9-cf03-4906-93aa-12ae2d450421', '79550ea1-c075-4fc5-90b1-05d406bcc83a', 'c5548233-40d5-45a7-bad6-056c911089f4', '08addf74-a543-4578-b1a6-576accd04b96'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:28:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:28:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:28:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764136448', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:28:11 user cinder-volume[73792]: DEBUG cinder.manager [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:28:11 user cinder-volume[73792]: INFO cinder.volume.manager [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Deleted volume successfully.
Apr 12 06:28:11 user cinder-volume[73792]: DEBUG cinder.coordination [None req-48f35e7d-0666-4d46-9bb9-43355ba6e79c tempest-TaggedBootDevicesTest-1618985724 None] Lock "cinder-43ddfeaf-9407-49e8-abb1-f5c9d23dab3f-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:28:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:28:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:28:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:28:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114764124160', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:28:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=42,cinder:INSERT=7,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=40,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:28:37 user cinder-volume[73792]: INFO cinder.action_track [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:26:50Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] terminate connection for d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:28:37 user cinder-volume[73792]: INFO cinder.action_track [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:26:50Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] Deleting attachment 0d6eff84-346f-4147-ab6f-3d248b7d3f04. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] remove_export for volume: d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:26:50Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] detach volume v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a from target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] delete target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] delete target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-86ed73a9-2a90-46ac-aa86-67b4fa9213fb tempest-TestShelveInstance-735091148 None] target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.coordination [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Acquiring lock "cinder-d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.coordination [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Lock "cinder-d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] remove_export for volume: d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1558140585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a,launched_at=2023-04-12T06:22:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7742afa38eb46818efaf3b811c417ba',provider_auth='CHAP bcOxDrPR 3lgjiHwxP5IfrQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:28:38Z,updated_at=2023-04-12T06:28:38Z,use_quota=True,user_id='9ed3a446901644b6a622afb3166f08dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] detach volume v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a from target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/luns/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] failed to remove resource iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a because of JDSS resource v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] delete target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] delete target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] failed to remove resource iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a because of JDSS resource iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] deleating volume v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] get snapshots for volume v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] get volume v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281995', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '59870', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14287637078480051128', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10145792', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': 'd498b40f84436c16', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114764124160', 'san:volume_id': 'd498b40f84436c167963b0fc65da40f5c97ab009', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10145792', 'objsetid': '37230', 'name': 'v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10145792', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] delete snapshot v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a of volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] snapshot v_d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:28:39 user cinder-volume[73792]: DEBUG cinder.quota [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Created reservations ['11cb38de-4568-4d5b-98cc-47157c9e0479', '4173f433-da0a-4917-b36a-d588800fe2b7', '5d887102-37e1-4512-a415-a716b8f2388e', '7b48e288-7086-4317-a80b-e5bf60823dae'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:28:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:28:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:28:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774343680', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:28:40 user cinder-volume[73792]: DEBUG cinder.manager [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:28:40 user cinder-volume[73792]: INFO cinder.volume.manager [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Deleted volume successfully.
Apr 12 06:28:40 user cinder-volume[73792]: DEBUG cinder.coordination [req-cda63090-1ed5-42d0-9deb-bf59bec5a385 req-838a4150-6eaa-441a-8f6c-8ee0affc1b36 tempest-TestShelveInstance-735091148 None] Lock "cinder-d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:28:41 user cinder-volume[73792]: INFO cinder.action_track [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:28:40Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] terminate connection for d96a84d2-2151-4f60-a72b-25e84b80c975  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:28:41 user cinder-volume[73792]: INFO cinder.action_track [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:28:40Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] Deleting attachment 14e8b92f-dc90-46e2-bc83-3ab6e56643a2. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] remove_export for volume: d96a84d2-2151-4f60-a72b-25e84b80c975. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:28:40Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] detach volume v_d96a84d2-2151-4f60-a72b-25e84b80c975 from target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] delete target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] delete target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b req-a988a183-7fc4-4957-8ea0-e934a9824249 tempest-ServerActionsTestJSON-752347644 None] target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:28:45 user cinder-volume[73792]: INFO cinder.action_track [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2104794616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3fe94bb6-234d-4c85-9d77-49c283e64b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Flow 'volume_create_manager' (0835fe57-17e5-46e1-8b0f-715a7fe3f78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1e1260-c997-42b7-92f5-0d8dbc16fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1e1260-c997-42b7-92f5-0d8dbc16fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2104794616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3fe94bb6-234d-4c85-9d77-49c283e64b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:28:45Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e211c874-c931-4dd2-ab3a-7d1a5cb431d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e211c874-c931-4dd2-ab3a-7d1a5cb431d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b769eb6c-4c40-4712-95c4-56fb9f94fd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b769eb6c-4c40-4712-95c4-56fb9f94fd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fe94bb6-234d-4c85-9d77-49c283e64b6d', 'volume_name': 'volume-3fe94bb6-234d-4c85-9d77-49c283e64b6d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07212e1a-87fc-4270-bf89-903e5c4b68d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07212e1a-87fc-4270-bf89-903e5c4b68d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb2b53b-12f7-45af-b8f6-0566a5b7cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:45 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Volume 3fe94bb6-234d-4c85-9d77-49c283e64b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fe94bb6-234d-4c85-9d77-49c283e64b6d', 'volume_size': 1}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] creating volume v_3fe94bb6-234d-4c85-9d77-49c283e64b6d. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] create volume {'name': 'v_3fe94bb6-234d-4c85-9d77-49c283e64b6d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:45 user cinder-volume[73792]: INFO cinder.action_track [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1405866328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Flow 'volume_create_manager' (56a7d356-f5cf-46c6-9467-14277e317762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0276a312-ab6e-493f-a864-fd54ad5d9621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0276a312-ab6e-493f-a864-fd54ad5d9621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1405866328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:28:46Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0b40e7-224b-4a69-a633-3fbffac07eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0b40e7-224b-4a69-a633-3fbffac07eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f1277c-7ee8-49e5-908c-c392193060aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f1277c-7ee8-49e5-908c-c392193060aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'volume_name': 'volume-fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c611a899-b32f-418b-bdae-faa92930176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c611a899-b32f-418b-bdae-faa92930176c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355d050c-1fbc-458d-8770-7b7b7fce1e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:45 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Volume fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'volume_size': 1}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] creating volume v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] create volume {'name': 'v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d', 'is_clone': False, 'name': 'v_3fe94bb6-234d-4c85-9d77-49c283e64b6d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb2b53b-12f7-45af-b8f6-0566a5b7cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fe94bb6-234d-4c85-9d77-49c283e64b6d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a95cca-67fc-4c5b-b0fb-19a4938863d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:46 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Volume volume-3fe94bb6-234d-4c85-9d77-49c283e64b6d (3fe94bb6-234d-4c85-9d77-49c283e64b6d): created successfully
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a95cca-67fc-4c5b-b0fb-19a4938863d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] Flow 'volume_create_manager' (0835fe57-17e5-46e1-8b0f-715a7fe3f78c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:28:46 user cinder-volume[73792]: INFO cinder.action_track [None req-e75688c6-8686-46c8-8b9f-9f9692efeba9 tempest-VolumesActionsTest-190731565 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2104794616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3fe94bb6-234d-4c85-9d77-49c283e64b6d,launched_at=2023-04-12T06:28:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP usatbmAB L1abHPt3QMingl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:45Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:28:45Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'is_clone': False, 'name': 'v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355d050c-1fbc-458d-8770-7b7b7fce1e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f9f1d4-8a1f-4e30-b4f4-17879c9e35fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:46 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Volume volume-fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 (fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5): created successfully
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f9f1d4-8a1f-4e30-b4f4-17879c9e35fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] Flow 'volume_create_manager' (56a7d356-f5cf-46c6-9467-14277e317762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:28:46 user cinder-volume[73792]: INFO cinder.action_track [None req-7432c1aa-22a4-4887-b818-cc187ff375bb tempest-VolumesAdminNegativeTest-1313851069 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1405866328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5,launched_at=2023-04-12T06:28:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth='CHAP qkWfKHao ACnlPqc6kZXSQV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:28:46Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.coordination [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Acquiring lock "cinder-3fe94bb6-234d-4c85-9d77-49c283e64b6d-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.coordination [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Lock "cinder-3fe94bb6-234d-4c85-9d77-49c283e64b6d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] remove_export for volume: 3fe94bb6-234d-4c85-9d77-49c283e64b6d. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2104794616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3fe94bb6-234d-4c85-9d77-49c283e64b6d,launched_at=2023-04-12T06:28:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP usatbmAB L1abHPt3QMingl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:45Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:28:47Z,updated_at=2023-04-12T06:28:47Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] detach volume v_3fe94bb6-234d-4c85-9d77-49c283e64b6d from target iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d/luns/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d/luns/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d/luns/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d/luns/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] failed to remove resource iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d because of JDSS resource v_3fe94bb6-234d-4c85-9d77-49c283e64b6d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] delete target: iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] delete target iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] failed to remove resource iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d because of JDSS resource iqn.2010-10.org.openstack:3fe94bb6-234d-4c85-9d77-49c283e64b6d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] deleating volume v_3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] get snapshots for volume v_3fe94bb6-234d-4c85-9d77-49c283e64b6d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] get volume v_3fe94bb6-234d-4c85-9d77-49c283e64b6d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282343', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60268', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2598515084742078019', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '916e3af0a54a6db8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774167552', 'san:volume_id': '916e3af0a54a6db882b3bd46c43f78df2f7ff6c4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38307', 'name': 'v_3fe94bb6-234d-4c85-9d77-49c283e64b6d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] delete volume:v_3fe94bb6-234d-4c85-9d77-49c283e64b6d recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:47 user cinder-volume[73792]: INFO cinder.action_track [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1405866328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5,launched_at=2023-04-12T06:28:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth='CHAP qkWfKHao ACnlPqc6kZXSQV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:28:47Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:47 user cinder-volume[73792]: INFO cinder.action_track [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1405866328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5,launched_at=2023-04-12T06:28:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth='CHAP qkWfKHao ACnlPqc6kZXSQV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:28:47Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] create export for volume: fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] ensure volume fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] check if targe iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] create target and attach volume fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] create target iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3fe94bb6-234d-4c85-9d77-49c283e64b6d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] volume v_3fe94bb6-234d-4c85-9d77-49c283e64b6d deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:28:48 user cinder-volume[73792]: DEBUG cinder.quota [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Created reservations ['705e7261-74cb-48c9-85c0-5ed0f7eed50e', 'acf577c2-4d8e-4f19-ba57-be2e42c7f3f5', '89871c45-596f-4d35-906a-6522da7be2c7', '1d22e541-4fbd-4c0d-9bd2-b77aee832289'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:28:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:28:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:28:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774249472', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:28:48 user cinder-volume[73792]: DEBUG cinder.manager [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:28:48 user cinder-volume[73792]: INFO cinder.volume.manager [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Deleted volume successfully.
Apr 12 06:28:48 user cinder-volume[73792]: DEBUG cinder.coordination [None req-403edad9-26b2-40a2-8921-bfa165c62ddc tempest-VolumesActionsTest-487909795 None] Lock "cinder-3fe94bb6-234d-4c85-9d77-49c283e64b6d-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:28:49 user cinder-volume[73792]: INFO cinder.action_track [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1336247327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98ad45f6-cac6-46f5-abbb-53120e74efae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Flow 'volume_create_manager' (247b4d21-3ed5-4409-9f93-5ae736673ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f822a83-1e78-4ace-83ff-3c9bf17806f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f822a83-1e78-4ace-83ff-3c9bf17806f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1336247327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98ad45f6-cac6-46f5-abbb-53120e74efae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:28:49Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1c84f8-1111-4334-a33c-21420b022ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1c84f8-1111-4334-a33c-21420b022ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e0c50c-1f74-47ba-a30a-c0a0b9d72547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e0c50c-1f74-47ba-a30a-c0a0b9d72547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98ad45f6-cac6-46f5-abbb-53120e74efae', 'volume_name': 'volume-98ad45f6-cac6-46f5-abbb-53120e74efae', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0326e23-3463-410e-b798-b4e4a8c2fc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0326e23-3463-410e-b798-b4e4a8c2fc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a6a8b7-94a5-4fa6-9604-00e0ffc2f12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:49 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Volume 98ad45f6-cac6-46f5-abbb-53120e74efae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98ad45f6-cac6-46f5-abbb-53120e74efae', 'volume_size': 1}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] creating volume v_98ad45f6-cac6-46f5-abbb-53120e74efae. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] create volume {'name': 'v_98ad45f6-cac6-46f5-abbb-53120e74efae', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_98ad45f6-cac6-46f5-abbb-53120e74efae', 'is_clone': False, 'name': 'v_98ad45f6-cac6-46f5-abbb-53120e74efae'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a6a8b7-94a5-4fa6-9604-00e0ffc2f12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ad45f6-cac6-46f5-abbb-53120e74efae', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9f5c8e-1bf3-4177-9df2-0e172fe17917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:49 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Volume volume-98ad45f6-cac6-46f5-abbb-53120e74efae (98ad45f6-cac6-46f5-abbb-53120e74efae): created successfully
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9f5c8e-1bf3-4177-9df2-0e172fe17917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:49 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] Flow 'volume_create_manager' (247b4d21-3ed5-4409-9f93-5ae736673ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:28:49 user cinder-volume[73792]: INFO cinder.action_track [None req-51ee0dec-38ed-441e-84d0-60cbf086f868 tempest-VolumesActionsTest-190731565 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1336247327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98ad45f6-cac6-46f5-abbb-53120e74efae,launched_at=2023-04-12T06:28:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP HlcOiEwr HmkKUrwcq4620L',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:49Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:28:49Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Acquiring lock "cinder-98ad45f6-cac6-46f5-abbb-53120e74efae-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Lock "cinder-98ad45f6-cac6-46f5-abbb-53120e74efae-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] remove_export for volume: 98ad45f6-cac6-46f5-abbb-53120e74efae. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1336247327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98ad45f6-cac6-46f5-abbb-53120e74efae,launched_at=2023-04-12T06:28:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP HlcOiEwr HmkKUrwcq4620L',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:49Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:28:50Z,updated_at=2023-04-12T06:28:50Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] detach volume v_98ad45f6-cac6-46f5-abbb-53120e74efae from target iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae/luns/v_98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae/luns/v_98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae/luns/v_98ad45f6-cac6-46f5-abbb-53120e74efae'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae/luns/v_98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] failed to remove resource iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae because of JDSS resource v_98ad45f6-cac6-46f5-abbb-53120e74efae DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] delete target: iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] delete target iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] atach volume v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 to target iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] failed to remove resource iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae because of JDSS resource iqn.2010-10.org.openstack:98ad45f6-cac6-46f5-abbb-53120e74efae DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] deleating volume v_98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] get snapshots for volume v_98ad45f6-cac6-46f5-abbb-53120e74efae  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98ad45f6-cac6-46f5-abbb-53120e74efae/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98ad45f6-cac6-46f5-abbb-53120e74efae/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98ad45f6-cac6-46f5-abbb-53120e74efae/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] get volume v_98ad45f6-cac6-46f5-abbb-53120e74efae info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_98ad45f6-cac6-46f5-abbb-53120e74efae', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282346', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60277', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10180347800187266998', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cb0fdb83bd78ac5e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774142976', 'san:volume_id': 'cb0fdb83bd78ac5eb02702cbc4d822e1673a0cc7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36191', 'name': 'v_98ad45f6-cac6-46f5-abbb-53120e74efae', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] delete volume:v_98ad45f6-cac6-46f5-abbb-53120e74efae recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6632323033383335', 'lun': 0, 'mode': 'wt', 'name': 'v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'prod_id': 'Storage', 'scsi_id': 'f220383533809ef5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] add credentails to target iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98ad45f6-cac6-46f5-abbb-53120e74efae {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] volume v_98ad45f6-cac6-46f5-abbb-53120e74efae deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.quota [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Created reservations ['51b80785-0686-4539-a7f7-9c1f5df11157', '2a0d8d21-89a0-4da8-954f-b085b8a24897', 'da57e1ad-9e41-494b-8c3d-0801ce5f8ee4', '80ee637d-c2e0-46b5-8a77-8717a9c474bb'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 201, 'error': None, 'data': {'name': 'qkWfKHao'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] initialize_connection for fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=58,cinder:INSERT=6,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:28:51 user cinder-volume[73792]: INFO cinder.action_track [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkWfKHao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'efaa0182-6b6b-4dc3-9332-fa3a85d62c99'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1405866328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5,launched_at=2023-04-12T06:28:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth='CHAP qkWfKHao ACnlPqc6kZXSQV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:28:47Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=61,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:28:51 user cinder-volume[73792]: INFO cinder.action_track [req-fc10ba32-a626-465b-9b5a-5414f61e058e req-f64d18cc-818f-4e2a-8839-c5c87c142e36 tempest-VolumesAdminNegativeTest-1313851069 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1405866328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5,launched_at=2023-04-12T06:28:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth='CHAP qkWfKHao ACnlPqc6kZXSQV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:28:52Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774224896', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:28:52 user cinder-volume[73792]: DEBUG cinder.manager [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:28:52 user cinder-volume[73792]: INFO cinder.volume.manager [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Deleted volume successfully.
Apr 12 06:28:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f32142eb-512b-49bf-83bd-ea22193e0a69 tempest-VolumesActionsTest-487909795 None] Lock "cinder-98ad45f6-cac6-46f5-abbb-53120e74efae-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:28:52 user cinder-volume[73792]: INFO cinder.action_track [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1809032126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=cd2e287e-1fbf-46f4-8fc0-526ab8628c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:52 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:28:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Flow 'volume_create_manager' (bfae79c3-c89f-4561-a5d0-1484ce1f058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:28:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5307bc-d7d7-4cd4-9398-a2ee34a47dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5307bc-d7d7-4cd4-9398-a2ee34a47dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1809032126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=cd2e287e-1fbf-46f4-8fc0-526ab8628c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:28:53Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d6acb8-aeb5-4131-a77d-e330661772e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d6acb8-aeb5-4131-a77d-e330661772e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3baab58d-0dbf-4a57-a82d-1c6074eac5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3baab58d-0dbf-4a57-a82d-1c6074eac5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd2e287e-1fbf-46f4-8fc0-526ab8628c26', 'volume_name': 'volume-cd2e287e-1fbf-46f4-8fc0-526ab8628c26', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb28fab-2bfb-4452-92ad-68b8f26a9936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb28fab-2bfb-4452-92ad-68b8f26a9936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3d12bb-fb7c-4068-8c9b-4aee3d548acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:53 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Volume cd2e287e-1fbf-46f4-8fc0-526ab8628c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd2e287e-1fbf-46f4-8fc0-526ab8628c26', 'volume_size': 1}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] creating volume v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] create volume {'name': 'v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26', 'is_clone': False, 'name': 'v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3d12bb-fb7c-4068-8c9b-4aee3d548acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2e287e-1fbf-46f4-8fc0-526ab8628c26', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c74dcd-36f0-4666-94c8-122be1f9a076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:53 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Volume volume-cd2e287e-1fbf-46f4-8fc0-526ab8628c26 (cd2e287e-1fbf-46f4-8fc0-526ab8628c26): created successfully
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c74dcd-36f0-4666-94c8-122be1f9a076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] Flow 'volume_create_manager' (bfae79c3-c89f-4561-a5d0-1484ce1f058c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:28:53 user cinder-volume[73792]: INFO cinder.action_track [None req-2f5bd482-69ec-4525-a3d0-d302c563747c tempest-VolumesActionsTest-190731565 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1809032126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=cd2e287e-1fbf-46f4-8fc0-526ab8628c26,launched_at=2023-04-12T06:28:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP cWTiSbaX zr3uP04EmNKkyR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:53Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:28:53Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Acquiring lock "cinder-cd2e287e-1fbf-46f4-8fc0-526ab8628c26-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Lock "cinder-cd2e287e-1fbf-46f4-8fc0-526ab8628c26-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] remove_export for volume: cd2e287e-1fbf-46f4-8fc0-526ab8628c26. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1809032126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=cd2e287e-1fbf-46f4-8fc0-526ab8628c26,launched_at=2023-04-12T06:28:54Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP cWTiSbaX zr3uP04EmNKkyR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:53Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:28:54Z,updated_at=2023-04-12T06:28:54Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] detach volume v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 from target iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26/luns/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26/luns/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26/luns/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26/luns/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] failed to remove resource iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 because of JDSS resource v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] delete target: iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] delete target iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] failed to remove resource iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 because of JDSS resource iqn.2010-10.org.openstack:cd2e287e-1fbf-46f4-8fc0-526ab8628c26 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] deleating volume v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] get snapshots for volume v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] get volume v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282350', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60286', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9859595267830433681', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c3ded6addf49ac3f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774155264', 'san:volume_id': 'c3ded6addf49ac3fb54cb291148bc3e07ef3d474', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38329', 'name': 'v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] delete volume:v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] volume v_cd2e287e-1fbf-46f4-8fc0-526ab8628c26 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:28:55 user cinder-volume[73792]: DEBUG cinder.quota [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Created reservations ['65e2931b-2599-4cdc-8176-95ad04b0fc73', '5a05a761-672e-478e-aa10-62c72b44a0e6', '6018f494-d151-445a-98a8-bc29ce107cc1', '8025d669-d26d-409b-b05d-9b897e9bcc88'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:28:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:28:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:28:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774224896', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.manager [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:28:56 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Deleted volume successfully.
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a503cdc9-7bfa-46fc-8d6a-3a589b89d181 tempest-VolumesActionsTest-487909795 None] Lock "cinder-cd2e287e-1fbf-46f4-8fc0-526ab8628c26-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:28:56 user cinder-volume[73792]: INFO cinder.action_track [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1405866328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5,launched_at=2023-04-12T06:28:46Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth='CHAP qkWfKHao ACnlPqc6kZXSQV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:28:55Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] terminate connection for fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:28:56 user cinder-volume[73792]: INFO cinder.action_track [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1405866328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5,launched_at=2023-04-12T06:28:46Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth='CHAP qkWfKHao ACnlPqc6kZXSQV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:28:55Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] Deleting attachment efaa0182-6b6b-4dc3-9332-fa3a85d62c99. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] remove_export for volume: fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1405866328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5,launched_at=2023-04-12T06:28:46Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth='CHAP qkWfKHao ACnlPqc6kZXSQV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:28:55Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] detach volume v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 from target iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/luns/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/luns/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:56 user cinder-volume[73792]: INFO cinder.action_track [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1391140632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Flow 'volume_create_manager' (df4cd591-b5b4-45cb-83e8-82396757470d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90640d1a-f764-493f-838a-e89a00de4893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90640d1a-f764-493f-838a-e89a00de4893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1391140632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:28:57Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259fda1c-c683-43d3-be87-480bb6266f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259fda1c-c683-43d3-be87-480bb6266f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba1edb4-6070-4e5f-aef4-e7f72e6e75ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba1edb4-6070-4e5f-aef4-e7f72e6e75ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a', 'volume_name': 'volume-fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2946aa6-2261-417b-a1dc-5d8fe083ac03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2946aa6-2261-417b-a1dc-5d8fe083ac03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a1c693-69ea-4225-bfa4-906e6caace5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:56 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Volume fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a', 'volume_size': 1}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] creating volume v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] create volume {'name': 'v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/luns/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] delete target: iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] delete target iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b req-4468ed68-ce68-4d06-bea9-f4723efc2c52 tempest-VolumesAdminNegativeTest-1313851069 None] target iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a', 'is_clone': False, 'name': 'v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a1c693-69ea-4225-bfa4-906e6caace5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4c4810-e1d1-4015-9069-59386768c54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:28:57 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Volume volume-fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a (fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a): created successfully
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4c4810-e1d1-4015-9069-59386768c54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] Flow 'volume_create_manager' (df4cd591-b5b4-45cb-83e8-82396757470d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:28:57 user cinder-volume[73792]: INFO cinder.action_track [None req-de1f9cd1-f348-4386-8e75-02a13f54a7e0 tempest-VolumesActionsTest-190731565 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1391140632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a,launched_at=2023-04-12T06:28:57Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP HBikIcLJ kDm2ld3XYsRagF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:28:57Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Acquiring lock "cinder-fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Lock "cinder-fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] remove_export for volume: fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1391140632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a,launched_at=2023-04-12T06:28:57Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP HBikIcLJ kDm2ld3XYsRagF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:57Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:28:58Z,updated_at=2023-04-12T06:28:58Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] detach volume v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a from target iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a/luns/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a/luns/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a/luns/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a/luns/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] failed to remove resource iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a because of JDSS resource v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] delete target: iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] delete target iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] failed to remove resource iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a because of JDSS resource iqn.2010-10.org.openstack:fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] deleating volume v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] get snapshots for volume v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] get volume v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:28:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282354', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60291', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1575294765490763737', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '56548fc1f4320fa4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774142976', 'san:volume_id': '56548fc1f4320fa49a95bfa5ccad12ffa7864845', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36582', 'name': 'v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] delete volume:v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:28:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] volume v_fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:28:59 user cinder-volume[73792]: DEBUG cinder.quota [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Created reservations ['71b8a4fd-c0a4-46e9-8583-3007401c064f', 'fe14e24f-388b-4706-8d72-eb23810ef0cd', '351b2734-53ce-4b9a-94bf-723c81d2197e', '8a3640b4-8db9-4954-a147-2626a60865f6'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:28:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:28:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:28:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:28:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:28:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774224896', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:28:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:28:59 user cinder-volume[73792]: DEBUG cinder.manager [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:28:59 user cinder-volume[73792]: INFO cinder.volume.manager [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Deleted volume successfully.
Apr 12 06:28:59 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3da6210a-5afd-4e29-8b72-cd0f6fb03840 tempest-VolumesActionsTest-487909795 None] Lock "cinder-fd08e142-d9b7-42ed-b5fa-c6c23e2bad4a-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:29:00 user cinder-volume[73792]: INFO cinder.action_track [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-59400839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=05ea7371-709b-4688-9ec4-279d5e5eaa58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Flow 'volume_create_manager' (f8bd27f3-2b95-4f4c-b5a5-377bbd512346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a493ae67-de2c-492e-8ac9-8076516138ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a493ae67-de2c-492e-8ac9-8076516138ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-59400839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=05ea7371-709b-4688-9ec4-279d5e5eaa58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:29:00Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483006b6-2bf8-4aed-8833-31b48e710584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483006b6-2bf8-4aed-8833-31b48e710584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18eb10a2-0ddf-403f-9dc9-ca97af455e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18eb10a2-0ddf-403f-9dc9-ca97af455e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05ea7371-709b-4688-9ec4-279d5e5eaa58', 'volume_name': 'volume-05ea7371-709b-4688-9ec4-279d5e5eaa58', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6e9ade-9f2c-46ae-a428-1a836a086503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6e9ade-9f2c-46ae-a428-1a836a086503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799f26fa-206f-4f40-b451-276c54ea8f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:00 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Volume 05ea7371-709b-4688-9ec4-279d5e5eaa58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05ea7371-709b-4688-9ec4-279d5e5eaa58', 'volume_size': 1}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] creating volume v_05ea7371-709b-4688-9ec4-279d5e5eaa58. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] create volume {'name': 'v_05ea7371-709b-4688-9ec4-279d5e5eaa58', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_05ea7371-709b-4688-9ec4-279d5e5eaa58', 'is_clone': False, 'name': 'v_05ea7371-709b-4688-9ec4-279d5e5eaa58'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799f26fa-206f-4f40-b451-276c54ea8f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ea7371-709b-4688-9ec4-279d5e5eaa58', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06633559-b139-406a-a54b-a12845e80c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:01 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Volume volume-05ea7371-709b-4688-9ec4-279d5e5eaa58 (05ea7371-709b-4688-9ec4-279d5e5eaa58): created successfully
Apr 12 06:29:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06633559-b139-406a-a54b-a12845e80c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] Flow 'volume_create_manager' (f8bd27f3-2b95-4f4c-b5a5-377bbd512346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:01 user cinder-volume[73792]: INFO cinder.action_track [None req-0ce76098-07d5-4c1e-a4ea-424b96019f50 tempest-VolumesActionsTest-190731565 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-59400839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=05ea7371-709b-4688-9ec4-279d5e5eaa58,launched_at=2023-04-12T06:29:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP HKdtzOIE 5sHn2wIrCNe7W9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:29:00Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Acquiring lock "cinder-05ea7371-709b-4688-9ec4-279d5e5eaa58-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Lock "cinder-05ea7371-709b-4688-9ec4-279d5e5eaa58-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] remove_export for volume: 05ea7371-709b-4688-9ec4-279d5e5eaa58. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-59400839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=05ea7371-709b-4688-9ec4-279d5e5eaa58,launched_at=2023-04-12T06:29:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92928c7a0ed463bbd9020808578b263',provider_auth='CHAP HKdtzOIE 5sHn2wIrCNe7W9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:29:02Z,updated_at=2023-04-12T06:29:02Z,use_quota=True,user_id='13f5402fd38f40c08c30991ad78b7f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] detach volume v_05ea7371-709b-4688-9ec4-279d5e5eaa58 from target iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58/luns/v_05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58/luns/v_05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58/luns/v_05ea7371-709b-4688-9ec4-279d5e5eaa58'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58/luns/v_05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] failed to remove resource iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 because of JDSS resource v_05ea7371-709b-4688-9ec4-279d5e5eaa58 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] delete target: iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] delete target iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] failed to remove resource iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 because of JDSS resource iqn.2010-10.org.openstack:05ea7371-709b-4688-9ec4-279d5e5eaa58 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] deleating volume v_05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] get snapshots for volume v_05ea7371-709b-4688-9ec4-279d5e5eaa58  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05ea7371-709b-4688-9ec4-279d5e5eaa58/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05ea7371-709b-4688-9ec4-279d5e5eaa58/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05ea7371-709b-4688-9ec4-279d5e5eaa58/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] get volume v_05ea7371-709b-4688-9ec4-279d5e5eaa58 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_05ea7371-709b-4688-9ec4-279d5e5eaa58', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282358', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60296', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12209816294852592321', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2b47a3b02258c355', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774142976', 'san:volume_id': '2b47a3b02258c35514cd68f3c2586310fc872aee', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36593', 'name': 'v_05ea7371-709b-4688-9ec4-279d5e5eaa58', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] delete volume:v_05ea7371-709b-4688-9ec4-279d5e5eaa58 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05ea7371-709b-4688-9ec4-279d5e5eaa58 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] volume v_05ea7371-709b-4688-9ec4-279d5e5eaa58 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:29:03 user cinder-volume[73792]: DEBUG cinder.quota [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Created reservations ['f2abf6eb-06fd-45a6-87ea-02161dfc15a1', '66f0c770-e761-4322-b333-a3b95ab37db7', 'fb4a922b-b657-4dea-a473-ccd35fa3476c', '5207aea5-fa7b-44aa-87ab-2d5c76f540b3'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:29:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:29:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:29:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774224896', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:29:03 user cinder-volume[73792]: DEBUG cinder.manager [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:29:03 user cinder-volume[73792]: INFO cinder.volume.manager [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Deleted volume successfully.
Apr 12 06:29:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f879b93a-6a06-45bc-b337-b13a829f5c37 tempest-VolumesActionsTest-190731565 None] Lock "cinder-05ea7371-709b-4688-9ec4-279d5e5eaa58-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:29:08 user cinder-volume[73792]: INFO cinder.action_track [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538420119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8a97e458-f71b-43df-a273-03e227d9abff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0a755743544f7c97644faad13bdeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:08 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=34,cinder:SELECT=56,cinder:DELETE=4,cinder:INSERT=6 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Flow 'volume_create_manager' (d32235f7-fe9c-4d11-a8cb-311fa3e0e98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa96d0d-3ae8-4e09-9fca-a475ef3cbf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa96d0d-3ae8-4e09-9fca-a475ef3cbf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538420119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8a97e458-f71b-43df-a273-03e227d9abff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0a755743544f7c97644faad13bdeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:29:09Z,use_quota=True,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15faacc-0910-4dae-a524-bfadca8c228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15faacc-0910-4dae-a524-bfadca8c228e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723a28c3-74fe-47fe-bc1e-60c4a338ea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723a28c3-74fe-47fe-bc1e-60c4a338ea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a97e458-f71b-43df-a273-03e227d9abff', 'volume_name': 'volume-8a97e458-f71b-43df-a273-03e227d9abff', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9a1a7d-981a-4d86-8b42-afc4aa3cd9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9a1a7d-981a-4d86-8b42-afc4aa3cd9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693815dc-ad5f-41cc-bcff-1e9ee12860d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:09 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Volume 8a97e458-f71b-43df-a273-03e227d9abff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a97e458-f71b-43df-a273-03e227d9abff', 'volume_size': 1}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] creating volume v_8a97e458-f71b-43df-a273-03e227d9abff. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] create volume {'name': 'v_8a97e458-f71b-43df-a273-03e227d9abff', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8a97e458-f71b-43df-a273-03e227d9abff', 'is_clone': False, 'name': 'v_8a97e458-f71b-43df-a273-03e227d9abff'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693815dc-ad5f-41cc-bcff-1e9ee12860d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a97e458-f71b-43df-a273-03e227d9abff', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be247a14-a389-4da4-9ee1-1bc854d75941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:09 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Volume volume-8a97e458-f71b-43df-a273-03e227d9abff (8a97e458-f71b-43df-a273-03e227d9abff): created successfully
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be247a14-a389-4da4-9ee1-1bc854d75941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] Flow 'volume_create_manager' (d32235f7-fe9c-4d11-a8cb-311fa3e0e98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:09 user cinder-volume[73792]: INFO cinder.action_track [None req-40c6871b-1a33-4ae1-8384-3207bfd95dab tempest-VolumesActionsTest-1914558791 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538420119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8a97e458-f71b-43df-a273-03e227d9abff,launched_at=2023-04-12T06:29:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0a755743544f7c97644faad13bdeb4',provider_auth='CHAP LshCmFfD HEt5vaDiTkoS4g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:29:09Z,use_quota=True,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:09 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=60,cinder:DELETE=3,cinder:UPDATE=31,cinder:INSERT=6 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:29:11 user cinder-volume[73792]: INFO cinder.action_track [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-334060970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=55ee740a-2e2d-4d68-a7b5-964a0f53ea4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca90b5b5fb49ca857aa4e215a99e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='e761442395d14d7f82216e3d4174e43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Flow 'volume_create_manager' (39613711-decd-49d4-b91e-49345d293681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aedf3a6-10d9-4a25-baca-1bc8eae230df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aedf3a6-10d9-4a25-baca-1bc8eae230df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-334060970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=55ee740a-2e2d-4d68-a7b5-964a0f53ea4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca90b5b5fb49ca857aa4e215a99e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:29:12Z,use_quota=True,user_id='e761442395d14d7f82216e3d4174e43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0d32d6-4ae4-4d3e-81c1-9f5d7bb3aa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0d32d6-4ae4-4d3e-81c1-9f5d7bb3aa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1888c06-2baf-4afc-bdc7-74b2b178a3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1888c06-2baf-4afc-bdc7-74b2b178a3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ee740a-2e2d-4d68-a7b5-964a0f53ea4d', 'volume_name': 'volume-55ee740a-2e2d-4d68-a7b5-964a0f53ea4d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc761a2-560c-4550-8ee2-9a8cab37422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc761a2-560c-4550-8ee2-9a8cab37422c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57dd35f2-00dd-453c-9420-b3602b0951df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:11 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Volume 55ee740a-2e2d-4d68-a7b5-964a0f53ea4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ee740a-2e2d-4d68-a7b5-964a0f53ea4d', 'volume_size': 1}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] creating volume v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] create volume {'name': 'v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d', 'is_clone': False, 'name': 'v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57dd35f2-00dd-453c-9420-b3602b0951df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ee740a-2e2d-4d68-a7b5-964a0f53ea4d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4435f53d-5a09-4d4a-a8ad-abd47885e4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:12 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Volume volume-55ee740a-2e2d-4d68-a7b5-964a0f53ea4d (55ee740a-2e2d-4d68-a7b5-964a0f53ea4d): created successfully
Apr 12 06:29:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4435f53d-5a09-4d4a-a8ad-abd47885e4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] Flow 'volume_create_manager' (39613711-decd-49d4-b91e-49345d293681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:12 user cinder-volume[73792]: INFO cinder.action_track [None req-2351887b-f65f-4787-a47c-63249cee81f7 tempest-ServersNegativeTestJSON-815999574 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-334060970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=55ee740a-2e2d-4d68-a7b5-964a0f53ea4d,launched_at=2023-04-12T06:29:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca90b5b5fb49ca857aa4e215a99e37',provider_auth='CHAP tTgvRiNB ZUFivCPoTNHxue',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:29:12Z,use_quota=True,user_id='e761442395d14d7f82216e3d4174e43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:22 user cinder-volume[73792]: INFO cinder.action_track [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:22Z,deleted=False,deleted_at=None,display_description='',display_name='ebb36f74-c4a3-4108-949d-1fb8918f9a8c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9013e447-dbe0-46fc-97fe-c8d65768b297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Flow 'volume_create_manager' (e01a47ba-656d-47d9-9d96-1a5600a1ab54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b54ac1-8e8d-4827-9ae2-f01d8ccba20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b54ac1-8e8d-4827-9ae2-f01d8ccba20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:22Z,deleted=False,deleted_at=None,display_description='',display_name='ebb36f74-c4a3-4108-949d-1fb8918f9a8c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9013e447-dbe0-46fc-97fe-c8d65768b297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:29:22Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3786ef50-c94e-4183-ac7c-49731c462f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3786ef50-c94e-4183-ac7c-49731c462f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80489aab-540e-4f86-807a-93112c47660e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80489aab-540e-4f86-807a-93112c47660e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9013e447-dbe0-46fc-97fe-c8d65768b297', 'volume_name': 'volume-9013e447-dbe0-46fc-97fe-c8d65768b297', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19302e4e-71e2-4f3e-80de-18f02e048db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19302e4e-71e2-4f3e-80de-18f02e048db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19729ce3-2180-46ac-97a6-db5813186614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:22 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Volume 9013e447-dbe0-46fc-97fe-c8d65768b297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9013e447-dbe0-46fc-97fe-c8d65768b297', 'volume_size': 1}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] creating volume v_9013e447-dbe0-46fc-97fe-c8d65768b297. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] create volume {'name': 'v_9013e447-dbe0-46fc-97fe-c8d65768b297', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9013e447-dbe0-46fc-97fe-c8d65768b297', 'is_clone': False, 'name': 'v_9013e447-dbe0-46fc-97fe-c8d65768b297'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19729ce3-2180-46ac-97a6-db5813186614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9013e447-dbe0-46fc-97fe-c8d65768b297', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4997d70c-d4e2-4ef4-b62e-4b5aa0af2f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:22 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Volume volume-9013e447-dbe0-46fc-97fe-c8d65768b297 (9013e447-dbe0-46fc-97fe-c8d65768b297): created successfully
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4997d70c-d4e2-4ef4-b62e-4b5aa0af2f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Flow 'volume_create_manager' (e01a47ba-656d-47d9-9d96-1a5600a1ab54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:22 user cinder-volume[73792]: INFO cinder.action_track [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-40c291f9-ed1f-497e-859d-bfea42991904 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:22Z,deleted=False,deleted_at=None,display_description='',display_name='ebb36f74-c4a3-4108-949d-1fb8918f9a8c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9013e447-dbe0-46fc-97fe-c8d65768b297,launched_at=2023-04-12T06:29:22Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP KQizkfug 7qlAL9WOgiYBt6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:22Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:29:22Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:27 user cinder-volume[73792]: INFO cinder.action_track [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:22Z,deleted=False,deleted_at=None,display_description='',display_name='ebb36f74-c4a3-4108-949d-1fb8918f9a8c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9013e447-dbe0-46fc-97fe-c8d65768b297,launched_at=2023-04-12T06:29:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP KQizkfug 7qlAL9WOgiYBt6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:22Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:29:27Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:27 user cinder-volume[73792]: INFO cinder.action_track [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:22Z,deleted=False,deleted_at=None,display_description='',display_name='ebb36f74-c4a3-4108-949d-1fb8918f9a8c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9013e447-dbe0-46fc-97fe-c8d65768b297,launched_at=2023-04-12T06:29:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP KQizkfug 7qlAL9WOgiYBt6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:22Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:29:27Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] create export for volume: 9013e447-dbe0-46fc-97fe-c8d65768b297. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:29:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ensure volume 9013e447-dbe0-46fc-97fe-c8d65768b297 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:29:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] check if targe iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:29:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] create target and attach volume 9013e447-dbe0-46fc-97fe-c8d65768b297 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:29:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] create target iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:29:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:29:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:29:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:29:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] atach volume v_9013e447-dbe0-46fc-97fe-c8d65768b297 to target iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:29:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114773942272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:29:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:29:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3838393638393066', 'lun': 0, 'mode': 'wt', 'name': 'v_9013e447-dbe0-46fc-97fe-c8d65768b297', 'prod_id': 'Storage', 'scsi_id': '8896890f96f7e444'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] add credentails to target iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:29:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 201, 'error': None, 'data': {'name': 'KQizkfug'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] initialize_connection for 9013e447-dbe0-46fc-97fe-c8d65768b297 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:29:31 user cinder-volume[73792]: INFO cinder.action_track [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQizkfug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '86dae585-faec-4479-90d5-f67160f21e09'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:22Z,deleted=False,deleted_at=None,display_description='',display_name='ebb36f74-c4a3-4108-949d-1fb8918f9a8c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9013e447-dbe0-46fc-97fe-c8d65768b297,launched_at=2023-04-12T06:29:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP KQizkfug 7qlAL9WOgiYBt6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:22Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:29:27Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:31 user cinder-volume[73792]: INFO cinder.action_track [req-1d675fdf-ce24-41e7-8f7e-73e83a11390d req-db729d25-10ea-4b36-baf5-fc0c15a4af42 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:22Z,deleted=False,deleted_at=None,display_description='',display_name='ebb36f74-c4a3-4108-949d-1fb8918f9a8c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9013e447-dbe0-46fc-97fe-c8d65768b297,launched_at=2023-04-12T06:29:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP KQizkfug 7qlAL9WOgiYBt6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:22Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:29:32Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Acquiring lock "cinder-ff8cf913-7198-47e1-adda-fe9fff61c36b-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Lock "cinder-ff8cf913-7198-47e1-adda-fe9fff61c36b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] remove_export for volume: ff8cf913-7198-47e1-adda-fe9fff61c36b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-588781848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff8cf913-7198-47e1-adda-fe9fff61c36b,launched_at=2023-04-12T06:25:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP kSFTbZuW TUW7zRdYNlbn4B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:47Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=a2733057-27d3-4034-9b97-aaa88c74593e,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:29:32Z,updated_at=2023-04-12T06:29:32Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] detach volume v_ff8cf913-7198-47e1-adda-fe9fff61c36b from target iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/luns/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/luns/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/luns/v_ff8cf913-7198-47e1-adda-fe9fff61c36b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b/luns/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] failed to remove resource iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b because of JDSS resource v_ff8cf913-7198-47e1-adda-fe9fff61c36b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] delete target: iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] delete target iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] failed to remove resource iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b because of JDSS resource iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] deleating volume v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] get snapshots for volume v_ff8cf913-7198-47e1-adda-fe9fff61c36b  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff8cf913-7198-47e1-adda-fe9fff61c36b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff8cf913-7198-47e1-adda-fe9fff61c36b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff8cf913-7198-47e1-adda-fe9fff61c36b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] get volume v_ff8cf913-7198-47e1-adda-fe9fff61c36b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_a2733057-27d3-4034-9b97-aaa88c74593e@v_ff8cf913-7198-47e1-adda-fe9fff61c36b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ff8cf913-7198-47e1-adda-fe9fff61c36b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282165', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '60149', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6948250895300505224', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '90112', 'logicalused': '303104', 'compressratio': '6.16', 'rootcontext': 'none', 'default_scsi_id': '50d4aebf354e72ef', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773942272', 'san:volume_id': '50d4aebf354e72ef6f3dc621de3dd9a5b1e707e1', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '90112', 'objsetid': '37780', 'name': 'v_ff8cf913-7198-47e1-adda-fe9fff61c36b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '90112', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] delete snapshot v_ff8cf913-7198-47e1-adda-fe9fff61c36b of volume s_a2733057-27d3-4034-9b97-aaa88c74593e {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/snapshots/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/snapshots/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/snapshots/v_ff8cf913-7198-47e1-adda-fe9fff61c36b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] snapshot v_ff8cf913-7198-47e1-adda-fe9fff61c36b deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:29:33 user cinder-volume[73792]: DEBUG cinder.quota [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Created reservations ['129f6e6f-9200-41fa-87e9-670c083221b3', '54f563a8-18e0-405c-8699-89ff5454960d', 'c0f971e3-884a-4381-91b2-fe00486205a6', '0341b5e8-9ff8-49cd-aa65-a071df558048'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:29:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:29:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:29:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774106112', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:29:34 user cinder-volume[73792]: DEBUG cinder.manager [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:29:34 user cinder-volume[73792]: INFO cinder.volume.manager [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Deleted volume successfully.
Apr 12 06:29:34 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ab63e820-b680-42d8-962b-221dce5ef038 tempest-TestStampPattern-1782553765 None] Lock "cinder-ff8cf913-7198-47e1-adda-fe9fff61c36b-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:29:34 user cinder-volume[73792]: DEBUG cinder.coordination [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Acquiring lock "cinder-a2733057-27d3-4034-9b97-aaa88c74593e-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:29:34 user cinder-volume[73792]: DEBUG cinder.coordination [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Lock "cinder-a2733057-27d3-4034-9b97-aaa88c74593e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:29:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] deleating snapshot s_a2733057-27d3-4034-9b97-aaa88c74593e. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:29:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] get snapshots for volume s_a2733057-27d3-4034-9b97-aaa88c74593e  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:29:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] get volume s_a2733057-27d3-4034-9b97-aaa88c74593e info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:29:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881@s_a2733057-27d3-4034-9b97-aaa88c74593e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_a2733057-27d3-4034-9b97-aaa88c74593e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282155', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '60127', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7539903211041358934', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '871e83a99f8324f2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774106112', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '36723', 'name': 's_a2733057-27d3-4034-9b97-aaa88c74593e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2733057-27d3-4034-9b97-aaa88c74593e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] delete snapshot s_a2733057-27d3-4034-9b97-aaa88c74593e of volume v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:29:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881/snapshots/s_a2733057-27d3-4034-9b97-aaa88c74593e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881/snapshots/s_a2733057-27d3-4034-9b97-aaa88c74593e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881/snapshots/s_a2733057-27d3-4034-9b97-aaa88c74593e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] snapshot s_a2733057-27d3-4034-9b97-aaa88c74593e deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:29:35 user cinder-volume[73792]: DEBUG cinder.quota [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Created reservations ['45d0ed40-0d2a-4bdf-a493-e14909e967ae', '5f9c43a0-45f6-47a1-9a72-be92198d6bef', 'd272bf0b-ba07-4731-8d9a-e7c0492ea781', 'b15d4b5a-ba84-4f14-9477-7ded9c8712a8'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:29:35 user cinder-volume[73792]: INFO cinder.volume.manager [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Delete snapshot completed successfully.
Apr 12 06:29:35 user cinder-volume[73792]: DEBUG cinder.coordination [None req-e94ef894-7013-4afb-92d4-ae5ed87e9ced tempest-TestStampPattern-1782553765 None] Lock "cinder-a2733057-27d3-4034-9b97-aaa88c74593e-delete_snapshot" released by "delete_snapshot" :: held 1.214s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:29:38 user cinder-volume[73792]: INFO cinder.action_track [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1d71170c-9465-43e1-8597-e9e43011833c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6ac12ddd61b4c7680300eb9b70aaecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='305eff9fc1894c278c562b84cf9c440b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff95311-5674-4268-989b-9a15e11ce350),volume_type_id=0ff95311-5674-4268-989b-9a15e11ce350) 
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Flow 'volume_create_manager' (8e492d02-d255-4898-bfec-98a2234a9f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65db599-79f3-471c-8bd2-528e6ea028a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65db599-79f3-471c-8bd2-528e6ea028a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1d71170c-9465-43e1-8597-e9e43011833c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6ac12ddd61b4c7680300eb9b70aaecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:29:38Z,use_quota=True,user_id='305eff9fc1894c278c562b84cf9c440b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff95311-5674-4268-989b-9a15e11ce350),volume_type_id=0ff95311-5674-4268-989b-9a15e11ce350)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1c2756-0f48-40b2-8d95-d99dd572e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1c2756-0f48-40b2-8d95-d99dd572e97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01c8850-2c6a-46c8-8207-928e40ab7558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01c8850-2c6a-46c8-8207-928e40ab7558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d71170c-9465-43e1-8597-e9e43011833c', 'volume_name': 'volume-1d71170c-9465-43e1-8597-e9e43011833c', 'volume_size': 1, 'image_id': 'c9ffab82-71a7-4562-b3e1-a0342a4e44fa', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f659090623707c63b2056d8d974b228d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b6ac12ddd61b4c7680300eb9b70aaecb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04210d87e874b85bd044efe6e181a58431d5159223eebc5381dde97585013831189bccaaa70097dc30375adddcb1cb10d55be8afa24ee1a45597ee109b864d15', 'id': 'c9ffab82-71a7-4562-b3e1-a0342a4e44fa', 'created_at': datetime.datetime(2023, 4, 12, 6, 29, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 29, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9ffab82-71a7-4562-b3e1-a0342a4e44fa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f876021fa60>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a36a85-aeed-4eea-b9b7-5441f15200cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a36a85-aeed-4eea-b9b7-5441f15200cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e05024-c371-45a7-ae8b-76f1a4c242b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:38 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Volume 1d71170c-9465-43e1-8597-e9e43011833c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d71170c-9465-43e1-8597-e9e43011833c', 'volume_size': 1, 'image_id': 'c9ffab82-71a7-4562-b3e1-a0342a4e44fa', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f659090623707c63b2056d8d974b228d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b6ac12ddd61b4c7680300eb9b70aaecb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04210d87e874b85bd044efe6e181a58431d5159223eebc5381dde97585013831189bccaaa70097dc30375adddcb1cb10d55be8afa24ee1a45597ee109b864d15', 'id': 'c9ffab82-71a7-4562-b3e1-a0342a4e44fa', 'created_at': datetime.datetime(2023, 4, 12, 6, 29, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 29, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9ffab82-71a7-4562-b3e1-a0342a4e44fa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f876021fa60>}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Cloning 1d71170c-9465-43e1-8597-e9e43011833c from image c9ffab82-71a7-4562-b3e1-a0342a4e44fa  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.coordination [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Acquiring lock "cinder-c9ffab82-71a7-4562-b3e1-a0342a4e44fa" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.coordination [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Lock "cinder-c9ffab82-71a7-4562-b3e1-a0342a4e44fa" acquired by "_prepare_image_cache_entry" :: waited 0.034s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Preparing cache entry for image = c9ffab82-71a7-4562-b3e1-a0342a4e44fa on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Attempting to retrieve cache entry for image = c9ffab82-71a7-4562-b3e1-a0342a4e44fa on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG cinder.image.image_utils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2, size 0.00 MB, duration 1.00 sec {{(pid=73792) fetch /opt/stack/cinder/cinder/image/image_utils.py:628}}
Apr 12 06:29:38 user cinder-volume[73792]: INFO cinder.image.image_utils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Image download 0.00 MB at 0.00 MB/s
Apr 12 06:29:38 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2 {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:38 user sudo[89270]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2
Apr 12 06:29:38 user sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:29:39 user sudo[89270]: pam_unix(sudo:session): session closed for user root
Apr 12 06:29:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2" returned: 0 in 0.815s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:39 user cinder-volume[73792]: DEBUG cinder.image.image_utils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Temporary image c9ffab82-71a7-4562-b3e1-a0342a4e44fa is fetched for user 305eff9fc1894c278c562b84cf9c440b. {{(pid=73792) fetch /opt/stack/cinder/cinder/image/image_utils.py:1279}}
Apr 12 06:29:39 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=26,cinder:SELECT=48,cinder:DELETE=2,cinder:INSERT=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:29:39 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=55,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:29:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2 {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:39 user sudo[89298]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2
Apr 12 06:29:39 user sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:29:40 user sudo[89298]: pam_unix(sudo:session): session closed for user root
Apr 12 06:29:40 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2" returned: 0 in 0.744s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] creating volume v_1d71170c-9465-43e1-8597-e9e43011833c. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:29:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] create volume {'name': 'v_1d71170c-9465-43e1-8597-e9e43011833c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:29:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1d71170c-9465-43e1-8597-e9e43011833c', 'is_clone': False, 'name': 'v_1d71170c-9465-43e1-8597-e9e43011833c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Attempting download of c9ffab82-71a7-4562-b3e1-a0342a4e44fa ((None, None)) to volume 1d71170c-9465-43e1-8597-e9e43011833c. {{(pid=73792) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.driver [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] copy_image_to_volume volume-1d71170c-9465-43e1-8597-e9e43011833c. {{(pid=73792) _copy_image_data_to_volume /opt/stack/cinder/cinder/volume/driver.py:890}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG os_brick.utils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69c1fbd-6945-40cb-96e7-d3c322d691fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad8cd00-6f9a-40c6-adff-389eea9e35f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba967766-43dd-4f7e-a722-33db7fe6a78f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[710c5c62-8bbe-4829-b2c3-51ebf62192c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Running cmd (subprocess): nvme version {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] 'nvme version' failed. Not Retrying. {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] nvme not present on system {{(pid=73792) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:29:41 user cinder-volume[73792]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[38991e45-4e55-4dee-b48f-20af2030d2d7]: (4, '') {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.lightos [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73792) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.lightos [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73792) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.lightos [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] LIGHTOS: no hostnqn found. {{(pid=73792) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG os_brick.utils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.driver [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Volume 1d71170c-9465-43e1-8597-e9e43011833c: creating export {{(pid=73792) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] create export for volume: 1d71170c-9465-43e1-8597-e9e43011833c. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] ensure volume 1d71170c-9465-43e1-8597-e9e43011833c assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] check if targe iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] create target and attach volume 1d71170c-9465-43e1-8597-e9e43011833c to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] create target iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] atach volume v_1d71170c-9465-43e1-8597-e9e43011833c to target iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:29:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3863613836636430', 'lun': 0, 'mode': 'wt', 'name': 'v_1d71170c-9465-43e1-8597-e9e43011833c', 'prod_id': 'Storage', 'scsi_id': '8ca86cd034290535'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] add credentails to target iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:29:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 201, 'error': None, 'data': {'name': 'COwaDZrX'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] initialize_connection for 1d71170c-9465-43e1-8597-e9e43011833c 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connector [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Factory for iscsi on None {{(pid=73792) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f876a0afe50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COwaDZrX', 'auth_password': '***', 'target_lun': False}}" {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:29:45 user cinder-volume[73792]: INFO os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[5127d389-7e78-4fe2-830f-26dc394601a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:29:45 user cinder-volume[73792]:  {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --interface default --op new {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d7dc45-d9f0-4e29-b282-6233e98e823b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c] added\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c] added
Apr 12 06:29:45 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cade362-0281-4140-9a6b-dedd19442e02]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba50f7b-b71b-4000-9a69-1ce1a61522dd]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v COwaDZrX {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v COwaDZrX" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[779f130f-ca06-4590-bd9e-e6d42b38f6a4]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'COwaDZrX'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[494e8966-7f18-44a3-ad9b-d7cbd18684b9]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[24be6d84-ecfd-4c14-a647-bd25e5a6dc98]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:29:45 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:29:45 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --login {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[383dbb14-c21a-4237-984c-d2be0cf36e05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c, portal: 172.16.0.220,3260]
Apr 12 06:29:45 user cinder-volume[73792]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c, portal: 172.16.0.220,3260] successful.
Apr 12 06:29:45 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a85706a-1de4-45ac-84e0-295ba5201630]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb4dc38-f96b-4d2a-90e8-5062c897c530]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c (non-flash)\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:29:45 user cinder-volume[73792]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c (non-flash)
Apr 12 06:29:45 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:29:45 user cinder-volume[73792]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c (non-flash)
Apr 12 06:29:45 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Connected to 172.16.0.220:3260 {{(pid=73792) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=73792) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Scanning host 34 c: -, t: -, l: 0) {{(pid=73792) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d7f953-9826-484c-99cb-1b040c98b7d0]: (4, ('- - 0', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73792) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:29:45 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COwaDZrX', 'auth_password': '***', 'target_lun': False} {{(pid=73792) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:29:46 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:29:46 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23863613836636430', 'path': '/dev/sdc'} {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:29:46 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdc of=/dev/null count=1 {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:46 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdc of=/dev/null count=1" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:46 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b35449-6af0-442b-ae66-31d60422de5d]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.00283158 s, 181 kB/s\n')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:46 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_yyyqg3gx {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:46 user sudo[89367]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_yyyqg3gx
Apr 12 06:29:46 user sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:29:47 user sudo[89367]: pam_unix(sudo:session): session closed for user root
Apr 12 06:29:47 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_yyyqg3gx" returned: 0 in 0.774s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:47 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2 {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user sudo[89385]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2
Apr 12 06:29:47 user sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:29:47 user sudo[89385]: pam_unix(sudo:session): session closed for user root
Apr 12 06:29:47 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2" returned: 0 in 0.750s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:47 user cinder-volume[73792]: DEBUG cinder.image.image_utils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] c9ffab82-71a7-4562-b3e1-a0342a4e44fa was raw, converting to raw {{(pid=73792) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:976}}
Apr 12 06:29:47 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2 of=/dev/sdc oflag=direct {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user sudo[89411]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2 of=/dev/sdc oflag=direct
Apr 12 06:29:47 user sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:29:48 user sudo[89411]: pam_unix(sudo:session): session closed for user root
Apr 12 06:29:48 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2 of=/dev/sdc oflag=direct" returned: 0 in 0.646s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:48 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2 /dev/sdc {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:48 user sudo[89440]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2 /dev/sdc
Apr 12 06:29:48 user sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:29:49 user sudo[89440]: pam_unix(sudo:session): session closed for user root
Apr 12 06:29:49 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2 /dev/sdc" returned: 0 in 0.762s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:49 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2 {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:49 user sudo[89466]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2
Apr 12 06:29:49 user sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:29:50 user sudo[89466]: pam_unix(sudo:session): session closed for user root
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2" returned: 0 in 0.812s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.image.image_utils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c9ffab82-71a7-4562-b3e1-a0342a4e44fa_3er79mceuser@joviandss-2, size 0.00 MB, duration 1.00 sec, destination /dev/sdc {{(pid=73792) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:432}}
Apr 12 06:29:50 user cinder-volume[73792]: INFO cinder.image.image_utils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Converted 0.00 MB image at 0.00 MB/s
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f876a0afe50>, {'target_iqn': 'iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COwaDZrX', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '23863613836636430', 'path': '/dev/sdc'}), 'kwargs': {'force': False}}" {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[95503582-00be-4da8-9c92-4e87ba9a5c93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:29:50 user cinder-volume[73792]: No targets found.
Apr 12 06:29:50 user cinder-volume[73792]: iSNS:
Apr 12 06:29:50 user cinder-volume[73792]: No targets found.
Apr 12 06:29:50 user cinder-volume[73792]: STATIC:
Apr 12 06:29:50 user cinder-volume[73792]: Target: iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c
Apr 12 06:29:50 user cinder-volume[73792]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:29:50 user cinder-volume[73792]:                 Iface Name: default
Apr 12 06:29:50 user cinder-volume[73792]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:29:50 user cinder-volume[73792]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:29:50 user cinder-volume[73792]:                 Iface Name: default
Apr 12 06:29:50 user cinder-volume[73792]: FIRMWARE:
Apr 12 06:29:50 user cinder-volume[73792]: No targets found.
Apr 12 06:29:50 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:29:50 user cinder-volume[73792]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:29:50 user cinder-volume[73792]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=73792) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c', 0)] {{(pid=73792) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a258f31-4ab6-44da-9e83-789114ac4738]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5af6e81-9a13-40c8-809e-fdf6022b8049]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c (non-flash)\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:29:50 user cinder-volume[73792]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c (non-flash)
Apr 12 06:29:50 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:29:50 user cinder-volume[73792]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c (non-flash)
Apr 12 06:29:50 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8769e45d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c'): ({'sdc'}, set())}) {{(pid=73792) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Removing single pathed devices sdc {{(pid=73792) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e3c85a-e240-4a38-9d39-9d439b490043]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca2151e-a92a-4215-a4bf-970bf1431b9e]: (4, ('ok\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Flushing IO for device /dev/sdc {{(pid=73792) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c16a13-8e0a-494e-b2ae-d0f3d01441a4]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73792) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[899b499c-78f1-4609-9034-2f26fbe095f1]: (4, ('1', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=73792) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] SCSI volumes sdc have been removed. {{(pid=73792) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c')] {{(pid=73792) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73121cd-c6d6-4204-b1a1-c7f39bbcb477]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --logout {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cefd9d-7d0d-4733-838d-0c03edbb3805]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c, portal: 172.16.0.220,3260]
Apr 12 06:29:50 user cinder-volume[73792]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c, portal: 172.16.0.220,3260] successful.
Apr 12 06:29:50 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op delete {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8485e73-a1c8-4648-a904-0e3b0db8c587]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] <== disconnect_volume: return (266ms) None {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] terminate connection for 1d71170c-9465-43e1-8597-e9e43011833c  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.driver [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] volume 1d71170c-9465-43e1-8597-e9e43011833c: removing export {{(pid=73792) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] remove_export for volume: 1d71170c-9465-43e1-8597-e9e43011833c. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1d71170c-9465-43e1-8597-e9e43011833c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6ac12ddd61b4c7680300eb9b70aaecb',provider_auth='CHAP COwaDZrX nPx6tcJRO8KGZQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='downloading',terminated_at=None,updated_at=2023-04-12T06:29:38Z,use_quota=True,user_id='305eff9fc1894c278c562b84cf9c440b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff95311-5674-4268-989b-9a15e11ce350),volume_type_id=0ff95311-5674-4268-989b-9a15e11ce350) from target:iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] detach volume v_1d71170c-9465-43e1-8597-e9e43011833c from target iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/luns/v_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/luns/v_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/luns/v_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] delete target: iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] delete target iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] target iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Downloaded image c9ffab82-71a7-4562-b3e1-a0342a4e44fa ((None, None)) to volume 1d71170c-9465-43e1-8597-e9e43011833c successfully. {{(pid=73792) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.image.image_utils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Temporary image c9ffab82-71a7-4562-b3e1-a0342a4e44fa for user 305eff9fc1894c278c562b84cf9c440b is deleted. {{(pid=73792) fetch /opt/stack/cinder/cinder/image/image_utils.py:1283}}
Apr 12 06:29:51 user cinder-volume[73792]: WARNING cinder.quota [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:29:51 user cinder-volume[73792]: WARNING cinder.quota [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.quota [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Created reservations ['663b712e-b17b-4486-8632-9a590022277f', '93fb8c50-be66-4906-935c-990bd4f3af87', '77418335-8090-476f-9339-f5af9aff6a03', 'a4b3083d-c8b2-4b60-a002-c565e3f8091d'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Creating image volume entry: {'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'replication_driver_data': None, 'updated_at': datetime.datetime(2023, 4, 12, 6, 29, 38, tzinfo=datetime.timezone.utc), 'provider_id': None, 'created_at': datetime.datetime(2023, 4, 12, 6, 29, 38, tzinfo=datetime.timezone.utc), 'provider_auth': 'CHAP COwaDZrX nPx6tcJRO8KGZQ', 'user_id': '305eff9fc1894c278c562b84cf9c440b', 'display_description': None, 'ec2_id': None, 'scheduled_at': datetime.datetime(2023, 4, 12, 6, 29, 38, tzinfo=datetime.timezone.utc), 'metadata': {}, 'volume_metadata': [], 'host': 'user@joviandss-2#joviandss-2', 'consistencygroup_id': None, 'project_id': '47ae5d35908f49c5b6139fe1fea0ac76', 'terminated_at': None, 'cluster_name': None, 'volume_type_id': '0ff95311-5674-4268-989b-9a15e11ce350', 'volume_admin_metadata': [], 'display_name': 'image-c9ffab82-71a7-4562-b3e1-a0342a4e44fa', 'shared_targets': True, 'provider_geometry': None, 'group_id': None, 'size': 1, 'availability_zone': 'nova', 'replication_status': None, 'launched_at': None, 'deleted': False, 'encryption_key_id': None, 'replication_extended_status': None, 'previous_status': None, 'provider_location': '172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c 0', 'service_uuid': None, 'multiattach': False, 'deleted_at': None, 'bootable': False, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '1d71170c-9465-43e1-8597-e9e43011833c'}. {{(pid=73792) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1679}}
Apr 12 06:29:51 user cinder-volume[73792]: INFO cinder.action_track [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='image-c9ffab82-71a7-4562-b3e1-a0342a4e44fa',ec2_id=None,encryption_key_id=None,glance_metadata={signature_verified='False'},group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8b1b030c-45e4-4132-b846-583c469a4a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ae5d35908f49c5b6139fe1fea0ac76',provider_auth='CHAP COwaDZrX nPx6tcJRO8KGZQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=1d71170c-9465-43e1-8597-e9e43011833c,status='creating',terminated_at=None,updated_at=2023-04-12T06:29:38Z,use_quota=True,user_id='305eff9fc1894c278c562b84cf9c440b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff95311-5674-4268-989b-9a15e11ce350),volume_type_id=0ff95311-5674-4268-989b-9a15e11ce350) 
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Volume reschedule parameters: False retry: None {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Flow 'volume_create_manager' (6fcb8cba-1977-487f-8e6b-ac58e3353a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191f1c73-c8f4-4a2f-b126-715db05891c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191f1c73-c8f4-4a2f-b126-715db05891c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='image-c9ffab82-71a7-4562-b3e1-a0342a4e44fa',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8b1b030c-45e4-4132-b846-583c469a4a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ae5d35908f49c5b6139fe1fea0ac76',provider_auth='CHAP COwaDZrX nPx6tcJRO8KGZQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=1d71170c-9465-43e1-8597-e9e43011833c,status='creating',terminated_at=None,updated_at=2023-04-12T06:29:38Z,use_quota=True,user_id='305eff9fc1894c278c562b84cf9c440b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff95311-5674-4268-989b-9a15e11ce350),volume_type_id=0ff95311-5674-4268-989b-9a15e11ce350)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b271bfd8-bbf2-46d8-8882-bb801c8ee652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b271bfd8-bbf2-46d8-8882-bb801c8ee652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a717780a-92dd-4a7e-b2f5-a8c2facc8aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a717780a-92dd-4a7e-b2f5-a8c2facc8aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8b1b030c-45e4-4132-b846-583c469a4a8a', 'volume_name': 'volume-8b1b030c-45e4-4132-b846-583c469a4a8a', 'volume_size': 1, 'source_volid': '1d71170c-9465-43e1-8597-e9e43011833c', 'source_volstatus': 'downloading'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a91d30-eee4-4296-a9a3-a66c4cd0f5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a91d30-eee4-4296-a9a3-a66c4cd0f5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e47b2e-8cfd-4a1a-9da8-ccc1e68c8377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:51 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Volume 8b1b030c-45e4-4132-b846-583c469a4a8a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8b1b030c-45e4-4132-b846-583c469a4a8a', 'volume_size': 1, 'source_volid': '1d71170c-9465-43e1-8597-e9e43011833c', 'source_volstatus': 'downloading'}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] cloned volume 1d71170c-9465-43e1-8597-e9e43011833c to 8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] cloning v_1d71170c-9465-43e1-8597-e9e43011833c to v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] create snapshot v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1d71170c-9465-43e1-8597-e9e43011833c/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1d71170c-9465-43e1-8597-e9e43011833c/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_8b1b030c-45e4-4132-b846-583c469a4a8a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1d71170c-9465-43e1-8597-e9e43011833c/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] create volume v_8b1b030c-45e4-4132-b846-583c469a4a8a from snapshot v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1d71170c-9465-43e1-8597-e9e43011833c/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1d71170c-9465-43e1-8597-e9e43011833c/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1d71170c-9465-43e1-8597-e9e43011833c@v_8b1b030c-45e4-4132-b846-583c469a4a8a', 'is_clone': True, 'full_name': 'Pool-0/v_8b1b030c-45e4-4132-b846-583c469a4a8a', 'name': 'v_8b1b030c-45e4-4132-b846-583c469a4a8a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1d71170c-9465-43e1-8597-e9e43011833c/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] get volume v_8b1b030c-45e4-4132-b846-583c469a4a8a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1d71170c-9465-43e1-8597-e9e43011833c@v_8b1b030c-45e4-4132-b846-583c469a4a8a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8b1b030c-45e4-4132-b846-583c469a4a8a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282409', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '60344', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7865220848635020394', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5fc9569bab22ebeb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774032384', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '36207', 'name': 'v_8b1b030c-45e4-4132-b846-583c469a4a8a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e47b2e-8cfd-4a1a-9da8-ccc1e68c8377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b1b030c-45e4-4132-b846-583c469a4a8a', 'volume_size': 1, 'source_volid': '1d71170c-9465-43e1-8597-e9e43011833c', 'source_volstatus': 'downloading'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094f90bd-a7b9-4bcc-8a27-2b060d8f0979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:52 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Volume volume-8b1b030c-45e4-4132-b846-583c469a4a8a (8b1b030c-45e4-4132-b846-583c469a4a8a): created successfully
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094f90bd-a7b9-4bcc-8a27-2b060d8f0979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Flow 'volume_create_manager' (6fcb8cba-1977-487f-8e6b-ac58e3353a7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:52 user cinder-volume[73792]: INFO cinder.action_track [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='image-c9ffab82-71a7-4562-b3e1-a0342a4e44fa',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8b1b030c-45e4-4132-b846-583c469a4a8a,launched_at=2023-04-12T06:29:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ae5d35908f49c5b6139fe1fea0ac76',provider_auth='CHAP hamMelyq yoQc4L3hgb8HZ1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:38Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=1d71170c-9465-43e1-8597-e9e43011833c,status='available',terminated_at=None,updated_at=2023-04-12T06:29:38Z,use_quota=True,user_id='305eff9fc1894c278c562b84cf9c440b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff95311-5674-4268-989b-9a15e11ce350),volume_type_id=0ff95311-5674-4268-989b-9a15e11ce350) 
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Creating new image-volume cache entry for image c9ffab82-71a7-4562-b3e1-a0342a4e44fa on user@joviandss-2#joviandss-2 {{(pid=73792) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] New image-volume cache entry created: {'id': 2, 'image_id': 'c9ffab82-71a7-4562-b3e1-a0342a4e44fa', 'volume_id': '8b1b030c-45e4-4132-b846-583c469a4a8a', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 29, 38), 'last_used': datetime.datetime(2023, 4, 12, 6, 29, 52, 473424)}. {{(pid=73792) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Lock "cinder-c9ffab82-71a7-4562-b3e1-a0342a4e44fa" released by "_prepare_image_cache_entry" :: held 13.781s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Marking volume 1d71170c-9465-43e1-8597-e9e43011833c as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Copying metadata from image c9ffab82-71a7-4562-b3e1-a0342a4e44fa to 1d71170c-9465-43e1-8597-e9e43011833c. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Creating volume glance metadata for volume 1d71170c-9465-43e1-8597-e9e43011833c backed by image c9ffab82-71a7-4562-b3e1-a0342a4e44fa with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c9ffab82-71a7-4562-b3e1-a0342a4e44fa', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f659090623707c63b2056d8d974b228d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e05024-c371-45a7-ae8b-76f1a4c242b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d71170c-9465-43e1-8597-e9e43011833c', 'volume_size': 1, 'image_id': 'c9ffab82-71a7-4562-b3e1-a0342a4e44fa', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f659090623707c63b2056d8d974b228d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b6ac12ddd61b4c7680300eb9b70aaecb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04210d87e874b85bd044efe6e181a58431d5159223eebc5381dde97585013831189bccaaa70097dc30375adddcb1cb10d55be8afa24ee1a45597ee109b864d15', 'id': 'c9ffab82-71a7-4562-b3e1-a0342a4e44fa', 'created_at': datetime.datetime(2023, 4, 12, 6, 29, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 29, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9ffab82-71a7-4562-b3e1-a0342a4e44fa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f876021fa60>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b403057-3ba0-4bfe-b4bf-06015bde7fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:52 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Volume volume-1d71170c-9465-43e1-8597-e9e43011833c (1d71170c-9465-43e1-8597-e9e43011833c): created successfully
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b403057-3ba0-4bfe-b4bf-06015bde7fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Flow 'volume_create_manager' (8e492d02-d255-4898-bfec-98a2234a9f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:52 user cinder-volume[73792]: INFO cinder.action_track [None req-77bb144e-89fa-4258-8b9c-92cc9649abf2 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata={signature_verified='False'},group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1d71170c-9465-43e1-8597-e9e43011833c,launched_at=2023-04-12T06:29:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6ac12ddd61b4c7680300eb9b70aaecb',provider_auth='CHAP COwaDZrX nPx6tcJRO8KGZQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:38Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:29:38Z,use_quota=True,user_id='305eff9fc1894c278c562b84cf9c440b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff95311-5674-4268-989b-9a15e11ce350),volume_type_id=0ff95311-5674-4268-989b-9a15e11ce350) 
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Acquiring lock "cinder-1d71170c-9465-43e1-8597-e9e43011833c-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Lock "cinder-1d71170c-9465-43e1-8597-e9e43011833c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] remove_export for volume: 1d71170c-9465-43e1-8597-e9e43011833c. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1d71170c-9465-43e1-8597-e9e43011833c,launched_at=2023-04-12T06:29:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6ac12ddd61b4c7680300eb9b70aaecb',provider_auth='CHAP COwaDZrX nPx6tcJRO8KGZQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:38Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:29:53Z,updated_at=2023-04-12T06:29:53Z,use_quota=True,user_id='305eff9fc1894c278c562b84cf9c440b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff95311-5674-4268-989b-9a15e11ce350),volume_type_id=0ff95311-5674-4268-989b-9a15e11ce350) from target:iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] detach volume v_1d71170c-9465-43e1-8597-e9e43011833c from target iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/luns/v_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/luns/v_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/luns/v_1d71170c-9465-43e1-8597-e9e43011833c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c/luns/v_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] failed to remove resource iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c because of JDSS resource v_1d71170c-9465-43e1-8597-e9e43011833c DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] delete target: iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] delete target iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] failed to remove resource iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c because of JDSS resource iqn.2010-10.org.openstack:1d71170c-9465-43e1-8597-e9e43011833c DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] deleating volume v_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] get snapshots for volume v_1d71170c-9465-43e1-8597-e9e43011833c  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1d71170c-9465-43e1-8597-e9e43011833c/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1d71170c-9465-43e1-8597-e9e43011833c/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '61440', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-12 08:53:29', 'volsize': '1073741824', 'createtxg': '60343', 'guid': '15827991401328386098', 'compressratio': '4.87', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '61440', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '4.87', 'fscontext': 'none', 'clones': 'Pool-0/v_8b1b030c-45e4-4132-b846-583c469a4a8a', 'objsetid': '36201', 'name': 'v_8b1b030c-45e4-4132-b846-583c469a4a8a', 'defer_destroy': 'off', 'san:volume_id': '8ca86cd034290535c8968fdd204b150382537e89', 'mlslabel': 'none', 'logicalreferenced': '159744', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1d71170c-9465-43e1-8597-e9e43011833c/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] volume v_1d71170c-9465-43e1-8597-e9e43011833c updated {{(pid=73792) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}}
Apr 12 06:29:54 user cinder-volume[73792]: DEBUG cinder.quota [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Created reservations ['0c709a90-ebed-4e56-8354-981b6803204b', '148d46b9-019c-46d6-ad38-0147cb077b6c', '07169ade-68f5-40f3-b9bd-732cabdd8200', '94f43cf8-b3f8-41d5-a5e4-8c666625c259'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:29:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:29:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:29:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774020096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.manager [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:29:55 user cinder-volume[73792]: INFO cinder.volume.manager [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Deleted volume successfully.
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1089f961-52cc-47d6-97b1-4a0211c5ee92 tempest-VolumeAndVolumeTypeFromImageTest-1915392132 None] Lock "cinder-1d71170c-9465-43e1-8597-e9e43011833c-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.coordination [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Acquiring lock "cinder-8b1b030c-45e4-4132-b846-583c469a4a8a-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.coordination [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Lock "cinder-8b1b030c-45e4-4132-b846-583c469a4a8a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] remove_export for volume: 8b1b030c-45e4-4132-b846-583c469a4a8a. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='True'},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='image-c9ffab82-71a7-4562-b3e1-a0342a4e44fa',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8b1b030c-45e4-4132-b846-583c469a4a8a,launched_at=2023-04-12T06:29:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ae5d35908f49c5b6139fe1fea0ac76',provider_auth='CHAP hamMelyq yoQc4L3hgb8HZ1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:38Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=1d71170c-9465-43e1-8597-e9e43011833c,status='deleting',terminated_at=2023-04-12T06:29:56Z,updated_at=2023-04-12T06:29:56Z,use_quota=True,user_id='305eff9fc1894c278c562b84cf9c440b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff95311-5674-4268-989b-9a15e11ce350),volume_type_id=0ff95311-5674-4268-989b-9a15e11ce350) from target:iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] detach volume v_8b1b030c-45e4-4132-b846-583c469a4a8a from target iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a/luns/v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a/luns/v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a/luns/v_8b1b030c-45e4-4132-b846-583c469a4a8a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a/luns/v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] failed to remove resource iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a because of JDSS resource v_8b1b030c-45e4-4132-b846-583c469a4a8a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] delete target: iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] delete target iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] failed to remove resource iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a because of JDSS resource iqn.2010-10.org.openstack:8b1b030c-45e4-4132-b846-583c469a4a8a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] deleating volume v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] get snapshots for volume v_8b1b030c-45e4-4132-b846-583c469a4a8a  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b1b030c-45e4-4132-b846-583c469a4a8a/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b1b030c-45e4-4132-b846-583c469a4a8a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b1b030c-45e4-4132-b846-583c469a4a8a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] get volume v_8b1b030c-45e4-4132-b846-583c469a4a8a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_1d71170c-9465-43e1-8597-e9e43011833c@v_8b1b030c-45e4-4132-b846-583c469a4a8a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8b1b030c-45e4-4132-b846-583c469a4a8a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282409', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '60344', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7865220848635020394', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5fc9569bab22ebeb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774020096', 'san:volume_id': '5fc9569bab22ebeb4de6bca0bc0774c5bf4b1389', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '36207', 'name': 'v_8b1b030c-45e4-4132-b846-583c469a4a8a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '8192', 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8b1b030c-45e4-4132-b846-583c469a4a8a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] get snapshots for volume t_1d71170c-9465-43e1-8597-e9e43011833c  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_1d71170c-9465-43e1-8597-e9e43011833c/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_1d71170c-9465-43e1-8597-e9e43011833c/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '61440', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-12 08:53:29', 'volsize': '1073741824', 'createtxg': '60343', 'guid': '15827991401328386098', 'compressratio': '4.87', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '61440', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '4.87', 'fscontext': 'none', 'clones': 'Pool-0/v_8b1b030c-45e4-4132-b846-583c469a4a8a', 'objsetid': '36201', 'name': 'v_8b1b030c-45e4-4132-b846-583c469a4a8a', 'defer_destroy': 'off', 'san:volume_id': '8ca86cd034290535c8968fdd204b150382537e89', 'mlslabel': 'none', 'logicalreferenced': '159744', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_1d71170c-9465-43e1-8597-e9e43011833c/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] get volume t_1d71170c-9465-43e1-8597-e9e43011833c info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_1d71170c-9465-43e1-8597-e9e43011833c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282398', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '60329', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13899697954095015799', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '159744', 'compressratio': '4.87', 'rootcontext': 'none', 'default_scsi_id': '8ca86cd034290535', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774020096', 'san:volume_id': '8ca86cd034290535c8968fdd204b150382537e89', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '61440', 'objsetid': '38342', 'name': 't_1d71170c-9465-43e1-8597-e9e43011833c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '61440', 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] delete volume:t_1d71170c-9465-43e1-8597-e9e43011833c recursively children:{'recursively_children': True, 'recursively_dependents': True, 'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Geting {'code': 500, 'error': {'class': 'opene.storage.zfs.ZfsOeError', 'message': 'In order to delete a zvol, you must delete all of its clones first.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_1d71170c-9465-43e1-8597-e9e43011833c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_1d71170c-9465-43e1-8597-e9e43011833c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:29:56 user cinder-volume[73792]: DEBUG cinder.coordination [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Lock "cinder-8b1b030c-45e4-4132-b846-583c469a4a8a-delete_volume" released by "delete_volume" :: held 0.971s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server [None req-447dd25c-8d01-4538-a84d-42772639bbf3 tempest-VolumeAndVolumeTypeFromImageTest-291305706 None] Exception during message handling: KeyError: 'errno'
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 204, in wrapper
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, volume, *args, **kwargs)
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1042, in delete_volume
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1031, in delete_volume
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     self.driver.delete_volume(volume)
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 286, in delete_volume
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     self._gc_delete(vname)
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 305, in _gc_delete
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     self._delete_back_recursively(jcom.origin_volume(vol['origin']),
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 374, in _delete_back_recursively
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     self.ra.delete_lun(opvname,
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 360, in delete_lun
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     if resp["error"]["errno"] == 1000:
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server KeyError: 'errno'
Apr 12 06:29:56 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server 
Apr 12 06:29:59 user cinder-volume[73792]: INFO cinder.action_track [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1266856088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=94b982a0-ccc4-41c8-8efc-fd6785e9c211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Flow 'volume_create_manager' (d34e4f5d-b804-456f-91a7-29ea678dd77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1849f196-41aa-4017-813c-c841a2dd704f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=58,cinder:INSERT=15,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1849f196-41aa-4017-813c-c841a2dd704f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1266856088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=94b982a0-ccc4-41c8-8efc-fd6785e9c211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:30:00Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f6d7d4-daf3-4b55-ab3d-370b4dad8fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f6d7d4-daf3-4b55-ab3d-370b4dad8fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bff5e63-f381-4d1e-b92c-66abdb2f1d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bff5e63-f381-4d1e-b92c-66abdb2f1d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94b982a0-ccc4-41c8-8efc-fd6785e9c211', 'volume_name': 'volume-94b982a0-ccc4-41c8-8efc-fd6785e9c211', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3005675-7d63-4a0e-b175-4c36f50f1343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3005675-7d63-4a0e-b175-4c36f50f1343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a9f8bf-35e1-49cb-8d18-264f3b283d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:29:59 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume 94b982a0-ccc4-41c8-8efc-fd6785e9c211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94b982a0-ccc4-41c8-8efc-fd6785e9c211', 'volume_size': 1}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] creating volume v_94b982a0-ccc4-41c8-8efc-fd6785e9c211. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] create volume {'name': 'v_94b982a0-ccc4-41c8-8efc-fd6785e9c211', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:29:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211', 'is_clone': False, 'name': 'v_94b982a0-ccc4-41c8-8efc-fd6785e9c211'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a9f8bf-35e1-49cb-8d18-264f3b283d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b982a0-ccc4-41c8-8efc-fd6785e9c211', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93842a1-3715-46f8-b737-03c8af3f9a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:00 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume volume-94b982a0-ccc4-41c8-8efc-fd6785e9c211 (94b982a0-ccc4-41c8-8efc-fd6785e9c211): created successfully
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93842a1-3715-46f8-b737-03c8af3f9a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Flow 'volume_create_manager' (d34e4f5d-b804-456f-91a7-29ea678dd77b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:00 user cinder-volume[73792]: INFO cinder.action_track [None req-b8b51568-f1b9-42fd-9226-85fff631969d tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1266856088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=94b982a0-ccc4-41c8-8efc-fd6785e9c211,launched_at=2023-04-12T06:30:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth='CHAP qUReAgtw Se4q10zHCLX2kn',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:30:00Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:00 user cinder-volume[73792]: INFO cinder.action_track [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-733541010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=0fa27701-5674-468f-a26a-de89571d505a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Flow 'volume_create_manager' (e4f91651-6b4c-44bb-a947-d696849b916c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e52c014-cceb-43ab-9ed0-5a3e849fdd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e52c014-cceb-43ab-9ed0-5a3e849fdd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-733541010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=0fa27701-5674-468f-a26a-de89571d505a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:30:01Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1269ea-c346-4bb4-bd2f-970de541e361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1269ea-c346-4bb4-bd2f-970de541e361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed169daf-ffeb-4d87-ae88-eb045c6f7f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed169daf-ffeb-4d87-ae88-eb045c6f7f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fa27701-5674-468f-a26a-de89571d505a', 'volume_name': 'volume-0fa27701-5674-468f-a26a-de89571d505a', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7a557d-51ed-4e71-b996-139fc622ea84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7a557d-51ed-4e71-b996-139fc622ea84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab54242-cc53-432e-9287-42fe7a14d814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:00 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume 0fa27701-5674-468f-a26a-de89571d505a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fa27701-5674-468f-a26a-de89571d505a', 'volume_size': 1}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] creating volume v_0fa27701-5674-468f-a26a-de89571d505a. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] create volume {'name': 'v_0fa27701-5674-468f-a26a-de89571d505a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:01 user cinder-volume[73792]: INFO cinder.action_track [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239989604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1c9156c4-4a62-42d6-aeb9-b01bcf50786f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Flow 'volume_create_manager' (d6db26b4-8ae3-4261-a23a-301cbc2df0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915a8d47-bd97-4dbf-95cf-d22ed078cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915a8d47-bd97-4dbf-95cf-d22ed078cb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239989604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1c9156c4-4a62-42d6-aeb9-b01bcf50786f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:30:01Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4975beb3-965b-49f6-ae5b-0eaaf7401e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4975beb3-965b-49f6-ae5b-0eaaf7401e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4142bd1a-ad86-49d8-b584-024b7f6ac2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4142bd1a-ad86-49d8-b584-024b7f6ac2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c9156c4-4a62-42d6-aeb9-b01bcf50786f', 'volume_name': 'volume-1c9156c4-4a62-42d6-aeb9-b01bcf50786f', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0297ff-0e00-4baa-848c-b573d573f0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0297ff-0e00-4baa-848c-b573d573f0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d3c388-55cb-4f6a-88a1-a59d4149119c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume 1c9156c4-4a62-42d6-aeb9-b01bcf50786f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c9156c4-4a62-42d6-aeb9-b01bcf50786f', 'volume_size': 1}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] creating volume v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] create volume {'name': 'v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:01 user cinder-volume[73792]: INFO cinder.action_track [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-841225635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=eef9d12e-98cf-421d-8822-dbdf25085373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Flow 'volume_create_manager' (789f9c0d-08e1-4413-895b-c9e4df3e6c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49034d98-ed54-427b-81a9-bcf90dbbba9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49034d98-ed54-427b-81a9-bcf90dbbba9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-841225635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=eef9d12e-98cf-421d-8822-dbdf25085373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:30:01Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d036a2-9a7b-47d2-824e-2834ff9641c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d036a2-9a7b-47d2-824e-2834ff9641c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f122fab-cedc-4440-90ac-f8df15707271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f122fab-cedc-4440-90ac-f8df15707271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eef9d12e-98cf-421d-8822-dbdf25085373', 'volume_name': 'volume-eef9d12e-98cf-421d-8822-dbdf25085373', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2805e8ca-cf11-43dc-befe-359e852562d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2805e8ca-cf11-43dc-befe-359e852562d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6b1cc4-69bb-4ca5-98ae-706b7598e33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume eef9d12e-98cf-421d-8822-dbdf25085373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eef9d12e-98cf-421d-8822-dbdf25085373', 'volume_size': 1}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] creating volume v_eef9d12e-98cf-421d-8822-dbdf25085373. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] create volume {'name': 'v_eef9d12e-98cf-421d-8822-dbdf25085373', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=23,cinder:SELECT=67,cinder:INSERT=9,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0fa27701-5674-468f-a26a-de89571d505a', 'is_clone': False, 'name': 'v_0fa27701-5674-468f-a26a-de89571d505a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:01 user cinder-volume[73792]: INFO cinder.action_track [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-157190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=da8be4be-84fa-4896-ad85-172b39d008e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab54242-cc53-432e-9287-42fe7a14d814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa27701-5674-468f-a26a-de89571d505a', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af520abe-3ff6-4287-b043-dd13087068f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume volume-0fa27701-5674-468f-a26a-de89571d505a (0fa27701-5674-468f-a26a-de89571d505a): created successfully
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af520abe-3ff6-4287-b043-dd13087068f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Flow 'volume_create_manager' (e4f91651-6b4c-44bb-a947-d696849b916c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Flow 'volume_create_manager' (b840d44f-7007-4eb9-adcb-8b1b9631debe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9afcd6-69af-494b-8413-7f8852a61ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: INFO cinder.action_track [None req-d3ebe3c7-4012-4061-9693-8456c9d5b5a5 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-733541010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=0fa27701-5674-468f-a26a-de89571d505a,launched_at=2023-04-12T06:30:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth='CHAP vhpGesiP SevxfZqIJgGmk6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:30:01Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9afcd6-69af-494b-8413-7f8852a61ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-157190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=da8be4be-84fa-4896-ad85-172b39d008e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:30:02Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7cb35c-e539-4777-b3b7-8215c56c252e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7cb35c-e539-4777-b3b7-8215c56c252e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa16f5b1-dd00-4baf-a007-38e92f8aa7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa16f5b1-dd00-4baf-a007-38e92f8aa7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8be4be-84fa-4896-ad85-172b39d008e5', 'volume_name': 'volume-da8be4be-84fa-4896-ad85-172b39d008e5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a061e0-8c29-465f-8854-173ccd956bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a061e0-8c29-465f-8854-173ccd956bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9562e355-e545-4ef7-b741-e5b902a959f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume da8be4be-84fa-4896-ad85-172b39d008e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8be4be-84fa-4896-ad85-172b39d008e5', 'volume_size': 1}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] creating volume v_da8be4be-84fa-4896-ad85-172b39d008e5. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] create volume {'name': 'v_da8be4be-84fa-4896-ad85-172b39d008e5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f', 'is_clone': False, 'name': 'v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d3c388-55cb-4f6a-88a1-a59d4149119c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c9156c4-4a62-42d6-aeb9-b01bcf50786f', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aaf2877-7d92-4bda-b22f-7c6c59482083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume volume-1c9156c4-4a62-42d6-aeb9-b01bcf50786f (1c9156c4-4a62-42d6-aeb9-b01bcf50786f): created successfully
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aaf2877-7d92-4bda-b22f-7c6c59482083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Flow 'volume_create_manager' (d6db26b4-8ae3-4261-a23a-301cbc2df0c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:01 user cinder-volume[73792]: INFO cinder.action_track [None req-1f1d7bfe-3d47-40c6-a760-feeac71592ab tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239989604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1c9156c4-4a62-42d6-aeb9-b01bcf50786f,launched_at=2023-04-12T06:30:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth='CHAP EFnazHdV dU4aQLr02DFBHy',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:30:01Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:01 user cinder-volume[73792]: INFO cinder.action_track [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708872760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=95e45b35-d10b-443f-b850-136c3405e771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Flow 'volume_create_manager' (b5505b97-ec1f-48bc-98d1-cf495537929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f5a6c4-b799-42b6-b7b6-53d83e4f5bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f5a6c4-b799-42b6-b7b6-53d83e4f5bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708872760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=95e45b35-d10b-443f-b850-136c3405e771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:30:02Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5d2069-e307-408f-9340-80eb7e964d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5d2069-e307-408f-9340-80eb7e964d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad16e917-1037-4627-be90-9c6db9012223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad16e917-1037-4627-be90-9c6db9012223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e45b35-d10b-443f-b850-136c3405e771', 'volume_name': 'volume-95e45b35-d10b-443f-b850-136c3405e771', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ab9cb5-add6-4bab-8b8c-bc800ea7efea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ab9cb5-add6-4bab-8b8c-bc800ea7efea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f86ca1a-783d-486f-952a-05a1e8e37670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:01 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume 95e45b35-d10b-443f-b850-136c3405e771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e45b35-d10b-443f-b850-136c3405e771', 'volume_size': 1}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] creating volume v_95e45b35-d10b-443f-b850-136c3405e771. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] create volume {'name': 'v_95e45b35-d10b-443f-b850-136c3405e771', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_eef9d12e-98cf-421d-8822-dbdf25085373', 'is_clone': False, 'name': 'v_eef9d12e-98cf-421d-8822-dbdf25085373'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6b1cc4-69bb-4ca5-98ae-706b7598e33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eef9d12e-98cf-421d-8822-dbdf25085373', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d13401-5816-4d24-b834-a9defcf949bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:02 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume volume-eef9d12e-98cf-421d-8822-dbdf25085373 (eef9d12e-98cf-421d-8822-dbdf25085373): created successfully
Apr 12 06:30:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d13401-5816-4d24-b834-a9defcf949bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Flow 'volume_create_manager' (789f9c0d-08e1-4413-895b-c9e4df3e6c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:02 user cinder-volume[73792]: INFO cinder.action_track [None req-0597810e-6f2e-40ab-9efe-859a33e4ca84 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-841225635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=eef9d12e-98cf-421d-8822-dbdf25085373,launched_at=2023-04-12T06:30:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth='CHAP TJesQuEy VmjtuQP6ZFqGkA',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:30:01Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_da8be4be-84fa-4896-ad85-172b39d008e5', 'is_clone': False, 'name': 'v_da8be4be-84fa-4896-ad85-172b39d008e5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9562e355-e545-4ef7-b741-e5b902a959f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8be4be-84fa-4896-ad85-172b39d008e5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce72d6e-dee5-4a4e-a478-95f7ee042504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:02 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume volume-da8be4be-84fa-4896-ad85-172b39d008e5 (da8be4be-84fa-4896-ad85-172b39d008e5): created successfully
Apr 12 06:30:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce72d6e-dee5-4a4e-a478-95f7ee042504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Flow 'volume_create_manager' (b840d44f-7007-4eb9-adcb-8b1b9631debe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:02 user cinder-volume[73792]: INFO cinder.action_track [None req-10e5372a-5344-48d1-a990-3653e593b364 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-157190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=da8be4be-84fa-4896-ad85-172b39d008e5,launched_at=2023-04-12T06:30:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth='CHAP uhIbeZFA KCfvn34QNjWp97',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:02Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:30:02Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_95e45b35-d10b-443f-b850-136c3405e771', 'is_clone': False, 'name': 'v_95e45b35-d10b-443f-b850-136c3405e771'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f86ca1a-783d-486f-952a-05a1e8e37670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e45b35-d10b-443f-b850-136c3405e771', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137f02bc-ee2d-401b-a1ef-05e35547e9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:02 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Volume volume-95e45b35-d10b-443f-b850-136c3405e771 (95e45b35-d10b-443f-b850-136c3405e771): created successfully
Apr 12 06:30:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137f02bc-ee2d-401b-a1ef-05e35547e9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Flow 'volume_create_manager' (b5505b97-ec1f-48bc-98d1-cf495537929b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:02 user cinder-volume[73792]: INFO cinder.action_track [None req-923c233f-6cda-4cba-a6f3-29e0355671a7 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708872760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=95e45b35-d10b-443f-b850-136c3405e771,launched_at=2023-04-12T06:30:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth='CHAP pizZdDJH zjlVd0ySHqvxba',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:02Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:30:02Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Acquiring lock "cinder-95e45b35-d10b-443f-b850-136c3405e771-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Lock "cinder-95e45b35-d10b-443f-b850-136c3405e771-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] remove_export for volume: 95e45b35-d10b-443f-b850-136c3405e771. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708872760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=95e45b35-d10b-443f-b850-136c3405e771,launched_at=2023-04-12T06:30:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth='CHAP pizZdDJH zjlVd0ySHqvxba',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:02Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:30:03Z,updated_at=2023-04-12T06:30:03Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] detach volume v_95e45b35-d10b-443f-b850-136c3405e771 from target iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771/luns/v_95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771/luns/v_95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771/luns/v_95e45b35-d10b-443f-b850-136c3405e771'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771/luns/v_95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] failed to remove resource iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 because of JDSS resource v_95e45b35-d10b-443f-b850-136c3405e771 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete target: iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete target iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] failed to remove resource iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 because of JDSS resource iqn.2010-10.org.openstack:95e45b35-d10b-443f-b850-136c3405e771 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] deleating volume v_95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] get snapshots for volume v_95e45b35-d10b-443f-b850-136c3405e771  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95e45b35-d10b-443f-b850-136c3405e771/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95e45b35-d10b-443f-b850-136c3405e771/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95e45b35-d10b-443f-b850-136c3405e771/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] get volume v_95e45b35-d10b-443f-b850-136c3405e771 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_95e45b35-d10b-443f-b850-136c3405e771', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282419', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60369', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18288353356668337453', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd8630718e210a972', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773467136', 'san:volume_id': 'd8630718e210a97263a6bad0567c823a147000bd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37733', 'name': 'v_95e45b35-d10b-443f-b850-136c3405e771', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete volume:v_95e45b35-d10b-443f-b850-136c3405e771 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95e45b35-d10b-443f-b850-136c3405e771 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] volume v_95e45b35-d10b-443f-b850-136c3405e771 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:30:04 user cinder-volume[73792]: DEBUG cinder.quota [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Created reservations ['f72c6e04-527d-4c8e-ba9b-e43a5024bd73', 'c5a364ee-67a5-4b61-a236-a200b9250561', 'b80be686-9c40-4517-be06-dda727d33547', '157d0222-b510-4983-ae15-0804d10b4ded'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:30:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:30:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:30:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'available': '114773549056', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.manager [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:30:05 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Deleted volume successfully.
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b74e9771-85c0-4145-96f2-9ceceed584c6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Lock "cinder-95e45b35-d10b-443f-b850-136c3405e771-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.coordination [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Acquiring lock "cinder-da8be4be-84fa-4896-ad85-172b39d008e5-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.coordination [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Lock "cinder-da8be4be-84fa-4896-ad85-172b39d008e5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] remove_export for volume: da8be4be-84fa-4896-ad85-172b39d008e5. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-157190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=da8be4be-84fa-4896-ad85-172b39d008e5,launched_at=2023-04-12T06:30:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth='CHAP uhIbeZFA KCfvn34QNjWp97',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:02Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:30:05Z,updated_at=2023-04-12T06:30:05Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] detach volume v_da8be4be-84fa-4896-ad85-172b39d008e5 from target iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5/luns/v_da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5/luns/v_da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5/luns/v_da8be4be-84fa-4896-ad85-172b39d008e5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5/luns/v_da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] failed to remove resource iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 because of JDSS resource v_da8be4be-84fa-4896-ad85-172b39d008e5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete target: iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete target iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] failed to remove resource iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 because of JDSS resource iqn.2010-10.org.openstack:da8be4be-84fa-4896-ad85-172b39d008e5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] deleating volume v_da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] get snapshots for volume v_da8be4be-84fa-4896-ad85-172b39d008e5  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da8be4be-84fa-4896-ad85-172b39d008e5/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da8be4be-84fa-4896-ad85-172b39d008e5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da8be4be-84fa-4896-ad85-172b39d008e5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] get volume v_da8be4be-84fa-4896-ad85-172b39d008e5 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_da8be4be-84fa-4896-ad85-172b39d008e5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282419', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60365', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12934618070369406782', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '55123b378d7b5896', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773549056', 'san:volume_id': '55123b378d7b5896fe8bc4ada2c564adcd222abb', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37724', 'name': 'v_da8be4be-84fa-4896-ad85-172b39d008e5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete volume:v_da8be4be-84fa-4896-ad85-172b39d008e5 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_da8be4be-84fa-4896-ad85-172b39d008e5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] volume v_da8be4be-84fa-4896-ad85-172b39d008e5 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:30:06 user cinder-volume[73792]: DEBUG cinder.quota [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Created reservations ['d71cda4f-ccb5-4ab3-ae2f-8056f3382793', '6628931b-ffff-4435-b792-056ac3ccfb47', '9dd60a52-03e7-4647-af0f-8a8f5615663e', '897fce4f-1e55-45bb-9945-b8870af8d5c3'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:30:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:30:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:30:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'available': '114773630976', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.manager [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:30:07 user cinder-volume[73792]: INFO cinder.volume.manager [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Deleted volume successfully.
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.coordination [None req-53f44108-87e1-4673-b5ad-420008de087f tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Lock "cinder-da8be4be-84fa-4896-ad85-172b39d008e5-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.coordination [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Acquiring lock "cinder-eef9d12e-98cf-421d-8822-dbdf25085373-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.coordination [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Lock "cinder-eef9d12e-98cf-421d-8822-dbdf25085373-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] remove_export for volume: eef9d12e-98cf-421d-8822-dbdf25085373. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-841225635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=eef9d12e-98cf-421d-8822-dbdf25085373,launched_at=2023-04-12T06:30:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth='CHAP TJesQuEy VmjtuQP6ZFqGkA',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:30:08Z,updated_at=2023-04-12T06:30:08Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] detach volume v_eef9d12e-98cf-421d-8822-dbdf25085373 from target iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373/luns/v_eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373/luns/v_eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373/luns/v_eef9d12e-98cf-421d-8822-dbdf25085373'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373/luns/v_eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] failed to remove resource iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 because of JDSS resource v_eef9d12e-98cf-421d-8822-dbdf25085373 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete target: iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete target iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] failed to remove resource iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 because of JDSS resource iqn.2010-10.org.openstack:eef9d12e-98cf-421d-8822-dbdf25085373 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] deleating volume v_eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] get snapshots for volume v_eef9d12e-98cf-421d-8822-dbdf25085373  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eef9d12e-98cf-421d-8822-dbdf25085373/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eef9d12e-98cf-421d-8822-dbdf25085373/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eef9d12e-98cf-421d-8822-dbdf25085373/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] get volume v_eef9d12e-98cf-421d-8822-dbdf25085373 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_eef9d12e-98cf-421d-8822-dbdf25085373', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282419', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60361', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7769827659792902394', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b7c322ff175f18cf', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773630976', 'san:volume_id': 'b7c322ff175f18cf3845ef008042cc5e5ec3ec75', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37715', 'name': 'v_eef9d12e-98cf-421d-8822-dbdf25085373', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete volume:v_eef9d12e-98cf-421d-8822-dbdf25085373 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eef9d12e-98cf-421d-8822-dbdf25085373 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] volume v_eef9d12e-98cf-421d-8822-dbdf25085373 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:30:08 user cinder-volume[73792]: DEBUG cinder.quota [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Created reservations ['b48e851c-d51e-4dae-8504-436412a674f8', '0817b3f9-2575-4f43-89a2-a61da74ee62b', '7279dc3c-a269-41ae-a855-665e19e0466b', 'd5c13c2a-5e7e-484c-aa7c-d8d7c86a09ab'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:30:08 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=28,cinder:SELECT=60,cinder:DELETE=4,cinder:INSERT=8 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:30:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:30:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:30:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'available': '114773700608', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.manager [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:30:09 user cinder-volume[73792]: INFO cinder.volume.manager [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Deleted volume successfully.
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.coordination [None req-61ea45c4-9e31-457e-ac3d-499f239feebd tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Lock "cinder-eef9d12e-98cf-421d-8822-dbdf25085373-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.coordination [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Acquiring lock "cinder-1c9156c4-4a62-42d6-aeb9-b01bcf50786f-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.coordination [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Lock "cinder-1c9156c4-4a62-42d6-aeb9-b01bcf50786f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] remove_export for volume: 1c9156c4-4a62-42d6-aeb9-b01bcf50786f. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239989604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1c9156c4-4a62-42d6-aeb9-b01bcf50786f,launched_at=2023-04-12T06:30:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth='CHAP EFnazHdV dU4aQLr02DFBHy',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:30:10Z,updated_at=2023-04-12T06:30:10Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] detach volume v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f from target iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f/luns/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f/luns/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f/luns/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f/luns/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] failed to remove resource iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f because of JDSS resource v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete target: iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete target iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] failed to remove resource iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f because of JDSS resource iqn.2010-10.org.openstack:1c9156c4-4a62-42d6-aeb9-b01bcf50786f DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] deleating volume v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] get snapshots for volume v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] get volume v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:30:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282418', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60357', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8690994422105513927', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5fb770950ce244c9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773700608', 'san:volume_id': '5fb770950ce244c993c317d6eab4132063ffe6b2', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37706', 'name': 'v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete volume:v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:30:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] volume v_1c9156c4-4a62-42d6-aeb9-b01bcf50786f deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=40,cinder:SELECT=52,cinder:DELETE=4,cinder:INSERT=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.quota [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Created reservations ['59fd8392-52f9-42ab-a7b9-d6e89d42fcb3', '6e6b7a24-53ae-4e45-8d11-f833628be220', '4a02e970-ca54-48d9-9297-9e5b47158549', 'bf9ead49-1366-4797-8bf2-51cd530022d4'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'available': '114773782528', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.manager [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:30:11 user cinder-volume[73792]: INFO cinder.volume.manager [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Deleted volume successfully.
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.coordination [None req-75cae6e1-e459-4cdd-9af5-da9d7079a776 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Lock "cinder-1c9156c4-4a62-42d6-aeb9-b01bcf50786f-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Acquiring lock "cinder-0fa27701-5674-468f-a26a-de89571d505a-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:30:11 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Lock "cinder-0fa27701-5674-468f-a26a-de89571d505a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] remove_export for volume: 0fa27701-5674-468f-a26a-de89571d505a. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-733541010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=0fa27701-5674-468f-a26a-de89571d505a,launched_at=2023-04-12T06:30:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth='CHAP vhpGesiP SevxfZqIJgGmk6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:01Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:30:12Z,updated_at=2023-04-12T06:30:12Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] detach volume v_0fa27701-5674-468f-a26a-de89571d505a from target iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a/luns/v_0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a/luns/v_0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a/luns/v_0fa27701-5674-468f-a26a-de89571d505a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a/luns/v_0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] failed to remove resource iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a because of JDSS resource v_0fa27701-5674-468f-a26a-de89571d505a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete target: iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete target iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] failed to remove resource iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a because of JDSS resource iqn.2010-10.org.openstack:0fa27701-5674-468f-a26a-de89571d505a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] deleating volume v_0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] get snapshots for volume v_0fa27701-5674-468f-a26a-de89571d505a  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0fa27701-5674-468f-a26a-de89571d505a/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0fa27701-5674-468f-a26a-de89571d505a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0fa27701-5674-468f-a26a-de89571d505a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] get volume v_0fa27701-5674-468f-a26a-de89571d505a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0fa27701-5674-468f-a26a-de89571d505a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282418', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60354', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10875812976663335547', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5352d6d3c9cdf540', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773782528', 'san:volume_id': '5352d6d3c9cdf5402ff32661b75cc842ec833af2', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37698', 'name': 'v_0fa27701-5674-468f-a26a-de89571d505a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete volume:v_0fa27701-5674-468f-a26a-de89571d505a recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Acquiring lock "cinder-55ee740a-2e2d-4d68-a7b5-964a0f53ea4d-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Lock "cinder-55ee740a-2e2d-4d68-a7b5-964a0f53ea4d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] remove_export for volume: 55ee740a-2e2d-4d68-a7b5-964a0f53ea4d. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-334060970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=55ee740a-2e2d-4d68-a7b5-964a0f53ea4d,launched_at=2023-04-12T06:29:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca90b5b5fb49ca857aa4e215a99e37',provider_auth='CHAP tTgvRiNB ZUFivCPoTNHxue',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:30:13Z,updated_at=2023-04-12T06:30:13Z,use_quota=True,user_id='e761442395d14d7f82216e3d4174e43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] detach volume v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d from target iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d/luns/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d/luns/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d/luns/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d/luns/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] failed to remove resource iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d because of JDSS resource v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] delete target: iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] delete target iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] failed to remove resource iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d because of JDSS resource iqn.2010-10.org.openstack:55ee740a-2e2d-4d68-a7b5-964a0f53ea4d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] deleating volume v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] get snapshots for volume v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0fa27701-5674-468f-a26a-de89571d505a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] volume v_0fa27701-5674-468f-a26a-de89571d505a deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.quota [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Created reservations ['870265f0-2705-4455-8e9e-4cb37ef0085a', '1c5bdf79-4f99-4d63-9196-608d534958ff', 'bb96c5df-340e-46cd-852a-e03542f4842e', '2b5aa096-aa78-43c0-9373-c1b7e5bf260b'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] get volume v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282369', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60306', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16403405002004809276', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4ce36a16c047aff8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773864448', 'san:volume_id': '4ce36a16c047aff8f448e349a7e6436574bdca08', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37911', 'name': 'v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] delete volume:v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'available': '114773864448', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.manager [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:30:13 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Deleted volume successfully.
Apr 12 06:30:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c3929153-1c81-4ecd-8989-7df5f9da7413 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Lock "cinder-0fa27701-5674-468f-a26a-de89571d505a-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.coordination [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Acquiring lock "cinder-94b982a0-ccc4-41c8-8efc-fd6785e9c211-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.coordination [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Lock "cinder-94b982a0-ccc4-41c8-8efc-fd6785e9c211-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] remove_export for volume: 94b982a0-ccc4-41c8-8efc-fd6785e9c211. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1266856088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=94b982a0-ccc4-41c8-8efc-fd6785e9c211,launched_at=2023-04-12T06:30:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f890757aec4e3297e222e7df14bda9',provider_auth='CHAP qUReAgtw Se4q10zHCLX2kn',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:30:14Z,updated_at=2023-04-12T06:30:14Z,use_quota=True,user_id='b918aab645664916a628cedac7a5ef14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] detach volume v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 from target iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211/luns/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211/luns/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211/luns/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211/luns/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] failed to remove resource iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 because of JDSS resource v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete target: iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete target iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] failed to remove resource iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 because of JDSS resource iqn.2010-10.org.openstack:94b982a0-ccc4-41c8-8efc-fd6785e9c211 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] deleating volume v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] get snapshots for volume v_94b982a0-ccc4-41c8-8efc-fd6785e9c211  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] get volume v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282417', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60350', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14787803789400535858', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1e7b666de67ac2cd', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773946368', 'san:volume_id': '1e7b666de67ac2cd57411474e60af4186c2b18dc', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37689', 'name': 'v_94b982a0-ccc4-41c8-8efc-fd6785e9c211', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] delete volume:v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] volume v_55ee740a-2e2d-4d68-a7b5-964a0f53ea4d deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.quota [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Created reservations ['8d5c07cc-2a21-4724-b588-d8d3cc65d3a1', '9259891a-0e4f-4a16-8403-af3b083f1d90', '031e4ffe-c5b9-4e97-bc6e-5f018b5109af', 'dec80bef-9f4e-47b4-a97e-ea4b305a17bb'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 200, 'error': None, 'data': {'available': '114773946368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.manager [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:30:15 user cinder-volume[73792]: INFO cinder.volume.manager [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Deleted volume successfully.
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bfc8973f-c8ba-4b57-8905-73727803aeb5 tempest-ServersNegativeTestJSON-815999574 None] Lock "cinder-55ee740a-2e2d-4d68-a7b5-964a0f53ea4d-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Acquiring lock "cinder-859868f9-52cb-46c1-95b8-6ca520e4fae3-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Lock "cinder-859868f9-52cb-46c1-95b8-6ca520e4fae3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] remove_export for volume: 859868f9-52cb-46c1-95b8-6ca520e4fae3. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1655274161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=859868f9-52cb-46c1-95b8-6ca520e4fae3,launched_at=2023-04-12T06:27:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca90b5b5fb49ca857aa4e215a99e37',provider_auth='CHAP GxocdDBh 59speTJ71aRCNk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:27:10Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:30:15Z,updated_at=2023-04-12T06:30:15Z,use_quota=True,user_id='e761442395d14d7f82216e3d4174e43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] detach volume v_859868f9-52cb-46c1-95b8-6ca520e4fae3 from target iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3/luns/v_859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3/luns/v_859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3/luns/v_859868f9-52cb-46c1-95b8-6ca520e4fae3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3/luns/v_859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] failed to remove resource iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 because of JDSS resource v_859868f9-52cb-46c1-95b8-6ca520e4fae3 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] delete target: iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] delete target iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] failed to remove resource iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 because of JDSS resource iqn.2010-10.org.openstack:859868f9-52cb-46c1-95b8-6ca520e4fae3 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] deleating volume v_859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] get snapshots for volume v_859868f9-52cb-46c1-95b8-6ca520e4fae3  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_859868f9-52cb-46c1-95b8-6ca520e4fae3/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_859868f9-52cb-46c1-95b8-6ca520e4fae3/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_859868f9-52cb-46c1-95b8-6ca520e4fae3/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] get volume v_859868f9-52cb-46c1-95b8-6ca520e4fae3 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_859868f9-52cb-46c1-95b8-6ca520e4fae3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282247', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60222', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3809871877246849211', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4b677541659d6def', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774003712', 'san:volume_id': '4b677541659d6defb2bafb2669f423fc63d1953c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37810', 'name': 'v_859868f9-52cb-46c1-95b8-6ca520e4fae3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] delete volume:v_859868f9-52cb-46c1-95b8-6ca520e4fae3 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] volume v_94b982a0-ccc4-41c8-8efc-fd6785e9c211 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.quota [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Created reservations ['316080aa-06a1-42ef-bac8-95b9686421c6', '97084b16-bea1-43c4-81dc-958b04f733b1', 'ec156682-0a0c-4760-92b9-8e7805a1754d', '093e9259-0a40-4fb7-90bf-b208f6b020fd'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=33,cinder:SELECT=58,cinder:DELETE=3,cinder:INSERT=6 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_859868f9-52cb-46c1-95b8-6ca520e4fae3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] volume v_859868f9-52cb-46c1-95b8-6ca520e4fae3 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.quota [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Created reservations ['d05f8aa1-4022-402f-9f67-cc593177c172', '5261e50c-e696-4514-9f66-5b1307275ec7', '71ab16a3-7035-4fb0-abf6-ffe0e962ce7c', '191d2ed9-d2c9-477a-a0d8-03f8a50f78dd'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=51,cinder:INSERT=12,cinder:UPDATE=36,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Geting {'code': 200, 'error': None, 'data': {'available': '114773946368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.manager [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:30:16 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Deleted volume successfully.
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0e8b7a7c-d437-460d-a427-3ea10645ecc2 tempest-ServersNegativeTestJSON-815999574 None] Lock "cinder-859868f9-52cb-46c1-95b8-6ca520e4fae3-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774085632', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.manager [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:30:16 user cinder-volume[73792]: INFO cinder.volume.manager [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Deleted volume successfully.
Apr 12 06:30:16 user cinder-volume[73792]: DEBUG cinder.coordination [None req-90b6c208-316c-4dc5-962b-2542931c9aa6 tempest-CreateVolumesFromSourceVolumeTest-1053735274 None] Lock "cinder-94b982a0-ccc4-41c8-8efc-fd6785e9c211-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Acquiring lock "cinder-7b336ad6-910c-4dd4-8ef4-c16d440e9881-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Lock "cinder-7b336ad6-910c-4dd4-8ef4-c16d440e9881-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] remove_export for volume: 7b336ad6-910c-4dd4-8ef4-c16d440e9881. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-673748094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7b336ad6-910c-4dd4-8ef4-c16d440e9881,launched_at=2023-04-12T06:22:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d74130d4d417a93de352381229948',provider_auth='CHAP zvpZhPcJ YTkzhvPCfoUt58',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:22:41Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:30:28Z,updated_at=2023-04-12T06:30:28Z,use_quota=True,user_id='d59314e79d0344a2943391c3c2ab628a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] detach volume v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 from target iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/luns/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/luns/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/luns/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881/luns/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] failed to remove resource iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 because of JDSS resource v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] delete target: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] delete target iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] failed to remove resource iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 because of JDSS resource iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] deleating volume v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] get snapshots for volume v_7b336ad6-910c-4dd4-8ef4-c16d440e9881  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] get volume v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681281978', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '59843', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12513991236118133001', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '163840', 'logicalused': '1630208', 'compressratio': '15.30', 'rootcontext': 'none', 'default_scsi_id': 'bb45716e1bdaad9b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774085632', 'san:volume_id': 'bb45716e1bdaad9bc7fad842c19b25368dbc00a6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '163840', 'objsetid': '37043', 'name': 'v_7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '163840', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] delete volume:v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] volume v_7b336ad6-910c-4dd4-8ef4-c16d440e9881 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:30:29 user cinder-volume[73792]: DEBUG cinder.quota [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Created reservations ['a67531cb-31eb-4cee-9c46-df507e203c48', 'c7bd4e53-9af7-4e04-bcfe-e53a91e44753', '35cd09e7-b4f5-4ab8-9545-0472fa57c7d3', '1a052297-8bc2-4b8b-8e44-1fc5411c2cc5'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:30:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:30:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:30:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774298624', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:30:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:30:30 user cinder-volume[73792]: INFO cinder.volume.manager [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Deleted volume successfully.
Apr 12 06:30:30 user cinder-volume[73792]: DEBUG cinder.coordination [None req-99da0220-9c9e-4f14-9591-8279cfc1f0ac tempest-TestStampPattern-1782553765 None] Lock "cinder-7b336ad6-910c-4dd4-8ef4-c16d440e9881-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:30:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:30:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:30:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:30:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114774298624', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:30:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:30:31 user cinder-volume[73792]: INFO cinder.action_track [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Flow 'volume_create_manager' (bb2c710e-08e1-400d-9d7b-4023d05abd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e29731-b91f-48e8-b1d9-cd61a9c6fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e29731-b91f-48e8-b1d9-cd61a9c6fc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:30:32Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d570829-d6df-4578-9670-f37930d7df09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d570829-d6df-4578-9670-f37930d7df09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad35acaa-1061-4849-aad7-8fede2bfcac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad35acaa-1061-4849-aad7-8fede2bfcac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'volume_name': 'volume-c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285c999a-d39c-46b9-9c85-78bbd1a17028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285c999a-d39c-46b9-9c85-78bbd1a17028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6389c3-89ca-43aa-a2dc-c2a542e78aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:31 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Volume c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'volume_size': 1}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] creating volume v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] create volume {'name': 'v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'is_clone': False, 'name': 'v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6389c3-89ca-43aa-a2dc-c2a542e78aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557b3de9-c013-492e-9fc2-d7aa0c22335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:32 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Volume volume-c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7): created successfully
Apr 12 06:30:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557b3de9-c013-492e-9fc2-d7aa0c22335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:32 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] Flow 'volume_create_manager' (bb2c710e-08e1-400d-9d7b-4023d05abd6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:32 user cinder-volume[73792]: INFO cinder.action_track [None req-0c137ef1-8d59-4513-b274-11b3743c9f93 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:30:32Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:33 user cinder-volume[73792]: INFO cinder.action_track [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:30:33Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:33 user cinder-volume[73792]: INFO cinder.action_track [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:30:33Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] create export for volume: c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:30:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] ensure volume c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:30:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] check if targe iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:30:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] create target and attach volume c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:30:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] create target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:30:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] atach volume v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 to target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:30:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6538346464396661', 'lun': 0, 'mode': 'wt', 'name': 'v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'prod_id': 'Storage', 'scsi_id': 'e84dd9fa7eb9e238'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] add credentails to target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:30:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'name': 'akKCItqp'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] initialize_connection for c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:30:38 user cinder-volume[73792]: INFO cinder.action_track [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '9d6c1587-9572-404c-895e-3914f35401d9'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:30:33Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:38 user cinder-volume[73792]: INFO cinder.action_track [req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a req-9f2c54be-bfbc-4681-84a8-bc807ddc9697 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:30:38Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:40 user cinder-volume[73792]: INFO cinder.action_track [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fe98d827-3a80-4ca8-b8f5-6fbaff362ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d3696a32b747ef88d16049c1ca7fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='26576f897e484f75bd8db9dd48084156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Flow 'volume_create_manager' (2678f3d1-2acb-48ed-a380-919573a608f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bf6b1a-0e5e-4ebe-a27f-848c3e570745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bf6b1a-0e5e-4ebe-a27f-848c3e570745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fe98d827-3a80-4ca8-b8f5-6fbaff362ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d3696a32b747ef88d16049c1ca7fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:30:41Z,use_quota=True,user_id='26576f897e484f75bd8db9dd48084156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09807a00-c950-49e9-9b1b-2401597efa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09807a00-c950-49e9-9b1b-2401597efa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9396cace-b0a4-4226-8e5f-651a2375ce06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9396cace-b0a4-4226-8e5f-651a2375ce06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe98d827-3a80-4ca8-b8f5-6fbaff362ebc', 'volume_name': 'volume-fe98d827-3a80-4ca8-b8f5-6fbaff362ebc', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e695c0b-13f9-4199-97a8-d2f5f8394ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e695c0b-13f9-4199-97a8-d2f5f8394ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5811a68c-56d2-4b7a-ab58-b344878248b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Volume fe98d827-3a80-4ca8-b8f5-6fbaff362ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe98d827-3a80-4ca8-b8f5-6fbaff362ebc', 'volume_size': 1}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] creating volume v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] create volume {'name': 'v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc', 'is_clone': False, 'name': 'v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5811a68c-56d2-4b7a-ab58-b344878248b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe98d827-3a80-4ca8-b8f5-6fbaff362ebc', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e257d65-d97b-4248-847f-509b7cfab172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:41 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Volume volume-fe98d827-3a80-4ca8-b8f5-6fbaff362ebc (fe98d827-3a80-4ca8-b8f5-6fbaff362ebc): created successfully
Apr 12 06:30:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e257d65-d97b-4248-847f-509b7cfab172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:41 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] Flow 'volume_create_manager' (2678f3d1-2acb-48ed-a380-919573a608f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:41 user cinder-volume[73792]: INFO cinder.action_track [None req-1e59081b-668c-445c-9d89-72f5cca8de2e tempest-CinderUnicodeTest-725883130 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fe98d827-3a80-4ca8-b8f5-6fbaff362ebc,launched_at=2023-04-12T06:30:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d3696a32b747ef88d16049c1ca7fb8',provider_auth='CHAP uwYiczbv GOlkTIx73d6Xvr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:41Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:30:41Z,use_quota=True,user_id='26576f897e484f75bd8db9dd48084156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:42 user cinder-volume[73792]: INFO cinder.action_track [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1556891563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=49318b12-9829-4c99-b324-c4e52aca5b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d3696a32b747ef88d16049c1ca7fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='26576f897e484f75bd8db9dd48084156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Flow 'volume_create_manager' (6fd32aa7-322d-4e69-ba8b-ca14a8009f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d0fa5a-3e94-4b37-9daf-88377c10dac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d0fa5a-3e94-4b37-9daf-88377c10dac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1556891563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=49318b12-9829-4c99-b324-c4e52aca5b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d3696a32b747ef88d16049c1ca7fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:30:42Z,use_quota=True,user_id='26576f897e484f75bd8db9dd48084156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c837043-5ddc-4b2f-b9c5-71e01507c9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c837043-5ddc-4b2f-b9c5-71e01507c9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48630de1-4ebb-4392-89a8-f31ce911ec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48630de1-4ebb-4392-89a8-f31ce911ec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49318b12-9829-4c99-b324-c4e52aca5b79', 'volume_name': 'volume-49318b12-9829-4c99-b324-c4e52aca5b79', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7773b2dc-c3b5-4f98-aec4-5a834182a64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7773b2dc-c3b5-4f98-aec4-5a834182a64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c04eb1-16dc-47f5-a140-ce7c900d8395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:42 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Volume 49318b12-9829-4c99-b324-c4e52aca5b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49318b12-9829-4c99-b324-c4e52aca5b79', 'volume_size': 1}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] creating volume v_49318b12-9829-4c99-b324-c4e52aca5b79. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] create volume {'name': 'v_49318b12-9829-4c99-b324-c4e52aca5b79', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_49318b12-9829-4c99-b324-c4e52aca5b79', 'is_clone': False, 'name': 'v_49318b12-9829-4c99-b324-c4e52aca5b79'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c04eb1-16dc-47f5-a140-ce7c900d8395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49318b12-9829-4c99-b324-c4e52aca5b79', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85404930-c451-4f9c-bc6b-9c2b2a13e22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:30:42 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Volume volume-49318b12-9829-4c99-b324-c4e52aca5b79 (49318b12-9829-4c99-b324-c4e52aca5b79): created successfully
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85404930-c451-4f9c-bc6b-9c2b2a13e22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:30:42 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] Flow 'volume_create_manager' (6fd32aa7-322d-4e69-ba8b-ca14a8009f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:30:42 user cinder-volume[73792]: INFO cinder.action_track [None req-323672fa-7bab-4c6e-b413-f40d76770840 tempest-CinderUnicodeTest-725883130 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1556891563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=49318b12-9829-4c99-b324-c4e52aca5b79,launched_at=2023-04-12T06:30:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d3696a32b747ef88d16049c1ca7fb8',provider_auth='CHAP GoKYdMuE QqEG9Hv1BT8tAf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:42Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:30:42Z,use_quota=True,user_id='26576f897e484f75bd8db9dd48084156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:43 user cinder-volume[73792]: INFO cinder.action_track [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:30:43Z,deleted=False,deleted_at=None,display_description='中国社区',display_name='tempest-CinderUnicodeTest-Snapshot-1190484641',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=737344ac-cf7e-4a96-9971-0b5394b3710d,metadata={},progress='0%',project_id='33d3696a32b747ef88d16049c1ca7fb8',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='26576f897e484f75bd8db9dd48084156',volume=<?>,volume_id=49318b12-9829-4c99-b324-c4e52aca5b79,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] create snapshot 737344ac-cf7e-4a96-9971-0b5394b3710d for volume 49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:30:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] cloning v_49318b12-9829-4c99-b324-c4e52aca5b79 to s_737344ac-cf7e-4a96-9971-0b5394b3710d {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:30:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] create snapshot s_737344ac-cf7e-4a96-9971-0b5394b3710d {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:30:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_737344ac-cf7e-4a96-9971-0b5394b3710d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] create volume s_737344ac-cf7e-4a96-9971-0b5394b3710d from snapshot s_737344ac-cf7e-4a96-9971-0b5394b3710d {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:30:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_49318b12-9829-4c99-b324-c4e52aca5b79@s_737344ac-cf7e-4a96-9971-0b5394b3710d', 'is_clone': True, 'full_name': 'Pool-0/s_737344ac-cf7e-4a96-9971-0b5394b3710d', 'name': 's_737344ac-cf7e-4a96-9971-0b5394b3710d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_737344ac-cf7e-4a96-9971-0b5394b3710d/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_737344ac-cf7e-4a96-9971-0b5394b3710d/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_737344ac-cf7e-4a96-9971-0b5394b3710d/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] volume s_737344ac-cf7e-4a96-9971-0b5394b3710d properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:30:44 user cinder-volume[73792]: INFO cinder.volume.manager [None req-28282aba-c619-4ac3-aaa0-a77d25eef92e tempest-CinderUnicodeTest-725883130 None] Create snapshot completed successfully
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Acquiring lock "cinder-737344ac-cf7e-4a96-9971-0b5394b3710d-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Lock "cinder-737344ac-cf7e-4a96-9971-0b5394b3710d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] deleating snapshot s_737344ac-cf7e-4a96-9971-0b5394b3710d. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] get snapshots for volume s_737344ac-cf7e-4a96-9971-0b5394b3710d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_737344ac-cf7e-4a96-9971-0b5394b3710d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_737344ac-cf7e-4a96-9971-0b5394b3710d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_737344ac-cf7e-4a96-9971-0b5394b3710d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] get volume s_737344ac-cf7e-4a96-9971-0b5394b3710d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_737344ac-cf7e-4a96-9971-0b5394b3710d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_737344ac-cf7e-4a96-9971-0b5394b3710d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_49318b12-9829-4c99-b324-c4e52aca5b79@s_737344ac-cf7e-4a96-9971-0b5394b3710d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_737344ac-cf7e-4a96-9971-0b5394b3710d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282461', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60403', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13707691208487354678', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cd13bdeaa0c71dfb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774016000', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37537', 'name': 's_737344ac-cf7e-4a96-9971-0b5394b3710d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_737344ac-cf7e-4a96-9971-0b5394b3710d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] delete snapshot s_737344ac-cf7e-4a96-9971-0b5394b3710d of volume v_49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79/snapshots/s_737344ac-cf7e-4a96-9971-0b5394b3710d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79/snapshots/s_737344ac-cf7e-4a96-9971-0b5394b3710d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:45 user cinder-volume[73792]: INFO cinder.action_track [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:30:40Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] terminate connection for c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:30:45 user cinder-volume[73792]: INFO cinder.action_track [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:30:40Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] Deleting attachment 9d6c1587-9572-404c-895e-3914f35401d9. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] remove_export for volume: c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:30:40Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] detach volume v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 from target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79/snapshots/s_737344ac-cf7e-4a96-9971-0b5394b3710d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] snapshot s_737344ac-cf7e-4a96-9971-0b5394b3710d deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:30:46 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=65,cinder:INSERT=4,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:30:46 user cinder-volume[73792]: DEBUG cinder.quota [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Created reservations ['22ad7d4f-4fdc-447f-b791-4f2a7daf669e', 'a26f0391-d300-4549-a9d4-1127ce7253c6', 'bc3ba90f-e7ba-4af8-9741-1d6cbe43da8b', '81d6ef46-7e9f-4871-b2e4-6a27d082e34b'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:30:46 user cinder-volume[73792]: INFO cinder.volume.manager [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Delete snapshot completed successfully.
Apr 12 06:30:46 user cinder-volume[73792]: DEBUG cinder.coordination [None req-22aa0d9d-409a-43cb-8205-2ee0b7d44e53 tempest-CinderUnicodeTest-725883130 None] Lock "cinder-737344ac-cf7e-4a96-9971-0b5394b3710d-delete_snapshot" released by "delete_snapshot" :: held 1.235s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:30:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] delete target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:30:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] delete target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:30:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-cf4d9374-a6f9-4915-bbd6-ea3713fa76aa tempest-ServerActionsTestJSON-752347644 None] target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Acquiring lock "cinder-49318b12-9829-4c99-b324-c4e52aca5b79-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Lock "cinder-49318b12-9829-4c99-b324-c4e52aca5b79-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=30,cinder:SELECT=49,cinder:DELETE=5,cinder:INSERT=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] remove_export for volume: 49318b12-9829-4c99-b324-c4e52aca5b79. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1556891563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=49318b12-9829-4c99-b324-c4e52aca5b79,launched_at=2023-04-12T06:30:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d3696a32b747ef88d16049c1ca7fb8',provider_auth='CHAP GoKYdMuE QqEG9Hv1BT8tAf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:42Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:30:48Z,updated_at=2023-04-12T06:30:48Z,use_quota=True,user_id='26576f897e484f75bd8db9dd48084156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] detach volume v_49318b12-9829-4c99-b324-c4e52aca5b79 from target iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79/luns/v_49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79/luns/v_49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79/luns/v_49318b12-9829-4c99-b324-c4e52aca5b79'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79/luns/v_49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] failed to remove resource iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 because of JDSS resource v_49318b12-9829-4c99-b324-c4e52aca5b79 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] delete target: iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] delete target iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] failed to remove resource iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 because of JDSS resource iqn.2010-10.org.openstack:49318b12-9829-4c99-b324-c4e52aca5b79 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] deleating volume v_49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] get snapshots for volume v_49318b12-9829-4c99-b324-c4e52aca5b79  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] get volume v_49318b12-9829-4c99-b324-c4e52aca5b79 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_49318b12-9829-4c99-b324-c4e52aca5b79', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282459', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60397', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12991932322593732649', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6d3b779fc572802c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774016000', 'san:volume_id': '6d3b779fc572802c314d14f00d7c29bb1d830cc0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38656', 'name': 'v_49318b12-9829-4c99-b324-c4e52aca5b79', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] delete volume:v_49318b12-9829-4c99-b324-c4e52aca5b79 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:49 user cinder-volume[73792]: INFO cinder.action_track [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='reserved',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:30:47Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:49 user cinder-volume[73792]: INFO cinder.action_track [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='reserved',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:30:47Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] create export for volume: c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] ensure volume c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] check if targe iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49318b12-9829-4c99-b324-c4e52aca5b79 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] volume v_49318b12-9829-4c99-b324-c4e52aca5b79 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] create target and attach volume c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] create target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.quota [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Created reservations ['84081251-d10e-439b-8109-76a5e5cb14d6', 'd1e899f6-6e80-400d-a922-fe91329e9494', 'd5f5067e-ddbf-490d-a774-988b422788e2', '2131e421-ec4a-4ed4-80ad-8171b6ef3d30'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.coordination [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Acquiring lock "cinder-fe98d827-3a80-4ca8-b8f5-6fbaff362ebc-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.coordination [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Lock "cinder-fe98d827-3a80-4ca8-b8f5-6fbaff362ebc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] remove_export for volume: fe98d827-3a80-4ca8-b8f5-6fbaff362ebc. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fe98d827-3a80-4ca8-b8f5-6fbaff362ebc,launched_at=2023-04-12T06:30:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d3696a32b747ef88d16049c1ca7fb8',provider_auth='CHAP uwYiczbv GOlkTIx73d6Xvr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:41Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:30:50Z,updated_at=2023-04-12T06:30:50Z,use_quota=True,user_id='26576f897e484f75bd8db9dd48084156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] detach volume v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc from target iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc/luns/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc/luns/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc/luns/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc/luns/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] failed to remove resource iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc because of JDSS resource v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] delete target: iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] delete target iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] failed to remove resource iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc because of JDSS resource iqn.2010-10.org.openstack:fe98d827-3a80-4ca8-b8f5-6fbaff362ebc DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] deleating volume v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] get snapshots for volume v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] get volume v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:30:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282458', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60393', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16448007898392187460', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '261ae26b418426c3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774085632', 'san:volume_id': '261ae26b418426c3d344a2529b23d2314c030d58', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37844', 'name': 'v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] delete volume:v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:30:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] volume v_fe98d827-3a80-4ca8-b8f5-6fbaff362ebc deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.quota [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Created reservations ['77bac05e-0e50-40a1-a2bb-76790c0b7f3e', '8192b26c-4f53-40b5-bca4-7490db15f1fa', 'e18ae868-256d-421c-8525-95ec361df8a1', '36a900c5-8cc1-488d-a3fb-009e89be3444'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774155264', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.manager [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:30:51 user cinder-volume[73792]: INFO cinder.volume.manager [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Deleted volume successfully.
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.coordination [None req-66ce0ca3-f184-4447-b4f4-86d2c3d52e0a tempest-CinderUnicodeTest-725883130 None] Lock "cinder-fe98d827-3a80-4ca8-b8f5-6fbaff362ebc-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] atach volume v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 to target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774155264', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:30:52 user cinder-volume[73792]: DEBUG cinder.manager [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:30:52 user cinder-volume[73792]: INFO cinder.volume.manager [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Deleted volume successfully.
Apr 12 06:30:52 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3d92b421-7086-418e-acd2-c9baaae3c7ce tempest-CinderUnicodeTest-725883130 None] Lock "cinder-49318b12-9829-4c99-b324-c4e52aca5b79-delete_volume" released by "delete_volume" :: held 4.656s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:30:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6538346464396661', 'lun': 0, 'mode': 'wt', 'name': 'v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'prod_id': 'Storage', 'scsi_id': 'e84dd9fa7eb9e238'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] add credentails to target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:30:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:30:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:30:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'name': 'akKCItqp'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:30:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] initialize_connection for c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:30:53 user cinder-volume[73792]: INFO cinder.action_track [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'd2374a13-7899-49dc-8367-ba407e30a7ea'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='reserved',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:30:47Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:30:53 user cinder-volume[73792]: INFO cinder.action_track [req-d6ca20d0-29c6-447b-8734-6b15b1924461 req-f407864e-c53e-49aa-8ac1-6c3283eba866 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:30:54Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.coordination [None req-10c2bd5d-a1b8-4a98-a042-c33ee3541d34 tempest-VolumesActionsTest-1914558791 None] Acquiring lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff" by "attach_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.coordination [None req-10c2bd5d-a1b8-4a98-a042-c33ee3541d34 tempest-VolumesActionsTest-1914558791 None] Lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff" acquired by "attach_volume" :: waited 0.015s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:31:01 user cinder-volume[73792]: INFO cinder.volume.manager [None req-10c2bd5d-a1b8-4a98-a042-c33ee3541d34 tempest-VolumesActionsTest-1914558791 None] Attaching volume 8a97e458-f71b-43df-a273-03e227d9abff to instance 35495bca-759b-4940-af0e-e6da34c73b34 at mountpoint /dev/vdb on host None.
Apr 12 06:31:01 user cinder-volume[73792]: INFO cinder.action_track [None req-10c2bd5d-a1b8-4a98-a042-c33ee3541d34 tempest-VolumesActionsTest-1914558791 None] ACTION:'volume_attach' MSG:'Attach volume completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:1512:attach_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538420119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8a97e458-f71b-43df-a273-03e227d9abff,launched_at=2023-04-12T06:29:10Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='4d0a755743544f7c97644faad13bdeb4',provider_auth='CHAP LshCmFfD HEt5vaDiTkoS4g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:31:01Z,use_quota=True,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.coordination [None req-10c2bd5d-a1b8-4a98-a042-c33ee3541d34 tempest-VolumesActionsTest-1914558791 None] Lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff" released by "attach_volume" :: held 0.072s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.coordination [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] Acquiring lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff-detach_volume" by "detach_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.coordination [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] Lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:31:01 user cinder-volume[73792]: INFO cinder.action_track [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] ACTION:'volume_detach' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538420119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8a97e458-f71b-43df-a273-03e227d9abff,launched_at=2023-04-12T06:29:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0a755743544f7c97644faad13bdeb4',provider_auth='CHAP LshCmFfD HEt5vaDiTkoS4g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:31:01Z,use_quota=True,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:31:01 user cinder-volume[73792]: INFO cinder.volume.manager [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] Detaching volume 8a97e458-f71b-43df-a273-03e227d9abff from instance 35495bca-759b-4940-af0e-e6da34c73b34.
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] remove_export for volume: 8a97e458-f71b-43df-a273-03e227d9abff. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538420119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8a97e458-f71b-43df-a273-03e227d9abff,launched_at=2023-04-12T06:29:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0a755743544f7c97644faad13bdeb4',provider_auth='CHAP LshCmFfD HEt5vaDiTkoS4g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:31:01Z,use_quota=True,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] detach volume v_8a97e458-f71b-43df-a273-03e227d9abff from target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] failed to remove resource iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff because of JDSS resource v_8a97e458-f71b-43df-a273-03e227d9abff DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] delete target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] delete target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] failed to remove resource iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff because of JDSS resource iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=60,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:31:01 user cinder-volume[73792]: INFO cinder.volume.manager [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] Detach volume completed successfully.
Apr 12 06:31:01 user cinder-volume[73792]: DEBUG cinder.coordination [None req-2d3e26b5-cc88-4a48-b6d9-5306e4f43513 tempest-VolumesActionsTest-1914558791 None] Lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:31:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=47,cinder:INSERT=4,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:31:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:31:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:31:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:31:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:31:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:31:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114774155264', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:31:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:31:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:31:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:31:37 user cinder-volume[73792]: INFO cinder.action_track [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1952379722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3cd99089-1282-4efd-b9c6-7c2ee9c90a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Flow 'volume_create_manager' (27093efd-dd6d-4a31-8472-07e91f6dc52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210ca093-48dd-4d6a-933f-b8b3778a6a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210ca093-48dd-4d6a-933f-b8b3778a6a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1952379722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3cd99089-1282-4efd-b9c6-7c2ee9c90a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:31:37Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692ce422-2582-4998-9023-52d72e651f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692ce422-2582-4998-9023-52d72e651f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f6f2d3-d167-46c5-911c-7708ab3b6b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f6f2d3-d167-46c5-911c-7708ab3b6b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd99089-1282-4efd-b9c6-7c2ee9c90a2a', 'volume_name': 'volume-3cd99089-1282-4efd-b9c6-7c2ee9c90a2a', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0609d29b-0219-4293-8883-8a0492f6e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0609d29b-0219-4293-8883-8a0492f6e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95536c57-801d-4e3c-91e6-ebb9b899626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:31:37 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Volume 3cd99089-1282-4efd-b9c6-7c2ee9c90a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd99089-1282-4efd-b9c6-7c2ee9c90a2a', 'volume_size': 1}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] creating volume v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] create volume {'name': 'v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a', 'is_clone': False, 'name': 'v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95536c57-801d-4e3c-91e6-ebb9b899626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd99089-1282-4efd-b9c6-7c2ee9c90a2a', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971becaf-1a0b-4be5-b558-fcf49848ba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:31:37 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Volume volume-3cd99089-1282-4efd-b9c6-7c2ee9c90a2a (3cd99089-1282-4efd-b9c6-7c2ee9c90a2a): created successfully
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971becaf-1a0b-4be5-b558-fcf49848ba14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:31:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] Flow 'volume_create_manager' (27093efd-dd6d-4a31-8472-07e91f6dc52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:31:37 user cinder-volume[73792]: INFO cinder.action_track [None req-2dab2865-8e00-4a77-9e2f-2f638bf3e5ff tempest-VolumesAdminNegativeTest-1313851069 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1952379722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3cd99089-1282-4efd-b9c6-7c2ee9c90a2a,launched_at=2023-04-12T06:31:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth='CHAP TDFozLsl YfzZhDw0L1TjbG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:31:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:31:37Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.coordination [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Acquiring lock "cinder-3cd99089-1282-4efd-b9c6-7c2ee9c90a2a-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.coordination [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Lock "cinder-3cd99089-1282-4efd-b9c6-7c2ee9c90a2a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] remove_export for volume: 3cd99089-1282-4efd-b9c6-7c2ee9c90a2a. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1952379722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3cd99089-1282-4efd-b9c6-7c2ee9c90a2a,launched_at=2023-04-12T06:31:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth='CHAP TDFozLsl YfzZhDw0L1TjbG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:31:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:31:38Z,updated_at=2023-04-12T06:31:38Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] detach volume v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a from target iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a/luns/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a/luns/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a/luns/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a/luns/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] failed to remove resource iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a because of JDSS resource v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] delete target: iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] delete target iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] failed to remove resource iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a because of JDSS resource iqn.2010-10.org.openstack:3cd99089-1282-4efd-b9c6-7c2ee9c90a2a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] deleating volume v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] get snapshots for volume v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] get volume v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282514', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60425', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1571888273054627715', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4cf5aa967c64ab56', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774073344', 'san:volume_id': '4cf5aa967c64ab5655717668d9b1b0257d46dad0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37440', 'name': 'v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] delete volume:v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:31:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:31:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:31:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] volume v_3cd99089-1282-4efd-b9c6-7c2ee9c90a2a deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:31:39 user cinder-volume[73792]: DEBUG cinder.quota [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Created reservations ['f2fa7bef-8b90-4f1e-902f-28f1de8b9093', '51444126-84a1-4010-a6ba-2773a1d20bd5', 'b3e01533-7a39-4268-8e8e-c97aea84019e', '814dc97c-9ab2-480e-aad3-983c06fd84ec'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:31:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:31:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:31:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:31:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:31:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774142976', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:31:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:31:40 user cinder-volume[73792]: DEBUG cinder.manager [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:31:40 user cinder-volume[73792]: INFO cinder.volume.manager [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Deleted volume successfully.
Apr 12 06:31:40 user cinder-volume[73792]: DEBUG cinder.coordination [None req-214e70c0-4ef0-4f71-a03f-810dea4fdf34 tempest-VolumesAdminNegativeTest-1313851069 None] Lock "cinder-3cd99089-1282-4efd-b9c6-7c2ee9c90a2a-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:31:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=20,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:31:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=22,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:32:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:32:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:32:27 user cinder-volume[73792]: INFO cinder.action_track [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-133713086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Flow 'volume_create_manager' (b862ad98-1498-40a0-9f50-0e5dc468bb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a396f2-a97d-4f0c-9518-528d397ddb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a396f2-a97d-4f0c-9518-528d397ddb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-133713086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:32:27Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590e640a-9e7e-4053-9453-66f0c168989a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590e640a-9e7e-4053-9453-66f0c168989a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d0d9ed-3ce7-49a0-99b9-ccefbf5a7045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d0d9ed-3ce7-49a0-99b9-ccefbf5a7045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'volume_name': 'volume-9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b7354d-950a-4aff-a21a-b8e8c773433d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b7354d-950a-4aff-a21a-b8e8c773433d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3eedfe-93fd-4d5a-a165-713db0526dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:32:27 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Volume 9545da1e-1977-434b-9228-c5c2ff1cc9fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'volume_size': 1}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] creating volume v_9545da1e-1977-434b-9228-c5c2ff1cc9fc. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] create volume {'name': 'v_9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'is_clone': False, 'name': 'v_9545da1e-1977-434b-9228-c5c2ff1cc9fc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3eedfe-93fd-4d5a-a165-713db0526dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489ac3d4-8a62-4e33-adbe-6e78b5256fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:32:27 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Volume volume-9545da1e-1977-434b-9228-c5c2ff1cc9fc (9545da1e-1977-434b-9228-c5c2ff1cc9fc): created successfully
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489ac3d4-8a62-4e33-adbe-6e78b5256fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:32:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] Flow 'volume_create_manager' (b862ad98-1498-40a0-9f50-0e5dc468bb74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:32:27 user cinder-volume[73792]: INFO cinder.action_track [None req-0cfe0178-8c43-41d7-912e-cba3c60918a6 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-133713086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,launched_at=2023-04-12T06:32:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP flWMIBLP RnaPTthDQk0GSC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:32:27Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:32:27Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:30 user cinder-volume[73792]: INFO cinder.action_track [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-133713086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,launched_at=2023-04-12T06:32:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP flWMIBLP RnaPTthDQk0GSC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:32:27Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:32:30Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:30 user cinder-volume[73792]: INFO cinder.action_track [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-133713086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,launched_at=2023-04-12T06:32:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP flWMIBLP RnaPTthDQk0GSC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:32:27Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:32:30Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] create export for volume: 9545da1e-1977-434b-9228-c5c2ff1cc9fc. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] ensure volume 9545da1e-1977-434b-9228-c5c2ff1cc9fc assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] check if targe iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114774048768', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] create target and attach volume 9545da1e-1977-434b-9228-c5c2ff1cc9fc to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] create target iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:31 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Acquiring lock "cinder-fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:32:31 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Lock "cinder-fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:32:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] remove_export for volume: fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:32:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:32:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1405866328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5,launched_at=2023-04-12T06:28:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b656fa0bf05484889563c50ccc9a7e9',provider_auth='CHAP qkWfKHao ACnlPqc6kZXSQV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:28:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:32:31Z,updated_at=2023-04-12T06:32:31Z,use_quota=True,user_id='d682efe6338b4989beb714cce25e8e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:32:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] detach volume v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 from target iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:32:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/luns/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/luns/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] atach volume v_9545da1e-1977-434b-9228-c5c2ff1cc9fc to target iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:32:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/luns/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/luns/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] failed to remove resource iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 because of JDSS resource v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:32:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] delete target: iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:32:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] delete target iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:32:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:34 user cinder-volume[73792]: INFO cinder.action_track [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:30:59Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] terminate connection for c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:32:34 user cinder-volume[73792]: INFO cinder.action_track [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:30:59Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] Deleting attachment d2374a13-7899-49dc-8367-ba407e30a7ea. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] remove_export for volume: c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:30:59Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] detach volume v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 from target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3533323038376461', 'lun': 0, 'mode': 'wt', 'name': 'v_9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'prod_id': 'Storage', 'scsi_id': '532087dab5c9d75c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] add credentails to target iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] failed to remove resource iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 because of JDSS resource iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] deleating volume v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] get snapshots for volume v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] delete target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] delete target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'name': 'flWMIBLP'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] initialize_connection for 9545da1e-1977-434b-9228-c5c2ff1cc9fc 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:32:34 user cinder-volume[73792]: INFO cinder.action_track [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flWMIBLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '3818845c-af14-45a6-8b96-35d5a0cfb8bb'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-133713086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,launched_at=2023-04-12T06:32:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP flWMIBLP RnaPTthDQk0GSC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:32:27Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:32:30Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:34 user cinder-volume[73792]: INFO cinder.action_track [req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 req-dd0e0388-b79f-4eff-afe5-0ce72acb7ba2 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-133713086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,launched_at=2023-04-12T06:32:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP flWMIBLP RnaPTthDQk0GSC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:32:27Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:32:35Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-af0399c0-03c1-46e6-81f5-8dc39018326f tempest-ServerActionsTestJSON-752347644 None] target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:32:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] get volume v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:32:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282343', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60272', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13912532435391439102', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f220383533809ef5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774061056', 'san:volume_id': 'f220383533809ef59e3924b0007f58408c13c53f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38316', 'name': 'v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] delete volume:v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:32:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] volume v_fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.quota [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Created reservations ['ecfa3f76-677d-4be1-9f56-11354cf6d380', '36f60508-871a-493c-8a52-c888f06ec716', 'af3ecbf3-6b2b-43c6-989e-b44d50730277', '782b32d4-584b-402d-8c29-5743c5950cd9'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:36 user cinder-volume[73792]: INFO cinder.action_track [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='reserved',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:32:35Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:36 user cinder-volume[73792]: INFO cinder.action_track [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='reserved',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:32:35Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] create export for volume: c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] ensure volume c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] check if targe iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] create target and attach volume c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] create target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774155264', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.manager [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:32:36 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Deleted volume successfully.
Apr 12 06:32:36 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b6ff9e7b-a580-48f2-b7e9-b0d8414e2616 tempest-VolumesAdminNegativeTest-1313851069 None] Lock "cinder-fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5-delete_volume" released by "delete_volume" :: held 5.403s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:32:39 user cinder-volume[73792]: INFO cinder.action_track [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-snapshot-1171268208',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=fa791eeb-4190-4d1d-b3f9-ef9894ffc574,metadata={},progress='0%',project_id='1ebdd9f4006d413686bba37f22374759',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume=<?>,volume_id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] create snapshot fa791eeb-4190-4d1d-b3f9-ef9894ffc574 for volume 9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] cloning v_9545da1e-1977-434b-9228-c5c2ff1cc9fc to s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] create snapshot s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] atach volume v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 to target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_fa791eeb-4190-4d1d-b3f9-ef9894ffc574'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] create volume s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 from snapshot s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc@s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574', 'is_clone': True, 'full_name': 'Pool-0/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574', 'name': 's_fa791eeb-4190-4d1d-b3f9-ef9894ffc574'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] volume s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:32:40 user cinder-volume[73792]: INFO cinder.volume.manager [None req-1bb1eb21-900f-4f1e-9b12-b4e9f4416588 tempest-SnapshotDataIntegrityTests-2082659614 None] Create snapshot completed successfully
Apr 12 06:32:40 user cinder-volume[73792]: INFO cinder.action_track [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-snapshot-380912093',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=5b2af075-1f8f-41ca-bec6-2a439afd0c26,metadata={},progress='0%',project_id='1ebdd9f4006d413686bba37f22374759',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume=<?>,volume_id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] create snapshot 5b2af075-1f8f-41ca-bec6-2a439afd0c26 for volume 9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] cloning v_9545da1e-1977-434b-9228-c5c2ff1cc9fc to s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] create snapshot s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6538346464396661', 'lun': 0, 'mode': 'wt', 'name': 'v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'prod_id': 'Storage', 'scsi_id': 'e84dd9fa7eb9e238'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] add credentails to target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'name': 'akKCItqp'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] initialize_connection for c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:32:41 user cinder-volume[73792]: INFO cinder.action_track [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '856f0332-b737-476e-a57a-88ab04e8a750'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='reserved',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:32:35Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:41 user cinder-volume[73792]: INFO cinder.action_track [req-2aa97b26-595d-4611-a9b8-daed9a37f831 req-5b71b317-a7d4-45ee-b123-af156fef4e9a tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:32:41Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_5b2af075-1f8f-41ca-bec6-2a439afd0c26'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] create volume s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 from snapshot s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:32:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=55,cinder:UPDATE=16,cinder:DELETE=1,cinder:INSERT=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:32:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc@s_5b2af075-1f8f-41ca-bec6-2a439afd0c26', 'is_clone': True, 'full_name': 'Pool-0/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26', 'name': 's_5b2af075-1f8f-41ca-bec6-2a439afd0c26'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] volume s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:32:41 user cinder-volume[73792]: INFO cinder.volume.manager [None req-fa35a85d-1aa6-4fd8-8555-d3523728eb44 tempest-SnapshotDataIntegrityTests-2082659614 None] Create snapshot completed successfully
Apr 12 06:32:42 user cinder-volume[73792]: INFO cinder.action_track [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-snapshot-1034167500',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=d0d9e107-80ec-4bfc-867e-8e51873a07f4,metadata={},progress='0%',project_id='1ebdd9f4006d413686bba37f22374759',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume=<?>,volume_id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] create snapshot d0d9e107-80ec-4bfc-867e-8e51873a07f4 for volume 9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:32:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] cloning v_9545da1e-1977-434b-9228-c5c2ff1cc9fc to s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:32:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] create snapshot s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:32:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_d0d9e107-80ec-4bfc-867e-8e51873a07f4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] create volume s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 from snapshot s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:32:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc@s_d0d9e107-80ec-4bfc-867e-8e51873a07f4', 'is_clone': True, 'full_name': 'Pool-0/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4', 'name': 's_d0d9e107-80ec-4bfc-867e-8e51873a07f4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] volume s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:32:43 user cinder-volume[73792]: INFO cinder.volume.manager [None req-ef98be95-fff5-4986-8e05-66e04f73baba tempest-SnapshotDataIntegrityTests-2082659614 None] Create snapshot completed successfully
Apr 12 06:32:44 user cinder-volume[73792]: INFO cinder.action_track [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-133713086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,launched_at=2023-04-12T06:32:28Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP flWMIBLP RnaPTthDQk0GSC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:32:27Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:32:43Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] terminate connection for 9545da1e-1977-434b-9228-c5c2ff1cc9fc  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:32:44 user cinder-volume[73792]: INFO cinder.action_track [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-133713086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,launched_at=2023-04-12T06:32:28Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP flWMIBLP RnaPTthDQk0GSC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:32:27Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:32:43Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Deleting attachment 3818845c-af14-45a6-8b96-35d5a0cfb8bb. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] remove_export for volume: 9545da1e-1977-434b-9228-c5c2ff1cc9fc. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-133713086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,launched_at=2023-04-12T06:32:28Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP flWMIBLP RnaPTthDQk0GSC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:32:27Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:32:43Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume v_9545da1e-1977-434b-9228-c5c2ff1cc9fc from target iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/luns/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/luns/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/luns/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] delete target: iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] delete target iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:32:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:32:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:32:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 req-b373dab8-9044-42fd-a2dd-5798c90f41f5 tempest-SnapshotDataIntegrityTests-2082659614 None] target iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:33:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=56,cinder:UPDATE=19,cinder:INSERT=2,cinder:DELETE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:33:08 user cinder-volume[73792]: INFO cinder.action_track [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-882481842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8ce85a4c-100f-44cd-b4a4-a32bac7351a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Flow 'volume_create_manager' (f7d55090-bc54-4c1f-94df-c9f60b11d18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac658d9c-25dc-46fd-a62b-e77c529e931f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac658d9c-25dc-46fd-a62b-e77c529e931f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-882481842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8ce85a4c-100f-44cd-b4a4-a32bac7351a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:33:09Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67b86f8-091e-4c9f-b461-4d1dc9606507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67b86f8-091e-4c9f-b461-4d1dc9606507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc82839f-54d0-4a58-91f4-54054af89cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc82839f-54d0-4a58-91f4-54054af89cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce85a4c-100f-44cd-b4a4-a32bac7351a8', 'volume_name': 'volume-8ce85a4c-100f-44cd-b4a4-a32bac7351a8', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad794f5-e910-4fdf-aabb-fbfdd65b4fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad794f5-e910-4fdf-aabb-fbfdd65b4fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93396e43-11f4-4fe0-9fb8-f2514e29152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:08 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Volume 8ce85a4c-100f-44cd-b4a4-a32bac7351a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce85a4c-100f-44cd-b4a4-a32bac7351a8', 'volume_size': 1}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] creating volume v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] create volume {'name': 'v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8', 'is_clone': False, 'name': 'v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93396e43-11f4-4fe0-9fb8-f2514e29152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce85a4c-100f-44cd-b4a4-a32bac7351a8', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6590da5-a945-4dbd-8ef4-578d10f791de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:09 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Volume volume-8ce85a4c-100f-44cd-b4a4-a32bac7351a8 (8ce85a4c-100f-44cd-b4a4-a32bac7351a8): created successfully
Apr 12 06:33:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6590da5-a945-4dbd-8ef4-578d10f791de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Flow 'volume_create_manager' (f7d55090-bc54-4c1f-94df-c9f60b11d18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:33:09 user cinder-volume[73792]: INFO cinder.action_track [None req-aab5a8db-4975-4e45-9f57-11c8463009c0 tempest-ServerRescueNegativeTestJSON-1179647693 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-882481842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8ce85a4c-100f-44cd-b4a4-a32bac7351a8,launched_at=2023-04-12T06:33:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth='CHAP IiJUEloD P5ENf0UXk3wWOS',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:33:09Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:13 user cinder-volume[73792]: INFO cinder.action_track [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1072844948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7604ff57-70fb-4c5c-abde-c58dab75bf44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=15,cinder:DELETE=2,cinder:UPDATE=6 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Flow 'volume_create_manager' (5f974d1a-a6e4-4afe-9af5-7ebc13cbdb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed011823-1922-42c4-a66a-57a4a594e275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed011823-1922-42c4-a66a-57a4a594e275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1072844948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7604ff57-70fb-4c5c-abde-c58dab75bf44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:33:14Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c27c9d-d451-4316-bdc6-d103b7957290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c27c9d-d451-4316-bdc6-d103b7957290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c974ba-0ff6-4306-bbb2-a3c847c23152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c974ba-0ff6-4306-bbb2-a3c847c23152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7604ff57-70fb-4c5c-abde-c58dab75bf44', 'volume_name': 'volume-7604ff57-70fb-4c5c-abde-c58dab75bf44', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502cdcf7-06f1-4e73-a2ef-59ea196ef446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502cdcf7-06f1-4e73-a2ef-59ea196ef446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e1e935-0918-4a6b-b7fe-99cd8213b4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:13 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Volume 7604ff57-70fb-4c5c-abde-c58dab75bf44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7604ff57-70fb-4c5c-abde-c58dab75bf44', 'volume_size': 1}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] creating volume v_7604ff57-70fb-4c5c-abde-c58dab75bf44. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] create volume {'name': 'v_7604ff57-70fb-4c5c-abde-c58dab75bf44', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7604ff57-70fb-4c5c-abde-c58dab75bf44', 'is_clone': False, 'name': 'v_7604ff57-70fb-4c5c-abde-c58dab75bf44'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e1e935-0918-4a6b-b7fe-99cd8213b4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7604ff57-70fb-4c5c-abde-c58dab75bf44', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85acbf91-5ea3-4426-8bbe-f7513fc90ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:14 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Volume volume-7604ff57-70fb-4c5c-abde-c58dab75bf44 (7604ff57-70fb-4c5c-abde-c58dab75bf44): created successfully
Apr 12 06:33:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85acbf91-5ea3-4426-8bbe-f7513fc90ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] Flow 'volume_create_manager' (5f974d1a-a6e4-4afe-9af5-7ebc13cbdb74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:33:14 user cinder-volume[73792]: INFO cinder.action_track [None req-c2dd20cb-1e2d-4209-a7c9-921b8a1c92a8 tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1072844948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7604ff57-70fb-4c5c-abde-c58dab75bf44,launched_at=2023-04-12T06:33:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP SwscbTLM t1j6XwDNM5QUGc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:33:14Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:15 user cinder-volume[73792]: INFO cinder.action_track [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1072844948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7604ff57-70fb-4c5c-abde-c58dab75bf44,launched_at=2023-04-12T06:33:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP SwscbTLM t1j6XwDNM5QUGc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:33:15Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:15 user cinder-volume[73792]: INFO cinder.action_track [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1072844948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7604ff57-70fb-4c5c-abde-c58dab75bf44,launched_at=2023-04-12T06:33:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP SwscbTLM t1j6XwDNM5QUGc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:33:15Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] create export for volume: 7604ff57-70fb-4c5c-abde-c58dab75bf44. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:33:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] ensure volume 7604ff57-70fb-4c5c-abde-c58dab75bf44 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:33:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] check if targe iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:33:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] create target and attach volume 7604ff57-70fb-4c5c-abde-c58dab75bf44 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:33:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] create target iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:33:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] atach volume v_7604ff57-70fb-4c5c-abde-c58dab75bf44 to target iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:33:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3462623366343864', 'lun': 0, 'mode': 'wt', 'name': 'v_7604ff57-70fb-4c5c-abde-c58dab75bf44', 'prod_id': 'Storage', 'scsi_id': '4bb3f48d1291569e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] add credentails to target iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:33:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 201, 'error': None, 'data': {'name': 'SwscbTLM'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] initialize_connection for 7604ff57-70fb-4c5c-abde-c58dab75bf44 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:33:19 user cinder-volume[73792]: INFO cinder.action_track [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwscbTLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '00973a61-0443-4ebe-9af3-e328e59f2c74'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1072844948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7604ff57-70fb-4c5c-abde-c58dab75bf44,launched_at=2023-04-12T06:33:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP SwscbTLM t1j6XwDNM5QUGc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:33:15Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:19 user cinder-volume[73792]: INFO cinder.action_track [req-c30ccbcd-877b-4a51-9724-216e654931b7 req-b9687a06-5bbb-4b16-a0f4-be7803c83e6b tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1072844948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7604ff57-70fb-4c5c-abde-c58dab75bf44,launched_at=2023-04-12T06:33:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP SwscbTLM t1j6XwDNM5QUGc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:33:20Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:33:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:33:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:33:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114773012480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:33:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:33:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=29,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:33:33 user cinder-volume[73792]: INFO cinder.action_track [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1739752693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1352a4c5-edb1-4cf3-8768-5ef649fe2bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa791eeb-4190-4d1d-b3f9-ef9894ffc574,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Flow 'volume_create_manager' (3b0a304c-0c1b-40c4-83f2-835211256da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3edae73-0c2d-48af-9b41-aa5cd719d1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3edae73-0c2d-48af-9b41-aa5cd719d1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1739752693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1352a4c5-edb1-4cf3-8768-5ef649fe2bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa791eeb-4190-4d1d-b3f9-ef9894ffc574,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:33:34Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be77f9b4-e268-4a2c-a1d7-98fe4037d80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be77f9b4-e268-4a2c-a1d7-98fe4037d80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e6b13d-ed5e-494b-b70f-d260aa3d3986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e6b13d-ed5e-494b-b70f-d260aa3d3986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'volume_name': 'volume-1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'volume_size': 1, 'snapshot_id': 'fa791eeb-4190-4d1d-b3f9-ef9894ffc574'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafabb3d-0025-47bf-a3dc-e91ec19281ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafabb3d-0025-47bf-a3dc-e91ec19281ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c718279-04bc-4647-ac39-118eac6d7afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:34 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Volume 1352a4c5-edb1-4cf3-8768-5ef649fe2bf8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'volume_size': 1, 'snapshot_id': 'fa791eeb-4190-4d1d-b3f9-ef9894ffc574'}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] create volume 1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 from snapshot fa791eeb-4190-4d1d-b3f9-ef9894ffc574 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] cloning s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 to v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] create snapshot v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] create volume v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 from snapshot v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574@v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'is_clone': True, 'full_name': 'Pool-0/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'name': 'v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] get volume v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:33:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574@v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282632', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '60497', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15099220756849707497', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0691a44cdab35336', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772987904', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38915', 'name': 'v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c718279-04bc-4647-ac39-118eac6d7afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'volume_size': 1, 'snapshot_id': 'fa791eeb-4190-4d1d-b3f9-ef9894ffc574'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4083fbf7-6807-488f-b9b7-5e9a091a260c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:33:35 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Volume volume-1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 (1352a4c5-edb1-4cf3-8768-5ef649fe2bf8): created successfully
Apr 12 06:33:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4083fbf7-6807-488f-b9b7-5e9a091a260c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:33:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] Flow 'volume_create_manager' (3b0a304c-0c1b-40c4-83f2-835211256da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:33:35 user cinder-volume[73792]: INFO cinder.action_track [None req-825b276b-460a-4729-919b-18e96ddd4df9 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1739752693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1352a4c5-edb1-4cf3-8768-5ef649fe2bf8,launched_at=2023-04-12T06:33:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP wWDnsZuU a1tIDfWdnwqkZO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=fa791eeb-4190-4d1d-b3f9-ef9894ffc574,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:33:34Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:36 user cinder-volume[73792]: INFO cinder.action_track [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1739752693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1352a4c5-edb1-4cf3-8768-5ef649fe2bf8,launched_at=2023-04-12T06:33:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP wWDnsZuU a1tIDfWdnwqkZO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=fa791eeb-4190-4d1d-b3f9-ef9894ffc574,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:33:37Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:36 user cinder-volume[73792]: INFO cinder.action_track [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1739752693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1352a4c5-edb1-4cf3-8768-5ef649fe2bf8,launched_at=2023-04-12T06:33:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP wWDnsZuU a1tIDfWdnwqkZO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=fa791eeb-4190-4d1d-b3f9-ef9894ffc574,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:33:37Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] create export for volume: 1352a4c5-edb1-4cf3-8768-5ef649fe2bf8. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:33:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] ensure volume 1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:33:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] check if targe iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:33:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] create target and attach volume 1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:33:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] create target iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:33:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] atach volume v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 to target iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:33:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3036393161343463', 'lun': 0, 'mode': 'wt', 'name': 'v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'prod_id': 'Storage', 'scsi_id': '0691a44cdab35336'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] add credentails to target iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:33:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'name': 'wWDnsZuU'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] initialize_connection for 1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:33:41 user cinder-volume[73792]: INFO cinder.action_track [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWDnsZuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '59e05987-a2b8-4850-8239-a495a0a05aa9'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1739752693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1352a4c5-edb1-4cf3-8768-5ef649fe2bf8,launched_at=2023-04-12T06:33:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP wWDnsZuU a1tIDfWdnwqkZO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=fa791eeb-4190-4d1d-b3f9-ef9894ffc574,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:33:37Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:41 user cinder-volume[73792]: INFO cinder.action_track [req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 req-6d6a3681-b299-466c-ac6e-886d6ea7b8f5 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1739752693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1352a4c5-edb1-4cf3-8768-5ef649fe2bf8,launched_at=2023-04-12T06:33:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP wWDnsZuU a1tIDfWdnwqkZO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=fa791eeb-4190-4d1d-b3f9-ef9894ffc574,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:33:41Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-08b4324f-f523-496f-9e5a-a2837646c662 tempest-VolumesActionsTest-1914558791 None] Acquiring lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff" by "attach_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-08b4324f-f523-496f-9e5a-a2837646c662 tempest-VolumesActionsTest-1914558791 None] Lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff" acquired by "attach_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:33:43 user cinder-volume[73792]: INFO cinder.volume.manager [None req-08b4324f-f523-496f-9e5a-a2837646c662 tempest-VolumesActionsTest-1914558791 None] Attaching volume 8a97e458-f71b-43df-a273-03e227d9abff to instance 487bc635-136c-43b1-8cb2-f233a0beaa25 at mountpoint /dev/vdb on host None.
Apr 12 06:33:43 user cinder-volume[73792]: INFO cinder.action_track [None req-08b4324f-f523-496f-9e5a-a2837646c662 tempest-VolumesActionsTest-1914558791 None] ACTION:'volume_attach' MSG:'Attach volume completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:1512:attach_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538420119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8a97e458-f71b-43df-a273-03e227d9abff,launched_at=2023-04-12T06:29:10Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='4d0a755743544f7c97644faad13bdeb4',provider_auth='CHAP LshCmFfD HEt5vaDiTkoS4g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:33:43Z,use_quota=True,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-08b4324f-f523-496f-9e5a-a2837646c662 tempest-VolumesActionsTest-1914558791 None] Lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff" released by "attach_volume" :: held 0.087s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] Acquiring lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff-detach_volume" by "detach_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] Lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:33:43 user cinder-volume[73792]: INFO cinder.action_track [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] ACTION:'volume_detach' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538420119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8a97e458-f71b-43df-a273-03e227d9abff,launched_at=2023-04-12T06:29:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0a755743544f7c97644faad13bdeb4',provider_auth='CHAP LshCmFfD HEt5vaDiTkoS4g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:33:43Z,use_quota=True,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:43 user cinder-volume[73792]: INFO cinder.volume.manager [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] Detaching volume 8a97e458-f71b-43df-a273-03e227d9abff from instance 487bc635-136c-43b1-8cb2-f233a0beaa25.
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] remove_export for volume: 8a97e458-f71b-43df-a273-03e227d9abff. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538420119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8a97e458-f71b-43df-a273-03e227d9abff,launched_at=2023-04-12T06:29:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0a755743544f7c97644faad13bdeb4',provider_auth='CHAP LshCmFfD HEt5vaDiTkoS4g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:33:43Z,use_quota=True,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] detach volume v_8a97e458-f71b-43df-a273-03e227d9abff from target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] failed to remove resource iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff because of JDSS resource v_8a97e458-f71b-43df-a273-03e227d9abff DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] delete target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] delete target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] failed to remove resource iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff because of JDSS resource iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:33:43 user cinder-volume[73792]: INFO cinder.volume.manager [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] Detach volume completed successfully.
Apr 12 06:33:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-19981574-a357-4e47-bd40-fc7cef427b2f tempest-VolumesActionsTest-1914558791 None] Lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:33:45 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=12,cinder:SELECT=51,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:33:45 user cinder-volume[73792]: INFO cinder.action_track [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1739752693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1352a4c5-edb1-4cf3-8768-5ef649fe2bf8,launched_at=2023-04-12T06:33:35Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP wWDnsZuU a1tIDfWdnwqkZO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=fa791eeb-4190-4d1d-b3f9-ef9894ffc574,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:33:45Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] terminate connection for 1352a4c5-edb1-4cf3-8768-5ef649fe2bf8  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:33:45 user cinder-volume[73792]: INFO cinder.action_track [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1739752693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1352a4c5-edb1-4cf3-8768-5ef649fe2bf8,launched_at=2023-04-12T06:33:35Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP wWDnsZuU a1tIDfWdnwqkZO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=fa791eeb-4190-4d1d-b3f9-ef9894ffc574,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:33:45Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:33:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] Deleting attachment 59e05987-a2b8-4850-8239-a495a0a05aa9. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:33:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] remove_export for volume: 1352a4c5-edb1-4cf3-8768-5ef649fe2bf8. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:33:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:33:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1739752693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1352a4c5-edb1-4cf3-8768-5ef649fe2bf8,launched_at=2023-04-12T06:33:35Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP wWDnsZuU a1tIDfWdnwqkZO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=fa791eeb-4190-4d1d-b3f9-ef9894ffc574,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:33:45Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:33:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 from target iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:33:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/luns/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/luns/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/luns/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] delete target: iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:33:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] delete target iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:33:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:33:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:33:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:33:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dd9088a8-92c3-49e8-b725-7e814fa484eb req-2bf6e277-dd5b-407f-8f60-02b3d0de641c tempest-SnapshotDataIntegrityTests-2082659614 None] target iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:34:00 user cinder-volume[73792]: INFO cinder.action_track [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000468819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1079c4b6-625d-4d6c-9710-702e5aa785ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Flow 'volume_create_manager' (6fa12f36-43e7-4b79-93e2-a5c32d08a890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9906f0b9-6434-488b-bc50-fdd5ce006bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9906f0b9-6434-488b-bc50-fdd5ce006bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000468819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1079c4b6-625d-4d6c-9710-702e5aa785ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:34:00Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d4f467-3dcd-4ba6-a373-86997b7faf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d4f467-3dcd-4ba6-a373-86997b7faf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c2984d-e1e5-4fe5-8579-2cb53f32f82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c2984d-e1e5-4fe5-8579-2cb53f32f82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1079c4b6-625d-4d6c-9710-702e5aa785ec', 'volume_name': 'volume-1079c4b6-625d-4d6c-9710-702e5aa785ec', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61497be-5d94-4ed2-9247-ffac1541c93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61497be-5d94-4ed2-9247-ffac1541c93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2702754e-d30b-4950-af4d-21be52b15299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:00 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Volume 1079c4b6-625d-4d6c-9710-702e5aa785ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1079c4b6-625d-4d6c-9710-702e5aa785ec', 'volume_size': 1}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] creating volume v_1079c4b6-625d-4d6c-9710-702e5aa785ec. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] create volume {'name': 'v_1079c4b6-625d-4d6c-9710-702e5aa785ec', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1079c4b6-625d-4d6c-9710-702e5aa785ec', 'is_clone': False, 'name': 'v_1079c4b6-625d-4d6c-9710-702e5aa785ec'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2702754e-d30b-4950-af4d-21be52b15299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1079c4b6-625d-4d6c-9710-702e5aa785ec', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dac30c7-8f7f-48bc-87f1-5018914d803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:01 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Volume volume-1079c4b6-625d-4d6c-9710-702e5aa785ec (1079c4b6-625d-4d6c-9710-702e5aa785ec): created successfully
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dac30c7-8f7f-48bc-87f1-5018914d803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] Flow 'volume_create_manager' (6fa12f36-43e7-4b79-93e2-a5c32d08a890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:34:01 user cinder-volume[73792]: INFO cinder.action_track [None req-dfd56eec-4e5e-4539-b827-b7ffce12e045 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000468819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1079c4b6-625d-4d6c-9710-702e5aa785ec,launched_at=2023-04-12T06:34:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP sgCbTNoh gWHRFaleLEorzV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:34:00Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=12,cinder:SELECT=34,cinder:INSERT=2,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:34:01 user cinder-volume[73792]: INFO cinder.action_track [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000468819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1079c4b6-625d-4d6c-9710-702e5aa785ec,launched_at=2023-04-12T06:34:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP sgCbTNoh gWHRFaleLEorzV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:34:01Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:01 user cinder-volume[73792]: INFO cinder.action_track [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000468819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1079c4b6-625d-4d6c-9710-702e5aa785ec,launched_at=2023-04-12T06:34:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP sgCbTNoh gWHRFaleLEorzV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:34:01Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] create export for volume: 1079c4b6-625d-4d6c-9710-702e5aa785ec. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] ensure volume 1079c4b6-625d-4d6c-9710-702e5aa785ec assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] check if targe iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] create target and attach volume 1079c4b6-625d-4d6c-9710-702e5aa785ec to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] create target iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] atach volume v_1079c4b6-625d-4d6c-9710-702e5aa785ec to target iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:34:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3638326535633933', 'lun': 0, 'mode': 'wt', 'name': 'v_1079c4b6-625d-4d6c-9710-702e5aa785ec', 'prod_id': 'Storage', 'scsi_id': '682e5c93c878868d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] add credentails to target iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:34:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 201, 'error': None, 'data': {'name': 'sgCbTNoh'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] initialize_connection for 1079c4b6-625d-4d6c-9710-702e5aa785ec 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:34:06 user cinder-volume[73792]: INFO cinder.action_track [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgCbTNoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '1cf78530-d179-4e72-9b3a-e0c0a28a5af3'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000468819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1079c4b6-625d-4d6c-9710-702e5aa785ec,launched_at=2023-04-12T06:34:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP sgCbTNoh gWHRFaleLEorzV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:34:01Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:06 user cinder-volume[73792]: INFO cinder.action_track [req-e09b053a-8218-4774-810b-fb94e9bb42cc req-2a59e081-70df-4b21-be38-85c894f0bfb4 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000468819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1079c4b6-625d-4d6c-9710-702e5aa785ec,launched_at=2023-04-12T06:34:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP sgCbTNoh gWHRFaleLEorzV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:34:06Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:09 user cinder-volume[73792]: INFO cinder.action_track [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569583853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d4c733b5-a4df-4f96-8d98-ecf3eef24f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Flow 'volume_create_manager' (75418a66-44ba-44e7-a0b6-69cf997acf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd835d51-0399-4047-a364-9e2139390f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd835d51-0399-4047-a364-9e2139390f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569583853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d4c733b5-a4df-4f96-8d98-ecf3eef24f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:34:09Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bd74c0-fe55-463b-bbf5-a946771e0a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bd74c0-fe55-463b-bbf5-a946771e0a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af613096-b4ef-4eea-9ce1-b0584e06fc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af613096-b4ef-4eea-9ce1-b0584e06fc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'volume_name': 'volume-d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9731ee54-aebf-4a6a-9f59-bbf9e933f926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9731ee54-aebf-4a6a-9f59-bbf9e933f926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53884420-a60d-4e67-a797-72c1973528bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:09 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Volume d4c733b5-a4df-4f96-8d98-ecf3eef24f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'volume_size': 1}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] creating volume v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] create volume {'name': 'v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'is_clone': False, 'name': 'v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53884420-a60d-4e67-a797-72c1973528bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1b3e76-1454-497a-adb2-0ce6882bfdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:10 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Volume volume-d4c733b5-a4df-4f96-8d98-ecf3eef24f50 (d4c733b5-a4df-4f96-8d98-ecf3eef24f50): created successfully
Apr 12 06:34:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1b3e76-1454-497a-adb2-0ce6882bfdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] Flow 'volume_create_manager' (75418a66-44ba-44e7-a0b6-69cf997acf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:34:10 user cinder-volume[73792]: INFO cinder.action_track [None req-c4b8044d-fa8f-46dc-8f4b-7cdb899d5c20 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569583853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d4c733b5-a4df-4f96-8d98-ecf3eef24f50,launched_at=2023-04-12T06:34:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP UMgQWNlT zwRTAyG2dS4Heu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:34:09Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:11 user cinder-volume[73792]: INFO cinder.action_track [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569583853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d4c733b5-a4df-4f96-8d98-ecf3eef24f50,launched_at=2023-04-12T06:34:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP UMgQWNlT zwRTAyG2dS4Heu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:34:11Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:11 user cinder-volume[73792]: INFO cinder.action_track [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569583853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d4c733b5-a4df-4f96-8d98-ecf3eef24f50,launched_at=2023-04-12T06:34:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP UMgQWNlT zwRTAyG2dS4Heu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:34:11Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] create export for volume: d4c733b5-a4df-4f96-8d98-ecf3eef24f50. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:34:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] ensure volume d4c733b5-a4df-4f96-8d98-ecf3eef24f50 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:34:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] check if targe iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:34:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] create target and attach volume d4c733b5-a4df-4f96-8d98-ecf3eef24f50 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:34:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] create target iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:34:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] atach volume v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 to target iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:34:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3565666637363964', 'lun': 0, 'mode': 'wt', 'name': 'v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'prod_id': 'Storage', 'scsi_id': '5eff769dc489c780'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] add credentails to target iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:34:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 201, 'error': None, 'data': {'name': 'UMgQWNlT'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] initialize_connection for d4c733b5-a4df-4f96-8d98-ecf3eef24f50 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:34:15 user cinder-volume[73792]: INFO cinder.action_track [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMgQWNlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '9c264edb-34f6-4920-afb0-f5a937c43a2c'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569583853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d4c733b5-a4df-4f96-8d98-ecf3eef24f50,launched_at=2023-04-12T06:34:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP UMgQWNlT zwRTAyG2dS4Heu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:34:11Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:15 user cinder-volume[73792]: INFO cinder.action_track [req-7e7fe8d4-de57-479a-9700-782b3233011e req-b63f9475-397c-4abf-9335-25d8a7fa1e57 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569583853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d4c733b5-a4df-4f96-8d98-ecf3eef24f50,launched_at=2023-04-12T06:34:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP UMgQWNlT zwRTAyG2dS4Heu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:34:15Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=35,cinder:UPDATE=7 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:34:19 user cinder-volume[73792]: INFO cinder.action_track [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000468819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1079c4b6-625d-4d6c-9710-702e5aa785ec,launched_at=2023-04-12T06:34:01Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP sgCbTNoh gWHRFaleLEorzV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:34:19Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] terminate connection for 1079c4b6-625d-4d6c-9710-702e5aa785ec  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:34:19 user cinder-volume[73792]: INFO cinder.action_track [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000468819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1079c4b6-625d-4d6c-9710-702e5aa785ec,launched_at=2023-04-12T06:34:01Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP sgCbTNoh gWHRFaleLEorzV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:34:19Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] Deleting attachment 1cf78530-d179-4e72-9b3a-e0c0a28a5af3. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] remove_export for volume: 1079c4b6-625d-4d6c-9710-702e5aa785ec. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000468819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1079c4b6-625d-4d6c-9710-702e5aa785ec,launched_at=2023-04-12T06:34:01Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP sgCbTNoh gWHRFaleLEorzV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:34:19Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] detach volume v_1079c4b6-625d-4d6c-9710-702e5aa785ec from target iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/luns/v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/luns/v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/luns/v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] delete target: iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] delete target iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 req-a8bd21a2-dbfa-4793-80fb-d2e062bd1b7b tempest-AttachVolumeTestJSON-1680327736 None] target iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:34:21 user cinder-volume[73792]: INFO cinder.action_track [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569583853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d4c733b5-a4df-4f96-8d98-ecf3eef24f50,launched_at=2023-04-12T06:34:10Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP UMgQWNlT zwRTAyG2dS4Heu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:34:21Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] terminate connection for d4c733b5-a4df-4f96-8d98-ecf3eef24f50  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:34:21 user cinder-volume[73792]: INFO cinder.action_track [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569583853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d4c733b5-a4df-4f96-8d98-ecf3eef24f50,launched_at=2023-04-12T06:34:10Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP UMgQWNlT zwRTAyG2dS4Heu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:34:21Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] Deleting attachment 9c264edb-34f6-4920-afb0-f5a937c43a2c. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:34:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] remove_export for volume: d4c733b5-a4df-4f96-8d98-ecf3eef24f50. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:34:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:34:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569583853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d4c733b5-a4df-4f96-8d98-ecf3eef24f50,launched_at=2023-04-12T06:34:10Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP UMgQWNlT zwRTAyG2dS4Heu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:34:21Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:34:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] detach volume v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 from target iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:34:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/luns/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/luns/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/luns/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] delete target: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:34:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] delete target iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:34:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-99cff04b-84fb-457e-8164-18eb6716a938 req-9d239c5a-042e-41e6-a6c1-5e377e7ec0b5 tempest-AttachVolumeTestJSON-1680327736 None] target iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:34:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:34:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:34:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:34:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114772656128', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:34:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:34:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=41,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:34:35 user cinder-volume[73792]: INFO cinder.action_track [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-788422349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=06ddc1aa-31ff-4da3-b156-9b5e7f11274b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b2af075-1f8f-41ca-bec6-2a439afd0c26,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Flow 'volume_create_manager' (17c7e357-b3bd-43c9-adc7-21c2c2ccb668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9982220a-1257-46e8-aee6-44ce6f1363c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9982220a-1257-46e8-aee6-44ce6f1363c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-788422349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=06ddc1aa-31ff-4da3-b156-9b5e7f11274b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b2af075-1f8f-41ca-bec6-2a439afd0c26,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:34:35Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696c577b-80a8-4d17-b86f-5c1cca221a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696c577b-80a8-4d17-b86f-5c1cca221a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6929581d-09fb-401b-9c1e-768d31ea1f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6929581d-09fb-401b-9c1e-768d31ea1f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'volume_name': 'volume-06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'volume_size': 1, 'snapshot_id': '5b2af075-1f8f-41ca-bec6-2a439afd0c26'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d09021-652a-43d9-b698-55116f18c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d09021-652a-43d9-b698-55116f18c918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a6bb69-f4d0-4636-b91f-4b5fff99be8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:35 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Volume 06ddc1aa-31ff-4da3-b156-9b5e7f11274b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'volume_size': 1, 'snapshot_id': '5b2af075-1f8f-41ca-bec6-2a439afd0c26'}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] create volume 06ddc1aa-31ff-4da3-b156-9b5e7f11274b from snapshot 5b2af075-1f8f-41ca-bec6-2a439afd0c26 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] cloning s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 to v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] create snapshot v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:35 user cinder-volume[73792]: INFO cinder.action_track [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] ACTION:'volume_copy_to_image' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:None 
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.driver [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] copy_volume_to_image volume-8a97e458-f71b-43df-a273-03e227d9abff. {{(pid=73792) copy_volume_to_image /opt/stack/cinder/cinder/volume/driver.py:930}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG os_brick.utils [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbe95d2-0fb8-4c59-9ea1-d310067c0d71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b88a3-d0ce-431a-9edb-a74f899ec2f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83010a0-ef8a-44e8-b188-6fda9e592c79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc92f7a-e0ab-44fd-80b1-ed5599f5520c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Running cmd (subprocess): nvme version {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] 'nvme version' failed. Not Retrying. {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] nvme not present on system {{(pid=73792) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:34:35 user cinder-volume[73792]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a546728-6e47-480d-8f2f-2cb2175c9e6a]: (4, '') {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73792) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73792) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] LIGHTOS: no hostnqn found. {{(pid=73792) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG os_brick.utils [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.driver [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Volume 8a97e458-f71b-43df-a273-03e227d9abff: creating export {{(pid=73792) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] create export for volume: 8a97e458-f71b-43df-a273-03e227d9abff. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] ensure volume 8a97e458-f71b-43df-a273-03e227d9abff assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] check if targe iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] create target and attach volume 8a97e458-f71b-43df-a273-03e227d9abff to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] create target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] create volume v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b from snapshot v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26@v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'is_clone': True, 'full_name': 'Pool-0/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'name': 'v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] get volume v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:34:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26@v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282693', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '60535', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13806126494192094107', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8ea31ca034cdc9db', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772631552', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38369', 'name': 'v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a6bb69-f4d0-4636-b91f-4b5fff99be8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'volume_size': 1, 'snapshot_id': '5b2af075-1f8f-41ca-bec6-2a439afd0c26'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb3c5bb-cb5a-4c01-9df8-335114cd882a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:34:36 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Volume volume-06ddc1aa-31ff-4da3-b156-9b5e7f11274b (06ddc1aa-31ff-4da3-b156-9b5e7f11274b): created successfully
Apr 12 06:34:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb3c5bb-cb5a-4c01-9df8-335114cd882a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:34:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] Flow 'volume_create_manager' (17c7e357-b3bd-43c9-adc7-21c2c2ccb668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:34:36 user cinder-volume[73792]: INFO cinder.action_track [None req-57bf994a-dc15-45e4-9bc6-9b303d6f0765 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-788422349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=06ddc1aa-31ff-4da3-b156-9b5e7f11274b,launched_at=2023-04-12T06:34:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP TFnrsXSe NY1pH6qkhwJdAl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=5b2af075-1f8f-41ca-bec6-2a439afd0c26,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:34:35Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:38 user cinder-volume[73792]: INFO cinder.action_track [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-788422349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=06ddc1aa-31ff-4da3-b156-9b5e7f11274b,launched_at=2023-04-12T06:34:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP TFnrsXSe NY1pH6qkhwJdAl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=5b2af075-1f8f-41ca-bec6-2a439afd0c26,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:34:38Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:38 user cinder-volume[73792]: INFO cinder.action_track [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-788422349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=06ddc1aa-31ff-4da3-b156-9b5e7f11274b,launched_at=2023-04-12T06:34:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP TFnrsXSe NY1pH6qkhwJdAl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=5b2af075-1f8f-41ca-bec6-2a439afd0c26,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:34:38Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] create export for volume: 06ddc1aa-31ff-4da3-b156-9b5e7f11274b. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] ensure volume 06ddc1aa-31ff-4da3-b156-9b5e7f11274b assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] check if targe iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] create target and attach volume 06ddc1aa-31ff-4da3-b156-9b5e7f11274b to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] create target iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] atach volume v_8a97e458-f71b-43df-a273-03e227d9abff to target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3132383434633137', 'lun': 0, 'mode': 'wt', 'name': 'v_8a97e458-f71b-43df-a273-03e227d9abff', 'prod_id': 'Storage', 'scsi_id': '12844c17d7df4b13'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] add credentails to target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 201, 'error': None, 'data': {'name': 'LshCmFfD'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] initialize_connection for 8a97e458-f71b-43df-a273-03e227d9abff 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connector [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Factory for iscsi on None {{(pid=73792) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8769c7dff0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LshCmFfD', 'auth_password': '***', 'target_lun': False}}" {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:34:39 user cinder-volume[73792]: INFO os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a90167f-0c86-42c5-b44d-1e48c2a7c0aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:34:39 user cinder-volume[73792]:  {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --interface default --op new {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1697992-3c2b-46ac-9f9c-d710a417b631]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff] added\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff] added
Apr 12 06:34:39 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d10a076-c276-4a6c-be2d-6e8017a9e12a]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[01badc41-de0d-4256-a97e-85fbdaa2922f]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LshCmFfD {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LshCmFfD" returned: 0 in 0.018s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2be800-300a-42a4-9a87-42bb35ed1a71]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LshCmFfD'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[e733c12c-e0a7-43a6-b95f-e3689701a8bb]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fa42d7-e8e2-4ce6-951b-d314cc56b91e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:39 user cinder-volume[73792]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:39 user cinder-volume[73792]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:39 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:39 user cinder-volume[73792]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:39 user cinder-volume[73792]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:39 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --login {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fc5050-38dc-4f58-916d-ef5802ef4ab5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff, portal: 172.16.0.220,3260]
Apr 12 06:34:39 user cinder-volume[73792]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff, portal: 172.16.0.220,3260] successful.
Apr 12 06:34:39 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37a0bbc-cfef-4dfe-895f-e259b342289d]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:39 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb4f5d9-0407-4b1d-8164-80ba08462866]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:40 user cinder-volume[73792]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:40 user cinder-volume[73792]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:40 user cinder-volume[73792]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)
Apr 12 06:34:40 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:40 user cinder-volume[73792]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:40 user cinder-volume[73792]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:40 user cinder-volume[73792]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)
Apr 12 06:34:40 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Connected to 172.16.0.220:3260 {{(pid=73792) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=73792) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Scanning host 36 c: -, t: -, l: 0) {{(pid=73792) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[72726935-bf74-4c58-9ff5-f9eae3db6ea0]: (4, ('- - 0', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73792) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LshCmFfD', 'auth_password': '***', 'target_lun': False} {{(pid=73792) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] atach volume v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b to target iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:41 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:34:41 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23132383434633137', 'path': '/dev/sde'} {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:34:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sde of=/dev/null count=1 {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sde of=/dev/null count=1" returned: 0 in 0.016s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:41 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[1951a105-45f3-4393-8ddf-92550c2462d8]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.00224541 s, 228 kB/s\n')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:41 user cinder-volume[73792]: DEBUG cinder.image.image_utils [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] abd3e585-59f4-4a6d-af04-840b43cd4c5d was raw, no need to convert to raw {{(pid=73792) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1004}}
Apr 12 06:34:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sde {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:41 user sudo[92877]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sde
Apr 12 06:34:41 user sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:34:41 user sudo[92877]: pam_unix(sudo:session): session closed for user root
Apr 12 06:34:41 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sde" returned: 0 in 0.664s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3865613331636130', 'lun': 0, 'mode': 'wt', 'name': 'v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'prod_id': 'Storage', 'scsi_id': '8ea31ca034cdc9db'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] add credentails to target iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:34:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'name': 'TFnrsXSe'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] initialize_connection for 06ddc1aa-31ff-4da3-b156-9b5e7f11274b 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:34:42 user cinder-volume[73792]: INFO cinder.action_track [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFnrsXSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '98714877-d03b-465e-a81e-d5ee514df3d7'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-788422349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=06ddc1aa-31ff-4da3-b156-9b5e7f11274b,launched_at=2023-04-12T06:34:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP TFnrsXSe NY1pH6qkhwJdAl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=5b2af075-1f8f-41ca-bec6-2a439afd0c26,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:34:38Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:42 user cinder-volume[73792]: INFO cinder.action_track [req-7e7f4477-d9dc-4fba-9f40-6fea68258299 req-aa401c20-81da-42c7-99ae-bee46cf79b2d tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-788422349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=06ddc1aa-31ff-4da3-b156-9b5e7f11274b,launched_at=2023-04-12T06:34:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP TFnrsXSe NY1pH6qkhwJdAl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=5b2af075-1f8f-41ca-bec6-2a439afd0c26,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:34:42Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:45 user cinder-volume[73792]: INFO cinder.action_track [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-788422349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=06ddc1aa-31ff-4da3-b156-9b5e7f11274b,launched_at=2023-04-12T06:34:36Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP TFnrsXSe NY1pH6qkhwJdAl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=5b2af075-1f8f-41ca-bec6-2a439afd0c26,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:34:45Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] terminate connection for 06ddc1aa-31ff-4da3-b156-9b5e7f11274b  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:34:45 user cinder-volume[73792]: INFO cinder.action_track [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-788422349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=06ddc1aa-31ff-4da3-b156-9b5e7f11274b,launched_at=2023-04-12T06:34:36Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP TFnrsXSe NY1pH6qkhwJdAl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=5b2af075-1f8f-41ca-bec6-2a439afd0c26,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:34:45Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:34:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] Deleting attachment 98714877-d03b-465e-a81e-d5ee514df3d7. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:34:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] remove_export for volume: 06ddc1aa-31ff-4da3-b156-9b5e7f11274b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:34:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:34:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-788422349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=06ddc1aa-31ff-4da3-b156-9b5e7f11274b,launched_at=2023-04-12T06:34:36Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP TFnrsXSe NY1pH6qkhwJdAl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=5b2af075-1f8f-41ca-bec6-2a439afd0c26,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:34:45Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:34:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b from target iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:34:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/luns/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/luns/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/luns/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] delete target: iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:34:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] delete target iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:34:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc req-0925e9f1-cbfb-4e1c-9a51-f0751e0fdbc9 tempest-SnapshotDataIntegrityTests-2082659614 None] target iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:34:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:34:56 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:56 user sudo[93058]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde
Apr 12 06:34:56 user sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:34:57 user sudo[93058]: pam_unix(sudo:session): session closed for user root
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.745s {{(pid=73792) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8769c7dff0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LshCmFfD', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '23132383434633137', 'path': '/dev/sde'}), 'kwargs': {'force': True}}" {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf34b54-ca0b-4566-bdfb-d956b359cf1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:34:57 user cinder-volume[73792]: No targets found.
Apr 12 06:34:57 user cinder-volume[73792]: iSNS:
Apr 12 06:34:57 user cinder-volume[73792]: No targets found.
Apr 12 06:34:57 user cinder-volume[73792]: STATIC:
Apr 12 06:34:57 user cinder-volume[73792]: Target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7
Apr 12 06:34:57 user cinder-volume[73792]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:57 user cinder-volume[73792]:                 Iface Name: default
Apr 12 06:34:57 user cinder-volume[73792]: Target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff
Apr 12 06:34:57 user cinder-volume[73792]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:57 user cinder-volume[73792]:                 Iface Name: default
Apr 12 06:34:57 user cinder-volume[73792]: Target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44
Apr 12 06:34:57 user cinder-volume[73792]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:57 user cinder-volume[73792]:                 Iface Name: default
Apr 12 06:34:57 user cinder-volume[73792]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:34:57 user cinder-volume[73792]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:57 user cinder-volume[73792]:                 Iface Name: default
Apr 12 06:34:57 user cinder-volume[73792]: FIRMWARE:
Apr 12 06:34:57 user cinder-volume[73792]: No targets found.
Apr 12 06:34:57 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:34:57 user cinder-volume[73792]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:34:57 user cinder-volume[73792]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=73792) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff', 0)] {{(pid=73792) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b66250-6d32-46cb-8455-dc9e68ded090]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd5eb82-6acb-4945-8332-7c941ba53061]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:57 user cinder-volume[73792]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:57 user cinder-volume[73792]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:57 user cinder-volume[73792]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)
Apr 12 06:34:57 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:57 user cinder-volume[73792]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:57 user cinder-volume[73792]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:57 user cinder-volume[73792]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)
Apr 12 06:34:57 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f87600d7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff'): ({'sde'}, set())}) {{(pid=73792) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Removing single pathed devices sde {{(pid=73792) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4d9776-c89e-4d9d-8b9e-b660cfb7e5c8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d10ba1-8cff-47d2-8cd3-b753d01aabb4]: (4, ('ok\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Flushing IO for device /dev/sde {{(pid=73792) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14188b9-abca-4424-97da-b5627374bac0]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73792) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1d8f62-bd2a-4f82-b83f-271302208960]: (4, ('1', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Checking to see if SCSI volumes sde have been removed. {{(pid=73792) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.linuxscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] SCSI volumes sde have been removed. {{(pid=73792) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff')] {{(pid=73792) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[9480c4f9-ae62-4272-b792-4e0af99ebe13]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --logout {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[d695ffd2-a068-4e69-a09b-e8b811c63af8]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff, portal: 172.16.0.220,3260]
Apr 12 06:34:57 user cinder-volume[73792]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff, portal: 172.16.0.220,3260] successful.
Apr 12 06:34:57 user cinder-volume[73792]:  stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op delete {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=80953) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7aeb33-0cc4-4d3f-b1ce-e85832a5391a]: (4, ('', '')) {{(pid=80953) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73792) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.base [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73792) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] <== disconnect_volume: return (315ms) None {{(pid=73792) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] terminate connection for 8a97e458-f71b-43df-a273-03e227d9abff  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG cinder.volume.driver [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] volume 8a97e458-f71b-43df-a273-03e227d9abff: removing export {{(pid=73792) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] remove_export for volume: 8a97e458-f71b-43df-a273-03e227d9abff. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538420119',ec2_id=None,encryption_key_id=None,glance_metadata={},group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8a97e458-f71b-43df-a273-03e227d9abff,launched_at=2023-04-12T06:29:10Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='4d0a755743544f7c97644faad13bdeb4',provider_auth='CHAP LshCmFfD HEt5vaDiTkoS4g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='uploading',terminated_at=None,updated_at=2023-04-12T06:34:35Z,use_quota=True,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] detach volume v_8a97e458-f71b-43df-a273-03e227d9abff from target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] delete target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:34:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] delete target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:34:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:34:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:34:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:34:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:34:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Uploaded volume to glance image-id: abd3e585-59f4-4a6d-af04-840b43cd4c5d. {{(pid=73792) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1813}}
Apr 12 06:34:58 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a8a60163-bb08-4e8c-87f8-9b1f3bf7b3c7 tempest-VolumesActionsTest-1914558791 None] Copy volume to image completed successfully.
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.coordination [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Acquiring lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.coordination [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] remove_export for volume: 8a97e458-f71b-43df-a273-03e227d9abff. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='False'},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538420119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8a97e458-f71b-43df-a273-03e227d9abff,launched_at=2023-04-12T06:29:10Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='4d0a755743544f7c97644faad13bdeb4',provider_auth='CHAP LshCmFfD HEt5vaDiTkoS4g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:35:00Z,updated_at=2023-04-12T06:35:00Z,use_quota=True,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] detach volume v_8a97e458-f71b-43df-a273-03e227d9abff from target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff/luns/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] failed to remove resource iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff because of JDSS resource v_8a97e458-f71b-43df-a273-03e227d9abff DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] delete target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] delete target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] failed to remove resource iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff because of JDSS resource iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] deleating volume v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] get snapshots for volume v_8a97e458-f71b-43df-a273-03e227d9abff  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a97e458-f71b-43df-a273-03e227d9abff/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a97e458-f71b-43df-a273-03e227d9abff/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a97e458-f71b-43df-a273-03e227d9abff/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] get volume v_8a97e458-f71b-43df-a273-03e227d9abff info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8a97e458-f71b-43df-a273-03e227d9abff', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282366', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60302', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6778898300175649047', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '12844c17d7df4b13', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772500480', 'san:volume_id': '12844c17d7df4b136842d7fc4c7833a7ef0d1495', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '36605', 'name': 'v_8a97e458-f71b-43df-a273-03e227d9abff', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] delete volume:v_8a97e458-f71b-43df-a273-03e227d9abff recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a97e458-f71b-43df-a273-03e227d9abff {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] volume v_8a97e458-f71b-43df-a273-03e227d9abff deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:35:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=41,cinder:UPDATE=9 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:35:01 user cinder-volume[73792]: DEBUG cinder.quota [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Created reservations ['978bbcd0-d974-450b-8568-94276428c251', '33993ddb-2c79-47e0-a84e-d7e1aea53389', '8ee76362-ddd7-48c3-a6a5-0d383481baed', '185497b0-134c-46dc-81cc-2e1e39acf800'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:35:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:35:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:35:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Geting {'code': 200, 'error': None, 'data': {'available': '114772594688', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:35:02 user cinder-volume[73792]: DEBUG cinder.manager [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:35:02 user cinder-volume[73792]: INFO cinder.volume.manager [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Deleted volume successfully.
Apr 12 06:35:02 user cinder-volume[73792]: DEBUG cinder.coordination [None req-88479ab3-a494-4467-8e1f-67a1f2a43a47 tempest-VolumesActionsTest-1914558791 None] Lock "cinder-8a97e458-f71b-43df-a273-03e227d9abff-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.coordination [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Acquiring lock "cinder-d4c733b5-a4df-4f96-8d98-ecf3eef24f50-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.coordination [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Lock "cinder-d4c733b5-a4df-4f96-8d98-ecf3eef24f50-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] remove_export for volume: d4c733b5-a4df-4f96-8d98-ecf3eef24f50. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-569583853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d4c733b5-a4df-4f96-8d98-ecf3eef24f50,launched_at=2023-04-12T06:34:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP UMgQWNlT zwRTAyG2dS4Heu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:35:15Z,updated_at=2023-04-12T06:35:15Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] detach volume v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 from target iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/luns/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/luns/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/luns/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50/luns/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] failed to remove resource iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 because of JDSS resource v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] delete target: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] delete target iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] failed to remove resource iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 because of JDSS resource iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] deleating volume v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] get snapshots for volume v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] get volume v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:35:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282667', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60521', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7583600441548565588', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5eff769dc489c780', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772594688', 'san:volume_id': '5eff769dc489c780d4cb1f64e7173451fb6f481b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38353', 'name': 'v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] delete volume:v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:35:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] volume v_d4c733b5-a4df-4f96-8d98-ecf3eef24f50 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:35:16 user cinder-volume[73792]: DEBUG cinder.quota [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Created reservations ['e6c29253-8395-4804-879b-c9cbd71c4410', '75dbd47e-90b2-4a84-8647-25ec600a2226', 'f8e2bba7-67c8-41a9-8c39-6e7292bfca99', '6adc2bc6-ce3f-429c-8247-dec9945c7a05'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:35:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:35:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:35:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Acquiring lock "cinder-1079c4b6-625d-4d6c-9710-702e5aa785ec-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Lock "cinder-1079c4b6-625d-4d6c-9710-702e5aa785ec-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 200, 'error': None, 'data': {'available': '114772676608', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.manager [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:35:17 user cinder-volume[73792]: INFO cinder.volume.manager [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Deleted volume successfully.
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] remove_export for volume: 1079c4b6-625d-4d6c-9710-702e5aa785ec. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000468819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1079c4b6-625d-4d6c-9710-702e5aa785ec,launched_at=2023-04-12T06:34:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP sgCbTNoh gWHRFaleLEorzV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:35:17Z,updated_at=2023-04-12T06:35:17Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] detach volume v_1079c4b6-625d-4d6c-9710-702e5aa785ec from target iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/luns/v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/luns/v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-70a97b44-240f-4252-bdd3-eab5dc5a0b34 tempest-AttachVolumeTestJSON-1680327736 None] Lock "cinder-d4c733b5-a4df-4f96-8d98-ecf3eef24f50-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/luns/v_1079c4b6-625d-4d6c-9710-702e5aa785ec'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec/luns/v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] failed to remove resource iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec because of JDSS resource v_1079c4b6-625d-4d6c-9710-702e5aa785ec DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] delete target: iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] delete target iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] failed to remove resource iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec because of JDSS resource iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] deleating volume v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] get snapshots for volume v_1079c4b6-625d-4d6c-9710-702e5aa785ec  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1079c4b6-625d-4d6c-9710-702e5aa785ec/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1079c4b6-625d-4d6c-9710-702e5aa785ec/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1079c4b6-625d-4d6c-9710-702e5aa785ec/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] get volume v_1079c4b6-625d-4d6c-9710-702e5aa785ec info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1079c4b6-625d-4d6c-9710-702e5aa785ec', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282658', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60513', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8124551858601820107', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '682e5c93c878868d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772676608', 'san:volume_id': '682e5c93c878868d98979d8c4e382b74b9838c26', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38179', 'name': 'v_1079c4b6-625d-4d6c-9710-702e5aa785ec', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] delete volume:v_1079c4b6-625d-4d6c-9710-702e5aa785ec recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1079c4b6-625d-4d6c-9710-702e5aa785ec {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] volume v_1079c4b6-625d-4d6c-9710-702e5aa785ec deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:35:18 user cinder-volume[73792]: DEBUG cinder.quota [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Created reservations ['81ab80a8-04a2-4ad3-945e-e73523f8aeaa', 'f4253821-29ab-4ff0-8386-542e24e95ea7', 'ad990186-c777-4263-8370-9c6e1eaba203', '88b05d12-49ea-4c62-a7d6-133169579789'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:35:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:35:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:35:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 200, 'error': None, 'data': {'available': '114772758528', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.manager [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:35:19 user cinder-volume[73792]: INFO cinder.volume.manager [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Deleted volume successfully.
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ad3d9dd6-0983-45fd-8e83-dffb9e1cc39d tempest-AttachVolumeTestJSON-1680327736 None] Lock "cinder-1079c4b6-625d-4d6c-9710-702e5aa785ec-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.coordination [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Acquiring lock "cinder-34023a39-bbf4-4afb-948b-0bff9f563bb8-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.coordination [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Lock "cinder-34023a39-bbf4-4afb-948b-0bff9f563bb8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] remove_export for volume: 34023a39-bbf4-4afb-948b-0bff9f563bb8. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-980997373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=34023a39-bbf4-4afb-948b-0bff9f563bb8,launched_at=2023-04-12T06:23:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124d62c4d345d9af22f1557abca276',provider_auth='CHAP vmJGqRkQ XLiQfzbosBCMga',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:23:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:35:19Z,updated_at=2023-04-12T06:35:19Z,use_quota=True,user_id='d58cc232d0094bebacf147c6b61a0989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] detach volume v_34023a39-bbf4-4afb-948b-0bff9f563bb8 from target iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/luns/v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/luns/v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/luns/v_34023a39-bbf4-4afb-948b-0bff9f563bb8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8/luns/v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] failed to remove resource iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 because of JDSS resource v_34023a39-bbf4-4afb-948b-0bff9f563bb8 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] delete target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] delete target iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] failed to remove resource iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 because of JDSS resource iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] deleating volume v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] get snapshots for volume v_34023a39-bbf4-4afb-948b-0bff9f563bb8  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34023a39-bbf4-4afb-948b-0bff9f563bb8/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34023a39-bbf4-4afb-948b-0bff9f563bb8/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34023a39-bbf4-4afb-948b-0bff9f563bb8/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] get volume v_34023a39-bbf4-4afb-948b-0bff9f563bb8 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_34023a39-bbf4-4afb-948b-0bff9f563bb8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282038', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '59963', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10237923382564803541', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b3d35b389c2a9ff3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772758528', 'san:volume_id': 'b3d35b389c2a9ff38ddcf66b7d07d87ba942245e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '35452', 'name': 'v_34023a39-bbf4-4afb-948b-0bff9f563bb8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] delete volume:v_34023a39-bbf4-4afb-948b-0bff9f563bb8 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34023a39-bbf4-4afb-948b-0bff9f563bb8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] volume v_34023a39-bbf4-4afb-948b-0bff9f563bb8 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:35:20 user cinder-volume[73792]: DEBUG cinder.quota [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Created reservations ['8943592d-3cb4-4148-a9a8-8ea477f68ca6', 'bdb21688-08b9-4fa3-b054-433487321df3', 'cab88d9a-e085-40d6-9f5c-619e531fbdfa', 'a3805392-9929-4bb5-acf9-1c422486924c'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:35:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:35:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:35:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Geting {'code': 200, 'error': None, 'data': {'available': '114772852736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:35:21 user cinder-volume[73792]: DEBUG cinder.manager [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:35:21 user cinder-volume[73792]: INFO cinder.volume.manager [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Deleted volume successfully.
Apr 12 06:35:21 user cinder-volume[73792]: DEBUG cinder.coordination [None req-d12facc0-04fb-4fd6-9959-e11371661416 tempest-AttachVolumeTestJSON-1680327736 None] Lock "cinder-34023a39-bbf4-4afb-948b-0bff9f563bb8-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=55,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:35:26 user cinder-volume[73792]: INFO cinder.action_track [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:32:47Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] terminate connection for c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:35:26 user cinder-volume[73792]: INFO cinder.action_track [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:32:47Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] Deleting attachment 856f0332-b737-476e-a57a-88ab04e8a750. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] remove_export for volume: c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:32:47Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] detach volume v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 from target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] delete target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] delete target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e373a48e-2621-4167-9c86-9e005c6c9cdb req-15326458-0ef6-481d-aab8-3d7b4df6f221 tempest-ServerActionsTestJSON-752347644 None] target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:35:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:35:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:35:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:35:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114772852736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:35:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:35:35 user cinder-volume[73792]: INFO cinder.action_track [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1225244951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8048631f-b3d7-4509-84f6-a042d0643041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d0d9e107-80ec-4bfc-867e-8e51873a07f4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=48,cinder:INSERT=9,cinder:UPDATE=31,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Flow 'volume_create_manager' (f1f3929b-d16a-4a0d-a1eb-1aad3238f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c4d5fd-b8b4-4ca6-9198-82fe926b71ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c4d5fd-b8b4-4ca6-9198-82fe926b71ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1225244951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8048631f-b3d7-4509-84f6-a042d0643041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d0d9e107-80ec-4bfc-867e-8e51873a07f4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:35:36Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a335af-594f-4bde-a952-ce528b02f05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a335af-594f-4bde-a952-ce528b02f05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e98b62a-963b-44e2-8d02-b873197cd704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e98b62a-963b-44e2-8d02-b873197cd704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8048631f-b3d7-4509-84f6-a042d0643041', 'volume_name': 'volume-8048631f-b3d7-4509-84f6-a042d0643041', 'volume_size': 1, 'snapshot_id': 'd0d9e107-80ec-4bfc-867e-8e51873a07f4'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8e4eff-512f-450c-99f1-0f8bbffb5bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8e4eff-512f-450c-99f1-0f8bbffb5bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0473a69-0ae9-4fec-9d53-ed7bd6f303e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:35 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Volume 8048631f-b3d7-4509-84f6-a042d0643041: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8048631f-b3d7-4509-84f6-a042d0643041', 'volume_size': 1, 'snapshot_id': 'd0d9e107-80ec-4bfc-867e-8e51873a07f4'}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] create volume 8048631f-b3d7-4509-84f6-a042d0643041 from snapshot d0d9e107-80ec-4bfc-867e-8e51873a07f4 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] cloning s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 to v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] create snapshot v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_8048631f-b3d7-4509-84f6-a042d0643041'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] create volume v_8048631f-b3d7-4509-84f6-a042d0643041 from snapshot v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4@v_8048631f-b3d7-4509-84f6-a042d0643041', 'is_clone': True, 'full_name': 'Pool-0/v_8048631f-b3d7-4509-84f6-a042d0643041', 'name': 'v_8048631f-b3d7-4509-84f6-a042d0643041'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] get volume v_8048631f-b3d7-4509-84f6-a042d0643041 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4@v_8048631f-b3d7-4509-84f6-a042d0643041', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8048631f-b3d7-4509-84f6-a042d0643041', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282753', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '60566', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4227312743040056347', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'eb88e3e9d620d85b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772828160', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39042', 'name': 'v_8048631f-b3d7-4509-84f6-a042d0643041', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0473a69-0ae9-4fec-9d53-ed7bd6f303e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8048631f-b3d7-4509-84f6-a042d0643041', 'volume_size': 1, 'snapshot_id': 'd0d9e107-80ec-4bfc-867e-8e51873a07f4'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e583d267-c726-40aa-aa15-d59ea9dd3267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:36 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Volume volume-8048631f-b3d7-4509-84f6-a042d0643041 (8048631f-b3d7-4509-84f6-a042d0643041): created successfully
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e583d267-c726-40aa-aa15-d59ea9dd3267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] Flow 'volume_create_manager' (f1f3929b-d16a-4a0d-a1eb-1aad3238f52d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:35:36 user cinder-volume[73792]: INFO cinder.action_track [None req-15005efc-a1f8-4565-965d-688f7e6c5047 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1225244951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8048631f-b3d7-4509-84f6-a042d0643041,launched_at=2023-04-12T06:35:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP CEulydVm g5QR9EerktCn8b',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:36Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d0d9e107-80ec-4bfc-867e-8e51873a07f4,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:35:36Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:36 user cinder-volume[73792]: INFO cinder.action_track [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-554118401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a6bbda0f-4ae4-4074-b1ca-1b498618f71d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aba135f770624d04ad862e15478cea8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='45b1284e8acb4758bfd4f26c450e319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Flow 'volume_create_manager' (ae481790-ce55-4006-bc88-6d2fd808e47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ff3ffb-23cb-4b07-b310-4d426a8ba7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ff3ffb-23cb-4b07-b310-4d426a8ba7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-554118401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a6bbda0f-4ae4-4074-b1ca-1b498618f71d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aba135f770624d04ad862e15478cea8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:35:37Z,use_quota=True,user_id='45b1284e8acb4758bfd4f26c450e319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f25d246-04fb-42aa-af01-829d582db0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f25d246-04fb-42aa-af01-829d582db0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab72085a-7b86-4998-acb1-87e744a3e158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab72085a-7b86-4998-acb1-87e744a3e158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6bbda0f-4ae4-4074-b1ca-1b498618f71d', 'volume_name': 'volume-a6bbda0f-4ae4-4074-b1ca-1b498618f71d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f00b9c3-1420-4b53-9d93-54cfa3ea8bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f00b9c3-1420-4b53-9d93-54cfa3ea8bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88638fba-020a-40bd-b2ed-122ae14737e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:36 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Volume a6bbda0f-4ae4-4074-b1ca-1b498618f71d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6bbda0f-4ae4-4074-b1ca-1b498618f71d', 'volume_size': 1}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] creating volume v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] create volume {'name': 'v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d', 'is_clone': False, 'name': 'v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88638fba-020a-40bd-b2ed-122ae14737e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6bbda0f-4ae4-4074-b1ca-1b498618f71d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025dc59e-e29c-4962-ac04-c6440da43311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:37 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Volume volume-a6bbda0f-4ae4-4074-b1ca-1b498618f71d (a6bbda0f-4ae4-4074-b1ca-1b498618f71d): created successfully
Apr 12 06:35:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025dc59e-e29c-4962-ac04-c6440da43311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] Flow 'volume_create_manager' (ae481790-ce55-4006-bc88-6d2fd808e47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:35:37 user cinder-volume[73792]: INFO cinder.action_track [None req-ed96174b-949f-41a0-b95a-b018d26a909d tempest-VolumesListTestJSON-1353750460 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-554118401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a6bbda0f-4ae4-4074-b1ca-1b498618f71d,launched_at=2023-04-12T06:35:37Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aba135f770624d04ad862e15478cea8f',provider_auth='CHAP RLCEyFGS C5H1Vw4Sk0EKQm',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:35:37Z,use_quota=True,user_id='45b1284e8acb4758bfd4f26c450e319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:38 user cinder-volume[73792]: INFO cinder.action_track [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-36512907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9a9424d8-6554-4fe0-a46d-0d2bed3edfe5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aba135f770624d04ad862e15478cea8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='45b1284e8acb4758bfd4f26c450e319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Flow 'volume_create_manager' (1c298c8c-752f-4244-b70e-3c1c2f71710f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bec95e1-5a1c-4455-a13e-2061839390e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bec95e1-5a1c-4455-a13e-2061839390e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-36512907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9a9424d8-6554-4fe0-a46d-0d2bed3edfe5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aba135f770624d04ad862e15478cea8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:35:38Z,use_quota=True,user_id='45b1284e8acb4758bfd4f26c450e319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f181900e-0829-4556-9608-16450ce8037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f181900e-0829-4556-9608-16450ce8037b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b544d0-f400-4c96-af57-950538e00035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b544d0-f400-4c96-af57-950538e00035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a9424d8-6554-4fe0-a46d-0d2bed3edfe5', 'volume_name': 'volume-9a9424d8-6554-4fe0-a46d-0d2bed3edfe5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (616ad120-232b-4503-a08b-379b50825eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (616ad120-232b-4503-a08b-379b50825eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8352a2b5-9586-44c5-8df4-5dd5bb37de87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:38 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Volume 9a9424d8-6554-4fe0-a46d-0d2bed3edfe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a9424d8-6554-4fe0-a46d-0d2bed3edfe5', 'volume_size': 1}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] creating volume v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] create volume {'name': 'v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:38 user cinder-volume[73792]: INFO cinder.action_track [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1225244951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8048631f-b3d7-4509-84f6-a042d0643041,launched_at=2023-04-12T06:35:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP CEulydVm g5QR9EerktCn8b',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:36Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d0d9e107-80ec-4bfc-867e-8e51873a07f4,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:35:38Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:38 user cinder-volume[73792]: INFO cinder.action_track [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1225244951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8048631f-b3d7-4509-84f6-a042d0643041,launched_at=2023-04-12T06:35:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP CEulydVm g5QR9EerktCn8b',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:36Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d0d9e107-80ec-4bfc-867e-8e51873a07f4,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:35:38Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] create export for volume: 8048631f-b3d7-4509-84f6-a042d0643041. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] ensure volume 8048631f-b3d7-4509-84f6-a042d0643041 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] check if targe iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] create target and attach volume 8048631f-b3d7-4509-84f6-a042d0643041 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] create target iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5', 'is_clone': False, 'name': 'v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8352a2b5-9586-44c5-8df4-5dd5bb37de87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a9424d8-6554-4fe0-a46d-0d2bed3edfe5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b282d0-660a-4ed0-896e-a93d85392178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:38 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Volume volume-9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 (9a9424d8-6554-4fe0-a46d-0d2bed3edfe5): created successfully
Apr 12 06:35:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b282d0-660a-4ed0-896e-a93d85392178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] Flow 'volume_create_manager' (1c298c8c-752f-4244-b70e-3c1c2f71710f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:35:39 user cinder-volume[73792]: INFO cinder.action_track [None req-52d217e9-ceaf-4d98-b24b-b9fb7007ae02 tempest-VolumesListTestJSON-1353750460 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-36512907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9a9424d8-6554-4fe0-a46d-0d2bed3edfe5,launched_at=2023-04-12T06:35:38Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aba135f770624d04ad862e15478cea8f',provider_auth='CHAP EQiTtpAl 84wsXeRqBol3Oa',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:38Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:35:38Z,use_quota=True,user_id='45b1284e8acb4758bfd4f26c450e319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:39 user cinder-volume[73792]: INFO cinder.action_track [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1489401279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9523943b-ad5a-4596-acdc-219859895baa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aba135f770624d04ad862e15478cea8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='45b1284e8acb4758bfd4f26c450e319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Flow 'volume_create_manager' (36c03873-fdb0-4a95-bd0c-4c53dc550538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f032e3da-669d-43db-a321-bc3634c611f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f032e3da-669d-43db-a321-bc3634c611f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1489401279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9523943b-ad5a-4596-acdc-219859895baa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aba135f770624d04ad862e15478cea8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:35:40Z,use_quota=True,user_id='45b1284e8acb4758bfd4f26c450e319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1dcdf69-71bb-41a5-a77a-37495ab44d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1dcdf69-71bb-41a5-a77a-37495ab44d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5364dfff-d709-4726-9334-c256289f447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5364dfff-d709-4726-9334-c256289f447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9523943b-ad5a-4596-acdc-219859895baa', 'volume_name': 'volume-9523943b-ad5a-4596-acdc-219859895baa', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0238061-756f-451a-a43e-513cb6702a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0238061-756f-451a-a43e-513cb6702a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae4bb01-8906-450d-b72c-224437d7120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:39 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Volume 9523943b-ad5a-4596-acdc-219859895baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9523943b-ad5a-4596-acdc-219859895baa', 'volume_size': 1}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] creating volume v_9523943b-ad5a-4596-acdc-219859895baa. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] create volume {'name': 'v_9523943b-ad5a-4596-acdc-219859895baa', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9523943b-ad5a-4596-acdc-219859895baa', 'is_clone': False, 'name': 'v_9523943b-ad5a-4596-acdc-219859895baa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae4bb01-8906-450d-b72c-224437d7120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9523943b-ad5a-4596-acdc-219859895baa', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba0b68d-6750-4bde-96aa-0c2a1530d096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:35:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Volume volume-9523943b-ad5a-4596-acdc-219859895baa (9523943b-ad5a-4596-acdc-219859895baa): created successfully
Apr 12 06:35:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba0b68d-6750-4bde-96aa-0c2a1530d096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:35:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] Flow 'volume_create_manager' (36c03873-fdb0-4a95-bd0c-4c53dc550538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:35:40 user cinder-volume[73792]: INFO cinder.action_track [None req-4880e62d-4569-455b-99b6-33d5e53066c2 tempest-VolumesListTestJSON-1353750460 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1489401279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9523943b-ad5a-4596-acdc-219859895baa,launched_at=2023-04-12T06:35:40Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aba135f770624d04ad862e15478cea8f',provider_auth='CHAP XeNwkoiY LgEUMOc1H3Q8W0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:35:40Z,use_quota=True,user_id='45b1284e8acb4758bfd4f26c450e319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] atach volume v_8048631f-b3d7-4509-84f6-a042d0643041 to target iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:35:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6562383865336539', 'lun': 0, 'mode': 'wt', 'name': 'v_8048631f-b3d7-4509-84f6-a042d0643041', 'prod_id': 'Storage', 'scsi_id': 'eb88e3e9d620d85b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] add credentails to target iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:35:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 201, 'error': None, 'data': {'name': 'CEulydVm'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] initialize_connection for 8048631f-b3d7-4509-84f6-a042d0643041 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:35:42 user cinder-volume[73792]: INFO cinder.action_track [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEulydVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '1725c085-2448-4629-838a-ceb959d5bace'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1225244951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8048631f-b3d7-4509-84f6-a042d0643041,launched_at=2023-04-12T06:35:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP CEulydVm g5QR9EerktCn8b',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:36Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d0d9e107-80ec-4bfc-867e-8e51873a07f4,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:35:38Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:42 user cinder-volume[73792]: INFO cinder.action_track [req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 req-1d2eba5e-566e-4961-9337-13b8349b3652 tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1225244951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8048631f-b3d7-4509-84f6-a042d0643041,launched_at=2023-04-12T06:35:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP CEulydVm g5QR9EerktCn8b',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:36Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d0d9e107-80ec-4bfc-867e-8e51873a07f4,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:35:43Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Acquiring lock "cinder-9523943b-ad5a-4596-acdc-219859895baa-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:35:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Lock "cinder-9523943b-ad5a-4596-acdc-219859895baa-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] remove_export for volume: 9523943b-ad5a-4596-acdc-219859895baa. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1489401279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9523943b-ad5a-4596-acdc-219859895baa,launched_at=2023-04-12T06:35:40Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aba135f770624d04ad862e15478cea8f',provider_auth='CHAP XeNwkoiY LgEUMOc1H3Q8W0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:35:44Z,updated_at=2023-04-12T06:35:44Z,use_quota=True,user_id='45b1284e8acb4758bfd4f26c450e319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] detach volume v_9523943b-ad5a-4596-acdc-219859895baa from target iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa/luns/v_9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa/luns/v_9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa/luns/v_9523943b-ad5a-4596-acdc-219859895baa'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa/luns/v_9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] failed to remove resource iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa because of JDSS resource v_9523943b-ad5a-4596-acdc-219859895baa DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] delete target: iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] delete target iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] failed to remove resource iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa because of JDSS resource iqn.2010-10.org.openstack:9523943b-ad5a-4596-acdc-219859895baa DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] deleating volume v_9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] get snapshots for volume v_9523943b-ad5a-4596-acdc-219859895baa  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9523943b-ad5a-4596-acdc-219859895baa/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9523943b-ad5a-4596-acdc-219859895baa/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9523943b-ad5a-4596-acdc-219859895baa/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] get volume v_9523943b-ad5a-4596-acdc-219859895baa info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9523943b-ad5a-4596-acdc-219859895baa', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282757', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60578', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4590614108956487830', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '869f682b3ec5fd05', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772557824', 'san:volume_id': '869f682b3ec5fd05f2a2ef7935f49cfff3f1db07', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38824', 'name': 'v_9523943b-ad5a-4596-acdc-219859895baa', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] delete volume:v_9523943b-ad5a-4596-acdc-219859895baa recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9523943b-ad5a-4596-acdc-219859895baa {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] volume v_9523943b-ad5a-4596-acdc-219859895baa deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:35:45 user cinder-volume[73792]: DEBUG cinder.quota [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Created reservations ['3ac8864c-d4aa-410c-bf9e-d6d33678ee8c', 'e40b488f-3fa8-4506-8d99-f128dd050ade', '19d0a9bd-b852-44b9-b873-92cac4b18514', '271617d9-10d8-49a6-a3a3-bc81c4776f06'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:35:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:35:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:35:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 200, 'error': None, 'data': {'available': '114772639744', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:35:45 user cinder-volume[73792]: DEBUG cinder.manager [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:35:45 user cinder-volume[73792]: INFO cinder.volume.manager [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Deleted volume successfully.
Apr 12 06:35:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-97f302df-d5fa-47c7-9fdc-8315416f8da8 tempest-VolumesListTestJSON-1353750460 None] Lock "cinder-9523943b-ad5a-4596-acdc-219859895baa-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Acquiring lock "cinder-9a9424d8-6554-4fe0-a46d-0d2bed3edfe5-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Lock "cinder-9a9424d8-6554-4fe0-a46d-0d2bed3edfe5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] remove_export for volume: 9a9424d8-6554-4fe0-a46d-0d2bed3edfe5. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-36512907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9a9424d8-6554-4fe0-a46d-0d2bed3edfe5,launched_at=2023-04-12T06:35:39Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aba135f770624d04ad862e15478cea8f',provider_auth='CHAP EQiTtpAl 84wsXeRqBol3Oa',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:38Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:35:46Z,updated_at=2023-04-12T06:35:46Z,use_quota=True,user_id='45b1284e8acb4758bfd4f26c450e319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] detach volume v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 from target iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5/luns/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5/luns/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5/luns/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5/luns/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] failed to remove resource iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 because of JDSS resource v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] delete target: iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] delete target iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] failed to remove resource iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 because of JDSS resource iqn.2010-10.org.openstack:9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] deleating volume v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] get snapshots for volume v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] get volume v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282756', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60574', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4457376745564178639', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '74f2e70cb9979acc', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772525056', 'san:volume_id': '74f2e70cb9979acc7d125f4040683076496a2db1', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38815', 'name': 'v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] delete volume:v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:47 user cinder-volume[73792]: INFO cinder.action_track [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1225244951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8048631f-b3d7-4509-84f6-a042d0643041,launched_at=2023-04-12T06:35:37Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP CEulydVm g5QR9EerktCn8b',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:36Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d0d9e107-80ec-4bfc-867e-8e51873a07f4,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:35:46Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] terminate connection for 8048631f-b3d7-4509-84f6-a042d0643041  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:35:47 user cinder-volume[73792]: INFO cinder.action_track [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1225244951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8048631f-b3d7-4509-84f6-a042d0643041,launched_at=2023-04-12T06:35:37Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP CEulydVm g5QR9EerktCn8b',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:36Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d0d9e107-80ec-4bfc-867e-8e51873a07f4,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:35:46Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] Deleting attachment 1725c085-2448-4629-838a-ceb959d5bace. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] remove_export for volume: 8048631f-b3d7-4509-84f6-a042d0643041. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1225244951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8048631f-b3d7-4509-84f6-a042d0643041,launched_at=2023-04-12T06:35:37Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP CEulydVm g5QR9EerktCn8b',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:36Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d0d9e107-80ec-4bfc-867e-8e51873a07f4,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:35:46Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume v_8048631f-b3d7-4509-84f6-a042d0643041 from target iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/luns/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/luns/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] volume v_9a9424d8-6554-4fe0-a46d-0d2bed3edfe5 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.quota [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Created reservations ['9260f964-eea4-4a0c-9b4d-3f93c3f4b549', 'ce326645-0a45-4560-bb0e-521d1727f587', '5a809a5d-6435-421f-9326-7f3d2a186776', '38506c74-f8dc-4069-b34f-a0ec7861b02e'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/luns/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] delete target: iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] delete target iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 200, 'error': None, 'data': {'available': '114772590592', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.manager [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:35:48 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Deleted volume successfully.
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.coordination [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Acquiring lock "cinder-a6bbda0f-4ae4-4074-b1ca-1b498618f71d-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0b839ad8-c177-48a7-ba6a-63e4ffa6f6a3 tempest-VolumesListTestJSON-1353750460 None] Lock "cinder-9a9424d8-6554-4fe0-a46d-0d2bed3edfe5-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.coordination [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Lock "cinder-a6bbda0f-4ae4-4074-b1ca-1b498618f71d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=67,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] remove_export for volume: a6bbda0f-4ae4-4074-b1ca-1b498618f71d. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-554118401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a6bbda0f-4ae4-4074-b1ca-1b498618f71d,launched_at=2023-04-12T06:35:38Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aba135f770624d04ad862e15478cea8f',provider_auth='CHAP RLCEyFGS C5H1Vw4Sk0EKQm',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:35:48Z,updated_at=2023-04-12T06:35:48Z,use_quota=True,user_id='45b1284e8acb4758bfd4f26c450e319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] detach volume v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d from target iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d/luns/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d/luns/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8297db5b-0efc-4e4a-bdda-074bc33bec24 req-3d1d5b83-2729-4b3c-8cde-55a4c4bc577e tempest-SnapshotDataIntegrityTests-2082659614 None] target iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d/luns/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d/luns/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] failed to remove resource iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d because of JDSS resource v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] delete target: iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] delete target iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] failed to remove resource iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d because of JDSS resource iqn.2010-10.org.openstack:a6bbda0f-4ae4-4074-b1ca-1b498618f71d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] deleating volume v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] get snapshots for volume v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] get volume v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:35:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282754', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60570', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9602125502109357035', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8fb819fb5a2a0589', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772590592', 'san:volume_id': '8fb819fb5a2a0589e8ce458ee502f773f073d9c3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38806', 'name': 'v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] delete volume:v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:35:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] volume v_a6bbda0f-4ae4-4074-b1ca-1b498618f71d deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:35:50 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=64,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:35:50 user cinder-volume[73792]: DEBUG cinder.quota [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Created reservations ['94d2b5ba-cc80-4248-b0d6-0361ffb465dd', '83e63a83-d31a-4885-89b3-96d16a357436', 'be5d6ca3-247b-4629-bcda-adea4eecf698', 'be8baa93-2b88-4ee7-b908-3893ec24fea6'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:35:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:35:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:35:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:35:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:35:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Geting {'code': 200, 'error': None, 'data': {'available': '114772672512', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:35:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:35:50 user cinder-volume[73792]: DEBUG cinder.manager [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:35:50 user cinder-volume[73792]: INFO cinder.volume.manager [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Deleted volume successfully.
Apr 12 06:35:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-361399ab-2f83-49c7-bc25-fafb76a5c011 tempest-VolumesListTestJSON-1353750460 None] Lock "cinder-a6bbda0f-4ae4-4074-b1ca-1b498618f71d-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:36:09 user cinder-volume[73792]: INFO cinder.action_track [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1072844948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7604ff57-70fb-4c5c-abde-c58dab75bf44,launched_at=2023-04-12T06:33:14Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP SwscbTLM t1j6XwDNM5QUGc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:36:08Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] terminate connection for 7604ff57-70fb-4c5c-abde-c58dab75bf44  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:36:09 user cinder-volume[73792]: INFO cinder.action_track [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1072844948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7604ff57-70fb-4c5c-abde-c58dab75bf44,launched_at=2023-04-12T06:33:14Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP SwscbTLM t1j6XwDNM5QUGc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:36:08Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] Deleting attachment 00973a61-0443-4ebe-9af3-e328e59f2c74. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] remove_export for volume: 7604ff57-70fb-4c5c-abde-c58dab75bf44. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1072844948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7604ff57-70fb-4c5c-abde-c58dab75bf44,launched_at=2023-04-12T06:33:14Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP SwscbTLM t1j6XwDNM5QUGc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:36:08Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] detach volume v_7604ff57-70fb-4c5c-abde-c58dab75bf44 from target iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/luns/v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/luns/v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/luns/v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] delete target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] delete target iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 req-9baba8d6-3534-4bb3-bf8b-2a4139ab88fb tempest-AttachVolumeNegativeTest-1905486920 None] target iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:36:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:36:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=16,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:36:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:36:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:36:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:36:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114772660224', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:36:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Acquiring lock "cinder-8048631f-b3d7-4509-84f6-a042d0643041-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-8048631f-b3d7-4509-84f6-a042d0643041-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] remove_export for volume: 8048631f-b3d7-4509-84f6-a042d0643041. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1225244951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8048631f-b3d7-4509-84f6-a042d0643041,launched_at=2023-04-12T06:35:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP CEulydVm g5QR9EerktCn8b',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:35:36Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d0d9e107-80ec-4bfc-867e-8e51873a07f4,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:36:37Z,updated_at=2023-04-12T06:36:37Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume v_8048631f-b3d7-4509-84f6-a042d0643041 from target iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/luns/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/luns/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/luns/v_8048631f-b3d7-4509-84f6-a042d0643041'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041/luns/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] failed to remove resource iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 because of JDSS resource v_8048631f-b3d7-4509-84f6-a042d0643041 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] delete target: iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] delete target iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] failed to remove resource iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 because of JDSS resource iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] deleating volume v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] get snapshots for volume v_8048631f-b3d7-4509-84f6-a042d0643041  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8048631f-b3d7-4509-84f6-a042d0643041/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8048631f-b3d7-4509-84f6-a042d0643041/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8048631f-b3d7-4509-84f6-a042d0643041/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] get volume v_8048631f-b3d7-4509-84f6-a042d0643041 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:36:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4@v_8048631f-b3d7-4509-84f6-a042d0643041', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8048631f-b3d7-4509-84f6-a042d0643041', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282753', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '60566', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4227312743040056347', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': 'eb88e3e9d620d85b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772660224', 'san:volume_id': 'eb88e3e9d620d85b8ad5ec458357d8df4f770aaa', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '39042', 'name': 'v_8048631f-b3d7-4509-84f6-a042d0643041', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] delete snapshot v_8048631f-b3d7-4509-84f6-a042d0643041 of volume s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:36:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/snapshots/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/snapshots/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/snapshots/v_8048631f-b3d7-4509-84f6-a042d0643041 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] snapshot v_8048631f-b3d7-4509-84f6-a042d0643041 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:36:38 user cinder-volume[73792]: DEBUG cinder.quota [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Created reservations ['d5996fff-6902-4b15-a262-fbcd3d29690e', '9f73f48d-e331-4c1d-b4ac-bba790329aec', '793b6d7d-89c7-47e0-8bbc-c869d97ea80f', 'a6e0ed12-adf4-4962-8e3e-3a0284899705'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:36:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:36:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:36:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'available': '114772815872', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:36:38 user cinder-volume[73792]: DEBUG cinder.manager [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:36:38 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Deleted volume successfully.
Apr 12 06:36:38 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7a721845-2cb3-454b-8353-f9e4f31a25b7 tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-8048631f-b3d7-4509-84f6-a042d0643041-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.coordination [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Acquiring lock "cinder-06ddc1aa-31ff-4da3-b156-9b5e7f11274b-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.coordination [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-06ddc1aa-31ff-4da3-b156-9b5e7f11274b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] remove_export for volume: 06ddc1aa-31ff-4da3-b156-9b5e7f11274b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-788422349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=06ddc1aa-31ff-4da3-b156-9b5e7f11274b,launched_at=2023-04-12T06:34:36Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP TFnrsXSe NY1pH6qkhwJdAl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:34:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=5b2af075-1f8f-41ca-bec6-2a439afd0c26,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:36:39Z,updated_at=2023-04-12T06:36:39Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b from target iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/luns/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/luns/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/luns/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b/luns/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] failed to remove resource iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b because of JDSS resource v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] delete target: iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] delete target iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] failed to remove resource iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b because of JDSS resource iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] deleating volume v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] get snapshots for volume v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] get volume v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26@v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282693', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '60535', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13806126494192094107', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': '8ea31ca034cdc9db', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772815872', 'san:volume_id': '8ea31ca034cdc9db4131bf7198971c2d5fec58c5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '38369', 'name': 'v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] delete snapshot v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b of volume s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/snapshots/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/snapshots/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/snapshots/v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] snapshot v_06ddc1aa-31ff-4da3-b156-9b5e7f11274b deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:36:40 user cinder-volume[73792]: DEBUG cinder.quota [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Created reservations ['d59fa94e-3456-4afc-a72f-8509fa179bde', '2a4e3031-8775-444e-b454-8d49537b41f7', 'e0810173-a8ef-46e2-b95f-621e3c155c97', '51b9adcb-7337-465e-aae2-2de3d131a150'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:36:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:36:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:36:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'available': '114772959232', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:36:40 user cinder-volume[73792]: DEBUG cinder.manager [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:36:40 user cinder-volume[73792]: INFO cinder.volume.manager [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Deleted volume successfully.
Apr 12 06:36:40 user cinder-volume[73792]: DEBUG cinder.coordination [None req-e0940cb5-4a5c-454e-9fba-38d1e4f9a94d tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-06ddc1aa-31ff-4da3-b156-9b5e7f11274b-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.coordination [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Acquiring lock "cinder-1352a4c5-edb1-4cf3-8768-5ef649fe2bf8-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.coordination [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-1352a4c5-edb1-4cf3-8768-5ef649fe2bf8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] remove_export for volume: 1352a4c5-edb1-4cf3-8768-5ef649fe2bf8. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1739752693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1352a4c5-edb1-4cf3-8768-5ef649fe2bf8,launched_at=2023-04-12T06:33:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP wWDnsZuU a1tIDfWdnwqkZO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=fa791eeb-4190-4d1d-b3f9-ef9894ffc574,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:36:41Z,updated_at=2023-04-12T06:36:41Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 from target iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/luns/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/luns/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/luns/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/luns/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] failed to remove resource iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 because of JDSS resource v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] delete target: iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] delete target iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] failed to remove resource iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 because of JDSS resource iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] deleating volume v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] get snapshots for volume v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] get volume v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574@v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282632', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '60497', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15099220756849707497', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': '0691a44cdab35336', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114772959232', 'san:volume_id': '0691a44cdab35336abac2ba5a0d304c22e433fc6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '38915', 'name': 'v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] delete snapshot v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 of volume s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/snapshots/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/snapshots/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/snapshots/v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] snapshot v_1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:36:42 user cinder-volume[73792]: DEBUG cinder.quota [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Created reservations ['c77de98d-85ab-41e0-a62c-65da806c18d3', '5d21e960-37a5-4aba-af42-a5e99d29036f', '3804dd81-0302-4965-a598-367c1935e985', 'd3f4dd83-e12e-4188-bbe6-ec291f2ca52c'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:36:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:36:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:36:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'available': '114773114880', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.manager [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:36:43 user cinder-volume[73792]: INFO cinder.volume.manager [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Deleted volume successfully.
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-59adb586-17ed-4a96-9769-b3047538979d tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-1352a4c5-edb1-4cf3-8768-5ef649fe2bf8-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Acquiring lock "cinder-d0d9e107-80ec-4bfc-867e-8e51873a07f4-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-d0d9e107-80ec-4bfc-867e-8e51873a07f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] deleating snapshot s_d0d9e107-80ec-4bfc-867e-8e51873a07f4. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] get snapshots for volume s_d0d9e107-80ec-4bfc-867e-8e51873a07f4  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] get volume s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc@s_d0d9e107-80ec-4bfc-867e-8e51873a07f4', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282580', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '60468', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5147401865180905784', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '01daef66a4afdf5d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773114880', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '38794', 'name': 's_d0d9e107-80ec-4bfc-867e-8e51873a07f4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] delete snapshot s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 of volume v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots/s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] snapshot s_d0d9e107-80ec-4bfc-867e-8e51873a07f4 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:36:44 user cinder-volume[73792]: DEBUG cinder.quota [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Created reservations ['07943bed-3ef1-4f9d-bf75-21b92d5b54e4', '17a59cd0-84eb-4367-a545-3a10df5d69e9', '03dd1ce7-bc7e-4fe3-a3a8-986fa9478f59', 'b5e480df-ba8b-4ad7-baff-3f1cce4f810e'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:36:44 user cinder-volume[73792]: INFO cinder.volume.manager [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Delete snapshot completed successfully.
Apr 12 06:36:44 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4d5c36f7-384f-4799-a152-1f37396c8776 tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-d0d9e107-80ec-4bfc-867e-8e51873a07f4-delete_snapshot" released by "delete_snapshot" :: held 1.128s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:36:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Acquiring lock "cinder-5b2af075-1f8f-41ca-bec6-2a439afd0c26-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:36:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-5b2af075-1f8f-41ca-bec6-2a439afd0c26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:36:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] deleating snapshot s_5b2af075-1f8f-41ca-bec6-2a439afd0c26. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:36:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] get snapshots for volume s_5b2af075-1f8f-41ca-bec6-2a439afd0c26  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:36:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] get volume s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:36:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc@s_5b2af075-1f8f-41ca-bec6-2a439afd0c26', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282578', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '60462', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12411364209770971972', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ef6780fbcd0183b8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773147648', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '35960', 'name': 's_5b2af075-1f8f-41ca-bec6-2a439afd0c26', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] delete snapshot s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 of volume v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:36:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots/s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] snapshot s_5b2af075-1f8f-41ca-bec6-2a439afd0c26 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:36:46 user cinder-volume[73792]: DEBUG cinder.quota [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Created reservations ['23a51ed1-42b5-4d99-99e4-bdd4690d25f4', '53876fc7-6eec-4a2f-ba24-411cf5576e93', 'bf377e09-f35e-4cdf-8db2-0c333fc90917', '389e0c2f-2dc5-47d1-8a98-c9f4c2c7d50c'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:36:46 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=62,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:36:46 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=50,cinder:UPDATE=36,cinder:INSERT=13,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:36:46 user cinder-volume[73792]: INFO cinder.volume.manager [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Delete snapshot completed successfully.
Apr 12 06:36:46 user cinder-volume[73792]: DEBUG cinder.coordination [None req-995d456b-dbf2-4b78-90f6-a9d064cf3b1c tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-5b2af075-1f8f-41ca-bec6-2a439afd0c26-delete_snapshot" released by "delete_snapshot" :: held 1.115s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:36:47 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Acquiring lock "cinder-fa791eeb-4190-4d1d-b3f9-ef9894ffc574-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:36:47 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-fa791eeb-4190-4d1d-b3f9-ef9894ffc574-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:36:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] deleating snapshot s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:36:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] get snapshots for volume s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:36:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] get volume s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:36:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc@s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282577', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '60452', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '161512964533540718', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ba912feeba0d0078', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773405696', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '38416', 'name': 's_fa791eeb-4190-4d1d-b3f9-ef9894ffc574', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] delete snapshot s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 of volume v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:36:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots/s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] snapshot s_fa791eeb-4190-4d1d-b3f9-ef9894ffc574 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:36:49 user cinder-volume[73792]: DEBUG cinder.quota [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Created reservations ['714cb1aa-ddbd-4f20-b9df-4f0f1f9fd9d1', 'e58bda4c-508a-41d2-9bc3-9b6997ac09ca', '826ba76f-8d18-4650-bd5d-228b9beea07b', 'f2070b00-4b5b-4b16-bd9a-e31d122e4cf6'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:36:49 user cinder-volume[73792]: INFO cinder.volume.manager [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Delete snapshot completed successfully.
Apr 12 06:36:49 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bee71df7-88d9-4c4d-aef1-d9dc5e0f2129 tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-fa791eeb-4190-4d1d-b3f9-ef9894ffc574-delete_snapshot" released by "delete_snapshot" :: held 1.177s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Acquiring lock "cinder-9545da1e-1977-434b-9228-c5c2ff1cc9fc-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-9545da1e-1977-434b-9228-c5c2ff1cc9fc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] remove_export for volume: 9545da1e-1977-434b-9228-c5c2ff1cc9fc. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-133713086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9545da1e-1977-434b-9228-c5c2ff1cc9fc,launched_at=2023-04-12T06:32:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebdd9f4006d413686bba37f22374759',provider_auth='CHAP flWMIBLP RnaPTthDQk0GSC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:32:27Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:36:51Z,updated_at=2023-04-12T06:36:51Z,use_quota=True,user_id='549eaf8464b64c96ab3c6dde394cc31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] detach volume v_9545da1e-1977-434b-9228-c5c2ff1cc9fc from target iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/luns/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/luns/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/luns/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc/luns/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] failed to remove resource iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc because of JDSS resource v_9545da1e-1977-434b-9228-c5c2ff1cc9fc DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] delete target: iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] delete target iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] failed to remove resource iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc because of JDSS resource iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] deleating volume v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] get snapshots for volume v_9545da1e-1977-434b-9228-c5c2ff1cc9fc  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] get volume v_9545da1e-1977-434b-9228-c5c2ff1cc9fc info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282564', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '60439', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4084851711761178743', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '475136', 'logicalused': '1892352', 'compressratio': '4.52', 'rootcontext': 'none', 'default_scsi_id': '532087dab5c9d75c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773676032', 'san:volume_id': '532087dab5c9d75c4822888b31ac86dd7567796a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '475136', 'objsetid': '38533', 'name': 'v_9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '475136', 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] delete volume:v_9545da1e-1977-434b-9228-c5c2ff1cc9fc recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:51 user cinder-volume[73792]: INFO cinder.action_track [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1057463130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4e3910db-ed08-4a5a-bb85-48c49eccbf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Flow 'volume_create_manager' (1757746f-9416-488a-af64-b748045d58a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ddb8cc-eadd-4094-920e-11e5cb831392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ddb8cc-eadd-4094-920e-11e5cb831392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1057463130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4e3910db-ed08-4a5a-bb85-48c49eccbf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:36:52Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7accf34-8eb9-4646-9d95-0d9945837a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7accf34-8eb9-4646-9d95-0d9945837a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3c541c-a295-4abc-b4ff-18301a08830b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3c541c-a295-4abc-b4ff-18301a08830b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'volume_name': 'volume-4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8de107f-a7ef-42c2-ba0b-3ae4e16a8a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8de107f-a7ef-42c2-ba0b-3ae4e16a8a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607e70e0-f60b-4388-9979-2b801133d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:36:51 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Volume 4e3910db-ed08-4a5a-bb85-48c49eccbf9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'volume_size': 1}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] creating volume v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] create volume {'name': 'v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'is_clone': False, 'name': 'v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607e70e0-f60b-4388-9979-2b801133d64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:36:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8be4e50-a218-4810-95a2-b770a218959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:36:52 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Volume volume-4e3910db-ed08-4a5a-bb85-48c49eccbf9a (4e3910db-ed08-4a5a-bb85-48c49eccbf9a): created successfully
Apr 12 06:36:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8be4e50-a218-4810-95a2-b770a218959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:36:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] Flow 'volume_create_manager' (1757746f-9416-488a-af64-b748045d58a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:36:52 user cinder-volume[73792]: INFO cinder.action_track [None req-19ecec74-29f0-4bf0-b242-28dd280d4f8b tempest-ServerRescueNegativeTestJSON-1179647693 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1057463130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4e3910db-ed08-4a5a-bb85-48c49eccbf9a,launched_at=2023-04-12T06:36:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth='CHAP NilzYZIx m31S4a9E5dizOF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:36:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:36:52Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:36:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9545da1e-1977-434b-9228-c5c2ff1cc9fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] volume v_9545da1e-1977-434b-9228-c5c2ff1cc9fc deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:36:53 user cinder-volume[73792]: DEBUG cinder.quota [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Created reservations ['a917546b-6433-4968-884a-35356a2811c2', 'f3b497ab-1b87-42b5-816f-8dd7512f65cf', '2103e851-4b81-40c9-bef3-1b8ce90d5baf', '081cbe39-de0c-493b-a14b-7f8a9f3edff8'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:36:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:36:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:36:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:36:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:36:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Geting {'code': 200, 'error': None, 'data': {'available': '114774130688', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:36:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:36:54 user cinder-volume[73792]: DEBUG cinder.manager [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:36:54 user cinder-volume[73792]: INFO cinder.volume.manager [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Deleted volume successfully.
Apr 12 06:36:54 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ce8c8abc-1cea-4457-a2e7-6946b5789165 tempest-SnapshotDataIntegrityTests-2082659614 None] Lock "cinder-9545da1e-1977-434b-9228-c5c2ff1cc9fc-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:37:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=24,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:37:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=40,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114774142976', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:37:30 user cinder-volume[73792]: INFO cinder.action_track [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1569607038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff76495e-eafb-4932-9636-e017f0a60dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d19689b343dd935505ba458dd6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='0ed0f651f79846138e3be8f312b3188f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Flow 'volume_create_manager' (c8f39621-76f9-4f3f-a826-03bb3d7b9c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ebdddc-4034-4863-a088-a98c39c9ad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ebdddc-4034-4863-a088-a98c39c9ad0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1569607038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff76495e-eafb-4932-9636-e017f0a60dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d19689b343dd935505ba458dd6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:37:31Z,use_quota=True,user_id='0ed0f651f79846138e3be8f312b3188f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5f1c6d-7588-428c-8288-f96ec15b5d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5f1c6d-7588-428c-8288-f96ec15b5d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbee335-1825-40da-9db2-50e8988b8dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbee335-1825-40da-9db2-50e8988b8dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff76495e-eafb-4932-9636-e017f0a60dbf', 'volume_name': 'volume-ff76495e-eafb-4932-9636-e017f0a60dbf', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0785dfc9-4ce6-4af9-b835-5da1d658c853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0785dfc9-4ce6-4af9-b835-5da1d658c853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bddbb09-4f0c-43d9-ab42-6165c874e4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:37:30 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Volume ff76495e-eafb-4932-9636-e017f0a60dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff76495e-eafb-4932-9636-e017f0a60dbf', 'volume_size': 1}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] creating volume v_ff76495e-eafb-4932-9636-e017f0a60dbf. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] create volume {'name': 'v_ff76495e-eafb-4932-9636-e017f0a60dbf', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:37:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:37:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ff76495e-eafb-4932-9636-e017f0a60dbf', 'is_clone': False, 'name': 'v_ff76495e-eafb-4932-9636-e017f0a60dbf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:37:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bddbb09-4f0c-43d9-ab42-6165c874e4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff76495e-eafb-4932-9636-e017f0a60dbf', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:37:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98200fcf-250b-4e8b-86f0-5ed89dc5367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:37:31 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Volume volume-ff76495e-eafb-4932-9636-e017f0a60dbf (ff76495e-eafb-4932-9636-e017f0a60dbf): created successfully
Apr 12 06:37:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98200fcf-250b-4e8b-86f0-5ed89dc5367d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:37:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] Flow 'volume_create_manager' (c8f39621-76f9-4f3f-a826-03bb3d7b9c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:37:31 user cinder-volume[73792]: INFO cinder.action_track [None req-ca764c0c-97fb-4333-98d5-c4e2e5c1c4fc tempest-ServerStableDeviceRescueTest-88660584 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1569607038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff76495e-eafb-4932-9636-e017f0a60dbf,launched_at=2023-04-12T06:37:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d19689b343dd935505ba458dd6af',provider_auth='CHAP LBTgevpr G7uLnJ5aCHmZqt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:37:31Z,use_quota=True,user_id='0ed0f651f79846138e3be8f312b3188f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:37:32 user cinder-volume[73792]: INFO cinder.action_track [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1569607038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff76495e-eafb-4932-9636-e017f0a60dbf,launched_at=2023-04-12T06:37:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d19689b343dd935505ba458dd6af',provider_auth='CHAP LBTgevpr G7uLnJ5aCHmZqt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:37:32Z,use_quota=True,user_id='0ed0f651f79846138e3be8f312b3188f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:37:32 user cinder-volume[73792]: INFO cinder.action_track [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1569607038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff76495e-eafb-4932-9636-e017f0a60dbf,launched_at=2023-04-12T06:37:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d19689b343dd935505ba458dd6af',provider_auth='CHAP LBTgevpr G7uLnJ5aCHmZqt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:37:32Z,use_quota=True,user_id='0ed0f651f79846138e3be8f312b3188f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:37:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] create export for volume: ff76495e-eafb-4932-9636-e017f0a60dbf. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:37:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] ensure volume ff76495e-eafb-4932-9636-e017f0a60dbf assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:37:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] check if targe iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:37:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:37:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:37:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:37:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] create target and attach volume ff76495e-eafb-4932-9636-e017f0a60dbf to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:37:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] create target iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:37:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:37:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:37:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:37:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] atach volume v_ff76495e-eafb-4932-9636-e017f0a60dbf to target iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:37:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:37:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:37:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3437396238633138', 'lun': 0, 'mode': 'wt', 'name': 'v_ff76495e-eafb-4932-9636-e017f0a60dbf', 'prod_id': 'Storage', 'scsi_id': '479b8c185f51f1c8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:37:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] add credentails to target iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:37:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:37:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:37:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 201, 'error': None, 'data': {'name': 'LBTgevpr'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:37:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] initialize_connection for ff76495e-eafb-4932-9636-e017f0a60dbf 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:37:36 user cinder-volume[73792]: INFO cinder.action_track [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBTgevpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '17c44b84-7de5-40cc-b13e-1031c4ecba32'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1569607038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff76495e-eafb-4932-9636-e017f0a60dbf,launched_at=2023-04-12T06:37:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d19689b343dd935505ba458dd6af',provider_auth='CHAP LBTgevpr G7uLnJ5aCHmZqt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:37:32Z,use_quota=True,user_id='0ed0f651f79846138e3be8f312b3188f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:37:36 user cinder-volume[73792]: INFO cinder.action_track [req-cdc7f369-7856-47a5-9d4b-003d73d845ab req-48302756-1615-4bc4-909d-280bfcbab132 tempest-ServerStableDeviceRescueTest-88660584 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1569607038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff76495e-eafb-4932-9636-e017f0a60dbf,launched_at=2023-04-12T06:37:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d19689b343dd935505ba458dd6af',provider_auth='CHAP LBTgevpr G7uLnJ5aCHmZqt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:37:37Z,use_quota=True,user_id='0ed0f651f79846138e3be8f312b3188f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:37:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:37:54 user cinder-volume[73792]: INFO cinder.action_track [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:54Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3b12a713-8214-4892-a05d-c4ae96583b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=26,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Flow 'volume_create_manager' (2167946a-9521-4787-861d-dfc6451632f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f983c2-6ce0-4146-9c67-f4c006fa934f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f983c2-6ce0-4146-9c67-f4c006fa934f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:54Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3b12a713-8214-4892-a05d-c4ae96583b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:37:54Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd7ffa1-20c5-475c-bd7a-e799a24a505c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd7ffa1-20c5-475c-bd7a-e799a24a505c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae39b0a0-3ad3-4ced-8d9e-d783bee37ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae39b0a0-3ad3-4ced-8d9e-d783bee37ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b12a713-8214-4892-a05d-c4ae96583b31', 'volume_name': 'volume-3b12a713-8214-4892-a05d-c4ae96583b31', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769beeb60>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcfd541-3209-4ff0-a667-85d7fc668019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcfd541-3209-4ff0-a667-85d7fc668019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04adadf-077e-4cd4-bd60-c24b073a00e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:37:54 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Volume 3b12a713-8214-4892-a05d-c4ae96583b31: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b12a713-8214-4892-a05d-c4ae96583b31', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769beeb60>}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Cloning 3b12a713-8214-4892-a05d-c4ae96583b31 from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.coordination [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.coordination [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.image.cache [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 37, 54, 371060)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.image.cache [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Found cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.coordination [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.image.cache [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 37, 54, 387820)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.image.cache [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Creating from source image-volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] cloned volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to 3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] cloning v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to v_3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] create snapshot v_3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_3b12a713-8214-4892-a05d-c4ae96583b31'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] create volume v_3b12a713-8214-4892-a05d-c4ae96583b31 from snapshot v_3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:37:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:37:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_3b12a713-8214-4892-a05d-c4ae96583b31', 'is_clone': True, 'full_name': 'Pool-0/v_3b12a713-8214-4892-a05d-c4ae96583b31', 'name': 'v_3b12a713-8214-4892-a05d-c4ae96583b31'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:37:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] get volume v_3b12a713-8214-4892-a05d-c4ae96583b31 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:37:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:37:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:37:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_3b12a713-8214-4892-a05d-c4ae96583b31', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3b12a713-8214-4892-a05d-c4ae96583b31', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282892', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60650', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15776534818711370958', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '496962072efa8e48', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114774036480', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38842', 'name': 'v_3b12a713-8214-4892-a05d-c4ae96583b31', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:37:55 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Marking volume 3b12a713-8214-4892-a05d-c4ae96583b31 as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:37:55 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to 3b12a713-8214-4892-a05d-c4ae96583b31. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:37:55 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Creating volume glance metadata for volume 3b12a713-8214-4892-a05d-c4ae96583b31 backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:37:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04adadf-077e-4cd4-bd60-c24b073a00e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b12a713-8214-4892-a05d-c4ae96583b31', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769beeb60>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:37:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8eb77c-cb82-446a-b1f1-51f812958777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:37:55 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Volume volume-3b12a713-8214-4892-a05d-c4ae96583b31 (3b12a713-8214-4892-a05d-c4ae96583b31): created successfully
Apr 12 06:37:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8eb77c-cb82-446a-b1f1-51f812958777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:37:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Flow 'volume_create_manager' (2167946a-9521-4787-861d-dfc6451632f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:37:55 user cinder-volume[73792]: INFO cinder.action_track [req-395327ad-8948-4ecc-a818-56e99bba38aa req-bb622988-4b45-41be-a265-3d16fe5ab013 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:54Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3b12a713-8214-4892-a05d-c4ae96583b31,launched_at=2023-04-12T06:37:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP mHIBytCb k2zJWto3FBZSlg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:54Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:37:54Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:37:59 user cinder-volume[73792]: INFO cinder.action_track [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:54Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3b12a713-8214-4892-a05d-c4ae96583b31,launched_at=2023-04-12T06:37:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP mHIBytCb k2zJWto3FBZSlg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:54Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:37:59Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:37:59 user cinder-volume[73792]: INFO cinder.action_track [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:54Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3b12a713-8214-4892-a05d-c4ae96583b31,launched_at=2023-04-12T06:37:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP mHIBytCb k2zJWto3FBZSlg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:54Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:37:59Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:37:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] create export for volume: 3b12a713-8214-4892-a05d-c4ae96583b31. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:37:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ensure volume 3b12a713-8214-4892-a05d-c4ae96583b31 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:37:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] check if targe iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:37:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:37:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:37:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:37:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] create target and attach volume 3b12a713-8214-4892-a05d-c4ae96583b31 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:37:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] create target iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:37:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:37:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] atach volume v_3b12a713-8214-4892-a05d-c4ae96583b31 to target iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:38:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3439363936323037', 'lun': 0, 'mode': 'wt', 'name': 'v_3b12a713-8214-4892-a05d-c4ae96583b31', 'prod_id': 'Storage', 'scsi_id': '496962072efa8e48'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] add credentails to target iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:38:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 201, 'error': None, 'data': {'name': 'mHIBytCb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] initialize_connection for 3b12a713-8214-4892-a05d-c4ae96583b31 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:38:03 user cinder-volume[73792]: INFO cinder.action_track [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHIBytCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '360e09a9-ce8b-489d-b13f-b0dd5093cd73'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:54Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3b12a713-8214-4892-a05d-c4ae96583b31,launched_at=2023-04-12T06:37:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP mHIBytCb k2zJWto3FBZSlg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:54Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:37:59Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:38:03 user cinder-volume[73792]: INFO cinder.action_track [req-395327ad-8948-4ecc-a818-56e99bba38aa req-98a15b78-6f67-47dd-ab2c-c117afdc0a41 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:54Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3b12a713-8214-4892-a05d-c4ae96583b31,launched_at=2023-04-12T06:37:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP mHIBytCb k2zJWto3FBZSlg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:54Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:38:04Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:38:07 user cinder-volume[73792]: INFO cinder.action_track [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Flow 'volume_create_manager' (503982d0-f58c-4432-921d-a8a07c84dc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b00d8e-221a-496a-b774-ff73f9560f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b00d8e-221a-496a-b774-ff73f9560f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:38:07Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b1fd47-1b5e-4fd5-a2f4-04d33f5123e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b1fd47-1b5e-4fd5-a2f4-04d33f5123e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0792c910-225f-4376-9f0b-e597bd55b302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0792c910-225f-4376-9f0b-e597bd55b302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'volume_name': 'volume-6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769eb7910>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c57231-b928-45b2-a34b-81308de38866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c57231-b928-45b2-a34b-81308de38866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e1641a-81a0-49b8-8893-66f298f0c603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:38:07 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Volume 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769eb7910>}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Cloning 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 38, 7, 208800)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Found cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 0.029s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 38, 7, 245213)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Creating from source image-volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] cloned volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] cloning v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] create snapshot v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] create volume v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 from snapshot v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'is_clone': True, 'full_name': 'Pool-0/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'name': 'v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] get volume v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:38:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282905', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60661', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6890043797728209449', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8ad50f7874045927', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114773987328', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38858', 'name': 'v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:08 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Marking volume 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:38:08 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:38:08 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Creating volume glance metadata for volume 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:38:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e1641a-81a0-49b8-8893-66f298f0c603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769eb7910>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:38:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b066a9d6-b8c6-427d-a443-59a66a9ca168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:38:08 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Volume volume-6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7): created successfully
Apr 12 06:38:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b066a9d6-b8c6-427d-a443-59a66a9ca168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:38:08 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] Flow 'volume_create_manager' (503982d0-f58c-4432-921d-a8a07c84dc38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:38:08 user cinder-volume[73792]: INFO cinder.action_track [None req-5d1b7786-d042-4dfb-b810-c1cc1876d1d7 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:38:07Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:38:11 user cinder-volume[73792]: INFO cinder.action_track [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:38:10Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:38:11 user cinder-volume[73792]: INFO cinder.action_track [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:38:10Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:38:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] create export for volume: 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:38:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] ensure volume 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:38:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] check if targe iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:38:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] create target and attach volume 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:38:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] create target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:38:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] atach volume v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 to target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:38:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3861643530663738', 'lun': 0, 'mode': 'wt', 'name': 'v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'prod_id': 'Storage', 'scsi_id': '8ad50f7874045927'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] add credentails to target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:38:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'name': 'jMIEsORw'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] initialize_connection for 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:38:15 user cinder-volume[73792]: INFO cinder.action_track [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIEsORw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '1d1fd753-b682-4014-a151-aad3a167b5c3'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:38:10Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:38:15 user cinder-volume[73792]: INFO cinder.action_track [req-219845b0-01d8-4e0d-99ed-8248c07da0c4 req-038b176e-4cc1-4839-956c-fa88ad229982 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:38:16Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:38:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:38:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:38:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:38:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114763821056', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:38:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:38:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=58,cinder:UPDATE=11,cinder:INSERT=12 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:38:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=58,cinder:UPDATE=14,cinder:INSERT=12,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:38:47 user cinder-volume[73792]: INFO cinder.action_track [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1057463130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4e3910db-ed08-4a5a-bb85-48c49eccbf9a,launched_at=2023-04-12T06:36:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth='CHAP NilzYZIx m31S4a9E5dizOF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:36:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:38:47Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:38:47 user cinder-volume[73792]: INFO cinder.action_track [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1057463130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4e3910db-ed08-4a5a-bb85-48c49eccbf9a,launched_at=2023-04-12T06:36:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth='CHAP NilzYZIx m31S4a9E5dizOF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:36:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:38:47Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:38:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] create export for volume: 4e3910db-ed08-4a5a-bb85-48c49eccbf9a. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:38:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] ensure volume 4e3910db-ed08-4a5a-bb85-48c49eccbf9a assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:38:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] check if targe iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:38:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] create target and attach volume 4e3910db-ed08-4a5a-bb85-48c49eccbf9a to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:38:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] create target iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:38:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] atach volume v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a to target iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:38:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6338353737343134', 'lun': 0, 'mode': 'wt', 'name': 'v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'prod_id': 'Storage', 'scsi_id': 'c85774141383be27'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] add credentails to target iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:38:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:38:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:38:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 201, 'error': None, 'data': {'name': 'NilzYZIx'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:38:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] initialize_connection for 4e3910db-ed08-4a5a-bb85-48c49eccbf9a 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:38:51 user cinder-volume[73792]: INFO cinder.action_track [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NilzYZIx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '40508e3c-269e-4d91-87cd-befd0381b757'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1057463130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4e3910db-ed08-4a5a-bb85-48c49eccbf9a,launched_at=2023-04-12T06:36:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth='CHAP NilzYZIx m31S4a9E5dizOF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:36:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:38:47Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:38:51 user cinder-volume[73792]: INFO cinder.action_track [req-f6734b2a-365e-4433-8330-8bd8941fd777 req-9e5b8501-1c93-4ead-b265-4279da3e6a4e tempest-ServerRescueNegativeTestJSON-1179647693 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1057463130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4e3910db-ed08-4a5a-bb85-48c49eccbf9a,launched_at=2023-04-12T06:36:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth='CHAP NilzYZIx m31S4a9E5dizOF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:36:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:38:51Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:39:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=16,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:39:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=17,cinder:UPDATE=7 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:39:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:39:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:39:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:39:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:39:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:39:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753671168', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:39:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:39:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:39:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:39:43 user cinder-volume[73792]: INFO cinder.action_track [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-606824657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a7204ed1-e658-42f0-b1fd-590e8b56f1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Flow 'volume_create_manager' (e20662cb-326b-4345-9f35-2db3d7fe4b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6b03ce-e5b2-4d00-87a0-48e7150f6fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6b03ce-e5b2-4d00-87a0-48e7150f6fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-606824657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a7204ed1-e658-42f0-b1fd-590e8b56f1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:39:44Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c3d231-0365-4e86-ae82-8ae1e8a43fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c3d231-0365-4e86-ae82-8ae1e8a43fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3de7ab0-c19b-4cb8-8f8e-2da276efe6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3de7ab0-c19b-4cb8-8f8e-2da276efe6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'volume_name': 'volume-a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5777043a-af5f-437a-bed2-8a7ff02fa44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5777043a-af5f-437a-bed2-8a7ff02fa44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f286e6-6e89-4dc4-870f-eda81d273936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:39:43 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Volume a7204ed1-e658-42f0-b1fd-590e8b56f1f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'volume_size': 1}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] creating volume v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] create volume {'name': 'v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:39:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:39:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'is_clone': False, 'name': 'v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:39:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f286e6-6e89-4dc4-870f-eda81d273936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:39:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282d94fc-bfbc-482a-a875-50e306d0216c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:39:44 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Volume volume-a7204ed1-e658-42f0-b1fd-590e8b56f1f5 (a7204ed1-e658-42f0-b1fd-590e8b56f1f5): created successfully
Apr 12 06:39:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282d94fc-bfbc-482a-a875-50e306d0216c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:39:44 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] Flow 'volume_create_manager' (e20662cb-326b-4345-9f35-2db3d7fe4b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:39:44 user cinder-volume[73792]: INFO cinder.action_track [None req-ce249bdd-85ec-4076-8e73-100797681825 tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-606824657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a7204ed1-e658-42f0-b1fd-590e8b56f1f5,launched_at=2023-04-12T06:39:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP YmGatSdx 5VGjA2EiRDOrB9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:39:44Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:39:44Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:39:46 user cinder-volume[73792]: INFO cinder.action_track [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-606824657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a7204ed1-e658-42f0-b1fd-590e8b56f1f5,launched_at=2023-04-12T06:39:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP YmGatSdx 5VGjA2EiRDOrB9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:39:44Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:39:46Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:39:46 user cinder-volume[73792]: INFO cinder.action_track [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-606824657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a7204ed1-e658-42f0-b1fd-590e8b56f1f5,launched_at=2023-04-12T06:39:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP YmGatSdx 5VGjA2EiRDOrB9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:39:44Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:39:46Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:39:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] create export for volume: a7204ed1-e658-42f0-b1fd-590e8b56f1f5. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:39:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] ensure volume a7204ed1-e658-42f0-b1fd-590e8b56f1f5 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:39:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] check if targe iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:39:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:39:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:39:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:39:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] create target and attach volume a7204ed1-e658-42f0-b1fd-590e8b56f1f5 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:39:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] create target iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:39:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:39:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:39:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:39:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] atach volume v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 to target iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:39:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:39:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:39:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3835366439343366', 'lun': 0, 'mode': 'wt', 'name': 'v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'prod_id': 'Storage', 'scsi_id': '856d943fbb33c971'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:39:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] add credentails to target iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:39:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:39:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:39:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YmGatSdx'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:39:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] initialize_connection for a7204ed1-e658-42f0-b1fd-590e8b56f1f5 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:39:50 user cinder-volume[73792]: INFO cinder.action_track [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmGatSdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '148fc50c-84ee-453f-90a5-ef24d0d03543'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-606824657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a7204ed1-e658-42f0-b1fd-590e8b56f1f5,launched_at=2023-04-12T06:39:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP YmGatSdx 5VGjA2EiRDOrB9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:39:44Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:39:46Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:39:50 user cinder-volume[73792]: INFO cinder.action_track [req-2dc40915-d342-4e6f-ae82-0367b5064218 req-b69a9f82-53b8-4507-a3eb-ad58a177004e tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-606824657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a7204ed1-e658-42f0-b1fd-590e8b56f1f5,launched_at=2023-04-12T06:39:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP YmGatSdx 5VGjA2EiRDOrB9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:39:44Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:39:51Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:39:54 user cinder-volume[73792]: INFO cinder.action_track [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-606824657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a7204ed1-e658-42f0-b1fd-590e8b56f1f5,launched_at=2023-04-12T06:39:44Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP YmGatSdx 5VGjA2EiRDOrB9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:39:44Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:39:54Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:39:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] terminate connection for a7204ed1-e658-42f0-b1fd-590e8b56f1f5  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:39:54 user cinder-volume[73792]: INFO cinder.action_track [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-606824657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a7204ed1-e658-42f0-b1fd-590e8b56f1f5,launched_at=2023-04-12T06:39:44Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP YmGatSdx 5VGjA2EiRDOrB9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:39:44Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:39:54Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:39:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] Deleting attachment 148fc50c-84ee-453f-90a5-ef24d0d03543. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:39:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] remove_export for volume: a7204ed1-e658-42f0-b1fd-590e8b56f1f5. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:39:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:39:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-606824657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a7204ed1-e658-42f0-b1fd-590e8b56f1f5,launched_at=2023-04-12T06:39:44Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP YmGatSdx 5VGjA2EiRDOrB9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:39:44Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:39:54Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:39:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] detach volume v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 from target iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:39:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/luns/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:39:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/luns/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:39:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/luns/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:39:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] delete target: iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:39:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] delete target iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:39:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:39:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:39:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:39:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 req-4ef13af3-8804-4084-8a56-63e5db3ac9fd tempest-AttachVolumeNegativeTest-1905486920 None] target iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:40:04 user cinder-volume[73792]: INFO cinder.action_track [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1569607038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff76495e-eafb-4932-9636-e017f0a60dbf,launched_at=2023-04-12T06:37:31Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='aa21d19689b343dd935505ba458dd6af',provider_auth='CHAP LBTgevpr G7uLnJ5aCHmZqt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:40:03Z,use_quota=True,user_id='0ed0f651f79846138e3be8f312b3188f',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] terminate connection for ff76495e-eafb-4932-9636-e017f0a60dbf  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:40:04 user cinder-volume[73792]: INFO cinder.action_track [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1569607038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff76495e-eafb-4932-9636-e017f0a60dbf,launched_at=2023-04-12T06:37:31Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='aa21d19689b343dd935505ba458dd6af',provider_auth='CHAP LBTgevpr G7uLnJ5aCHmZqt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:40:03Z,use_quota=True,user_id='0ed0f651f79846138e3be8f312b3188f',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] Deleting attachment 17c44b84-7de5-40cc-b13e-1031c4ecba32. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] remove_export for volume: ff76495e-eafb-4932-9636-e017f0a60dbf. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1569607038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff76495e-eafb-4932-9636-e017f0a60dbf,launched_at=2023-04-12T06:37:31Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='aa21d19689b343dd935505ba458dd6af',provider_auth='CHAP LBTgevpr G7uLnJ5aCHmZqt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:40:03Z,use_quota=True,user_id='0ed0f651f79846138e3be8f312b3188f',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] detach volume v_ff76495e-eafb-4932-9636-e017f0a60dbf from target iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/luns/v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/luns/v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/luns/v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] delete target: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] delete target iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-34433dcd-3d86-40a8-a390-6820efa83271 req-bca67a20-51c2-40e3-8511-cbb719bf95d9 tempest-ServerStableDeviceRescueTest-88660584 None] target iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:40:05 user cinder-volume[73792]: INFO cinder.action_track [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:38:16Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] terminate connection for 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:40:05 user cinder-volume[73792]: INFO cinder.action_track [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:38:16Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] Deleting attachment 1d1fd753-b682-4014-a151-aad3a167b5c3. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] remove_export for volume: 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:38:16Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] detach volume v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 from target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] delete target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] delete target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-af442830-d2ed-48be-b437-d192d06f24ff req-846c6f90-16db-47d7-aecd-0d15bd6cf222 tempest-ServerActionsTestJSON-752347644 None] target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:40:06 user cinder-volume[73792]: INFO cinder.action_track [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='reserved',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:40:06Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:40:06 user cinder-volume[73792]: INFO cinder.action_track [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='reserved',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:40:06Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:40:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] create export for volume: 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:40:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] ensure volume 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:40:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] check if targe iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:40:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] create target and attach volume 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:40:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] create target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:40:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] atach volume v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 to target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:40:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3861643530663738', 'lun': 0, 'mode': 'wt', 'name': 'v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'prod_id': 'Storage', 'scsi_id': '8ad50f7874045927'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] add credentails to target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:40:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 201, 'error': None, 'data': {'name': 'jMIEsORw'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] initialize_connection for 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:40:10 user cinder-volume[73792]: INFO cinder.action_track [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIEsORw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '5f20b09a-1757-4c0c-a2f8-9cac857e264c'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='reserved',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:40:06Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:40:10 user cinder-volume[73792]: INFO cinder.action_track [req-af442830-d2ed-48be-b437-d192d06f24ff req-a8d62a06-3199-4ef5-8acc-1aa185a6a985 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:40:11Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:40:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=35,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:40:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=39,cinder:UPDATE=10 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:40:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:40:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:40:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753564672', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:40:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:40:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:40:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.coordination [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Acquiring lock "cinder-ff76495e-eafb-4932-9636-e017f0a60dbf-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.coordination [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Lock "cinder-ff76495e-eafb-4932-9636-e017f0a60dbf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] remove_export for volume: ff76495e-eafb-4932-9636-e017f0a60dbf. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1569607038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ff76495e-eafb-4932-9636-e017f0a60dbf,launched_at=2023-04-12T06:37:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d19689b343dd935505ba458dd6af',provider_auth='CHAP LBTgevpr G7uLnJ5aCHmZqt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:40:53Z,updated_at=2023-04-12T06:40:53Z,use_quota=True,user_id='0ed0f651f79846138e3be8f312b3188f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] detach volume v_ff76495e-eafb-4932-9636-e017f0a60dbf from target iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/luns/v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/luns/v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/luns/v_ff76495e-eafb-4932-9636-e017f0a60dbf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf/luns/v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] failed to remove resource iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf because of JDSS resource v_ff76495e-eafb-4932-9636-e017f0a60dbf DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] delete target: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] delete target iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] failed to remove resource iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf because of JDSS resource iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] deleating volume v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] get snapshots for volume v_ff76495e-eafb-4932-9636-e017f0a60dbf  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff76495e-eafb-4932-9636-e017f0a60dbf/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff76495e-eafb-4932-9636-e017f0a60dbf/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff76495e-eafb-4932-9636-e017f0a60dbf/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] get volume v_ff76495e-eafb-4932-9636-e017f0a60dbf info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ff76495e-eafb-4932-9636-e017f0a60dbf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282868', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60637', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8198654405717822956', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '479b8c185f51f1c8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753540096', 'san:volume_id': '479b8c185f51f1c850b0b0dd5d2086aa041ec231', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37949', 'name': 'v_ff76495e-eafb-4932-9636-e017f0a60dbf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] delete volume:v_ff76495e-eafb-4932-9636-e017f0a60dbf recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ff76495e-eafb-4932-9636-e017f0a60dbf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] volume v_ff76495e-eafb-4932-9636-e017f0a60dbf deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:40:54 user cinder-volume[73792]: DEBUG cinder.quota [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Created reservations ['ee08d144-72aa-41c9-a3a5-ff31dfb9b355', '1adeab87-203a-4b13-a698-5cb40070a69d', 'f16a60cd-6694-43e4-a33b-d1ae8d86f108', 'ed5949b4-b5d1-486d-9fa4-de276e8244a7'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:40:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:40:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:40:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:40:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:40:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753609728', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:40:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:40:55 user cinder-volume[73792]: DEBUG cinder.manager [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:40:55 user cinder-volume[73792]: INFO cinder.volume.manager [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Deleted volume successfully.
Apr 12 06:40:55 user cinder-volume[73792]: DEBUG cinder.coordination [None req-43837e2b-f8c6-4abb-a79c-1fdf06464bae tempest-ServerStableDeviceRescueTest-88660584 None] Lock "cinder-ff76495e-eafb-4932-9636-e017f0a60dbf-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:41:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=10,cinder:SELECT=16,cinder:INSERT=2,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:41:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=17,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:41:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:41:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:41:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:41:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:41:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:41:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753585152', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:41:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:41:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:41:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:41:55 user cinder-volume[73792]: INFO cinder.action_track [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-160657954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1f851d6e-d135-4569-8b1f-236335e44bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a597407dd14b118473604e97693957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='15b5342c98c14ad0bdbc01e3d11f77bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Flow 'volume_create_manager' (ad43ce33-e664-4781-97ca-1afe09849e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae555986-25a5-4e4b-a971-21e5088837e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae555986-25a5-4e4b-a971-21e5088837e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-160657954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1f851d6e-d135-4569-8b1f-236335e44bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a597407dd14b118473604e97693957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:41:55Z,use_quota=True,user_id='15b5342c98c14ad0bdbc01e3d11f77bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2dd4a8-8c25-4041-947c-b8acec6ab89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2dd4a8-8c25-4041-947c-b8acec6ab89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f9c6e4-7e4f-4c87-800a-fc4bec02f33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f9c6e4-7e4f-4c87-800a-fc4bec02f33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f851d6e-d135-4569-8b1f-236335e44bb0', 'volume_name': 'volume-1f851d6e-d135-4569-8b1f-236335e44bb0', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f876023ead0>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab53df3-4286-4453-b96e-ea35e4954919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab53df3-4286-4453-b96e-ea35e4954919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7fc579e-3fca-407d-96cd-8ea073346532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:41:55 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Volume 1f851d6e-d135-4569-8b1f-236335e44bb0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f851d6e-d135-4569-8b1f-236335e44bb0', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f876023ead0>}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Cloning 1f851d6e-d135-4569-8b1f-236335e44bb0 from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.coordination [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.coordination [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 41, 55, 768139)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Found cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.coordination [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 41, 55, 781207)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Creating from source image-volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] cloned volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to 1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] cloning v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] create snapshot v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:41:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_1f851d6e-d135-4569-8b1f-236335e44bb0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] create volume v_1f851d6e-d135-4569-8b1f-236335e44bb0 from snapshot v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_1f851d6e-d135-4569-8b1f-236335e44bb0', 'is_clone': True, 'full_name': 'Pool-0/v_1f851d6e-d135-4569-8b1f-236335e44bb0', 'name': 'v_1f851d6e-d135-4569-8b1f-236335e44bb0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] get volume v_1f851d6e-d135-4569-8b1f-236335e44bb0 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_1f851d6e-d135-4569-8b1f-236335e44bb0', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1f851d6e-d135-4569-8b1f-236335e44bb0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283133', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60735', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7978632140009076755', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1205d1b348aec673', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753572864', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39085', 'name': 'v_1f851d6e-d135-4569-8b1f-236335e44bb0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Marking volume 1f851d6e-d135-4569-8b1f-236335e44bb0 as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to 1f851d6e-d135-4569-8b1f-236335e44bb0. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Creating volume glance metadata for volume 1f851d6e-d135-4569-8b1f-236335e44bb0 backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7fc579e-3fca-407d-96cd-8ea073346532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f851d6e-d135-4569-8b1f-236335e44bb0', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f876023ead0>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6808e1-236b-48c0-bf0c-9bc8b9a75160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:41:56 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Volume volume-1f851d6e-d135-4569-8b1f-236335e44bb0 (1f851d6e-d135-4569-8b1f-236335e44bb0): created successfully
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6808e1-236b-48c0-bf0c-9bc8b9a75160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:41:56 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] Flow 'volume_create_manager' (ad43ce33-e664-4781-97ca-1afe09849e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:41:56 user cinder-volume[73792]: INFO cinder.action_track [None req-499374c8-254c-4354-b5bb-7daf6502f962 tempest-VolumesImageMetadata-153720260 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-160657954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1f851d6e-d135-4569-8b1f-236335e44bb0,launched_at=2023-04-12T06:41:56Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a597407dd14b118473604e97693957',provider_auth='CHAP uYKTJBoD Xa3xY8tR0yVWHs',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:41:55Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:41:55Z,use_quota=True,user_id='15b5342c98c14ad0bdbc01e3d11f77bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:41:57 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Acquiring lock "cinder-1f851d6e-d135-4569-8b1f-236335e44bb0-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Lock "cinder-1f851d6e-d135-4569-8b1f-236335e44bb0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] remove_export for volume: 1f851d6e-d135-4569-8b1f-236335e44bb0. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-160657954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1f851d6e-d135-4569-8b1f-236335e44bb0,launched_at=2023-04-12T06:41:57Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a597407dd14b118473604e97693957',provider_auth='CHAP uYKTJBoD Xa3xY8tR0yVWHs',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:41:55Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:41:58Z,updated_at=2023-04-12T06:41:58Z,use_quota=True,user_id='15b5342c98c14ad0bdbc01e3d11f77bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] detach volume v_1f851d6e-d135-4569-8b1f-236335e44bb0 from target iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0/luns/v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0/luns/v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0/luns/v_1f851d6e-d135-4569-8b1f-236335e44bb0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0/luns/v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] failed to remove resource iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 because of JDSS resource v_1f851d6e-d135-4569-8b1f-236335e44bb0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] delete target: iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] delete target iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] failed to remove resource iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 because of JDSS resource iqn.2010-10.org.openstack:1f851d6e-d135-4569-8b1f-236335e44bb0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] deleating volume v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] get snapshots for volume v_1f851d6e-d135-4569-8b1f-236335e44bb0  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f851d6e-d135-4569-8b1f-236335e44bb0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f851d6e-d135-4569-8b1f-236335e44bb0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f851d6e-d135-4569-8b1f-236335e44bb0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] get volume v_1f851d6e-d135-4569-8b1f-236335e44bb0 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_1f851d6e-d135-4569-8b1f-236335e44bb0', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1f851d6e-d135-4569-8b1f-236335e44bb0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283133', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60735', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7978632140009076755', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1205d1b348aec673', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753560576', 'san:volume_id': '1205d1b348aec673c2dfa684a9abb4148528c85f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39085', 'name': 'v_1f851d6e-d135-4569-8b1f-236335e44bb0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] delete snapshot v_1f851d6e-d135-4569-8b1f-236335e44bb0 of volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:41:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:41:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_1f851d6e-d135-4569-8b1f-236335e44bb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:41:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] snapshot v_1f851d6e-d135-4569-8b1f-236335e44bb0 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:41:59 user cinder-volume[73792]: DEBUG cinder.quota [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Created reservations ['c11b0e05-647b-4b30-9d66-062abc107143', 'a711d649-699b-423a-9187-47d55c6aaef6', '6575953c-b9f3-45d5-9982-d1f487914861', '6484fe58-3640-4b61-bd61-ecf1f20a5200'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:41:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:41:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:41:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:41:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:41:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753585152', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:41:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:41:59 user cinder-volume[73792]: DEBUG cinder.manager [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:41:59 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Deleted volume successfully.
Apr 12 06:41:59 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7c7ddfff-5375-43ee-91b2-018b77f1e7db tempest-VolumesImageMetadata-153720260 None] Lock "cinder-1f851d6e-d135-4569-8b1f-236335e44bb0-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:42:02 user cinder-volume[73792]: INFO cinder.action_track [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-312964577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=af0ce9a9-04cb-443a-8b3c-6272eabe4f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b57240113645e698110d1c14137cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='b9288cc7eddb4e6ba34f99158f5ea05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=30,cinder:UPDATE=15,cinder:INSERT=7,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Flow 'volume_create_manager' (587592d1-427c-4f32-87b6-43521ef669df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26f8560-6df9-4438-9c3c-1756ad2e5976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26f8560-6df9-4438-9c3c-1756ad2e5976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-312964577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=af0ce9a9-04cb-443a-8b3c-6272eabe4f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b57240113645e698110d1c14137cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:42:02Z,use_quota=True,user_id='b9288cc7eddb4e6ba34f99158f5ea05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7170f2d-ced3-499e-8a83-051e771c4f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7170f2d-ced3-499e-8a83-051e771c4f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddb9375-1b96-46a5-aebd-67dba4f31882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddb9375-1b96-46a5-aebd-67dba4f31882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0ce9a9-04cb-443a-8b3c-6272eabe4f56', 'volume_name': 'volume-af0ce9a9-04cb-443a-8b3c-6272eabe4f56', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32785c07-fe4c-4653-8199-b93ab1ad659f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32785c07-fe4c-4653-8199-b93ab1ad659f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c557a840-045a-4827-af07-b98c6eb35c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:02 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Volume af0ce9a9-04cb-443a-8b3c-6272eabe4f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0ce9a9-04cb-443a-8b3c-6272eabe4f56', 'volume_size': 1}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] creating volume v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] create volume {'name': 'v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56', 'is_clone': False, 'name': 'v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c557a840-045a-4827-af07-b98c6eb35c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0ce9a9-04cb-443a-8b3c-6272eabe4f56', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abf28ad-8e18-4287-9e0a-2e2e2d2f5f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:02 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Volume volume-af0ce9a9-04cb-443a-8b3c-6272eabe4f56 (af0ce9a9-04cb-443a-8b3c-6272eabe4f56): created successfully
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abf28ad-8e18-4287-9e0a-2e2e2d2f5f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] Flow 'volume_create_manager' (587592d1-427c-4f32-87b6-43521ef669df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:42:02 user cinder-volume[73792]: INFO cinder.action_track [None req-c9c2ce80-f9e8-4abf-b752-c55e3706e7ca tempest-VolumesMetadataTest-328531590 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-312964577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=af0ce9a9-04cb-443a-8b3c-6272eabe4f56,launched_at=2023-04-12T06:42:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b57240113645e698110d1c14137cd2',provider_auth='CHAP yLGqVncB oRmsd2V7pWBrXy',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:02Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:42:02Z,use_quota=True,user_id='b9288cc7eddb4e6ba34f99158f5ea05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Acquiring lock "cinder-af0ce9a9-04cb-443a-8b3c-6272eabe4f56-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Lock "cinder-af0ce9a9-04cb-443a-8b3c-6272eabe4f56-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] remove_export for volume: af0ce9a9-04cb-443a-8b3c-6272eabe4f56. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-312964577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=af0ce9a9-04cb-443a-8b3c-6272eabe4f56,launched_at=2023-04-12T06:42:03Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b57240113645e698110d1c14137cd2',provider_auth='CHAP yLGqVncB oRmsd2V7pWBrXy',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:02Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:42:04Z,updated_at=2023-04-12T06:42:04Z,use_quota=True,user_id='b9288cc7eddb4e6ba34f99158f5ea05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] detach volume v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 from target iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56/luns/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56/luns/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56/luns/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56/luns/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] failed to remove resource iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 because of JDSS resource v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] delete target: iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] delete target iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] failed to remove resource iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 because of JDSS resource iqn.2010-10.org.openstack:af0ce9a9-04cb-443a-8b3c-6272eabe4f56 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] deleating volume v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] get snapshots for volume v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] get volume v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:42:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283139', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60742', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9613607109839391170', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '866ff7e16dfd9c16', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753503232', 'san:volume_id': '866ff7e16dfd9c16d02f0aeaecc07605316c675e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38558', 'name': 'v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] delete volume:v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:42:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] volume v_af0ce9a9-04cb-443a-8b3c-6272eabe4f56 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:42:05 user cinder-volume[73792]: DEBUG cinder.quota [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Created reservations ['a277ccfb-d624-4172-97a2-54d60d092519', '43c2215a-546c-40b3-a9c3-46684bc4fcf1', 'ac4fad86-87c3-4b39-abfe-e988db8be111', 'fe8f3c84-4e48-460a-b363-326d932a7499'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:42:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:42:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:42:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753597440', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:42:05 user cinder-volume[73792]: DEBUG cinder.manager [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:42:05 user cinder-volume[73792]: INFO cinder.volume.manager [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Deleted volume successfully.
Apr 12 06:42:05 user cinder-volume[73792]: DEBUG cinder.coordination [None req-df6abc78-4594-4e66-8100-6f93f972687b tempest-VolumesMetadataTest-328531590 None] Lock "cinder-af0ce9a9-04cb-443a-8b3c-6272eabe4f56-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:42:09 user cinder-volume[73792]: INFO cinder.action_track [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1481584220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Flow 'volume_create_manager' (6f9faead-ba8e-451a-ab8c-0c91fb851974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f32e6c3-33f3-4995-a71e-d8f55d2e139a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f32e6c3-33f3-4995-a71e-d8f55d2e139a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1481584220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:42:09Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7051874f-680b-4786-a7c0-ff31f4f10959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7051874f-680b-4786-a7c0-ff31f4f10959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a97730-62b5-4bd6-8ccf-ed38c695104e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a97730-62b5-4bd6-8ccf-ed38c695104e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'volume_name': 'volume-1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb012ca8-9174-440e-91fa-af02f60de38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb012ca8-9174-440e-91fa-af02f60de38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f475c79c-64bd-4ca6-bb08-ca3fb4a71c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:09 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Volume 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'volume_size': 1}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] creating volume v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] create volume {'name': 'v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'is_clone': False, 'name': 'v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f475c79c-64bd-4ca6-bb08-ca3fb4a71c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d94b84c-ff53-415f-9bdb-9bcea5892a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:09 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Volume volume-1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 (1a3b8849-fc77-4b4a-858e-5eb6bd4612d0): created successfully
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d94b84c-ff53-415f-9bdb-9bcea5892a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] Flow 'volume_create_manager' (6f9faead-ba8e-451a-ab8c-0c91fb851974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:42:09 user cinder-volume[73792]: INFO cinder.action_track [None req-2b80b6fe-e78d-469c-9d53-8a8bbb87b3fe tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1481584220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,launched_at=2023-04-12T06:42:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP zodFkufL JDsnwSP6ObUd9Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:42:09Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:42:10 user cinder-volume[73792]: INFO cinder.action_track [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-929784543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9004e518-c5eb-40fa-8afd-932d1d8b1625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Flow 'volume_create_manager' (303ce354-563e-43a9-a782-37ba70b267ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b209a093-6076-42a2-bcb3-5199b93bc2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b209a093-6076-42a2-bcb3-5199b93bc2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-929784543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9004e518-c5eb-40fa-8afd-932d1d8b1625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:42:11Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f385940f-f47a-43d8-9f28-676db1411ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f385940f-f47a-43d8-9f28-676db1411ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395a5b8d-8a91-4ea8-8f04-b0f47a693cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395a5b8d-8a91-4ea8-8f04-b0f47a693cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9004e518-c5eb-40fa-8afd-932d1d8b1625', 'volume_name': 'volume-9004e518-c5eb-40fa-8afd-932d1d8b1625', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8760004670>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48859be4-77ed-44a3-93e8-a262db20e2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48859be4-77ed-44a3-93e8-a262db20e2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25dfdd11-d04b-4e93-86d7-665d9aa40c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:10 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Volume 9004e518-c5eb-40fa-8afd-932d1d8b1625: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9004e518-c5eb-40fa-8afd-932d1d8b1625', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8760004670>}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Cloning 9004e518-c5eb-40fa-8afd-932d1d8b1625 from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.coordination [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.coordination [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 42, 10, 859496)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Found cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.coordination [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 42, 10, 873780)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Creating from source image-volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=65,cinder:UPDATE=22,cinder:INSERT=11,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] cloned volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to 9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] cloning v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_9004e518-c5eb-40fa-8afd-932d1d8b1625'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] create volume v_9004e518-c5eb-40fa-8afd-932d1d8b1625 from snapshot v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_9004e518-c5eb-40fa-8afd-932d1d8b1625', 'is_clone': True, 'full_name': 'Pool-0/v_9004e518-c5eb-40fa-8afd-932d1d8b1625', 'name': 'v_9004e518-c5eb-40fa-8afd-932d1d8b1625'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] get volume v_9004e518-c5eb-40fa-8afd-932d1d8b1625 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_9004e518-c5eb-40fa-8afd-932d1d8b1625', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9004e518-c5eb-40fa-8afd-932d1d8b1625', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283148', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60753', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10210092666370708826', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '413cfac28ab4a371', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753503232', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38582', 'name': 'v_9004e518-c5eb-40fa-8afd-932d1d8b1625', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Marking volume 9004e518-c5eb-40fa-8afd-932d1d8b1625 as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to 9004e518-c5eb-40fa-8afd-932d1d8b1625. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Creating volume glance metadata for volume 9004e518-c5eb-40fa-8afd-932d1d8b1625 backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25dfdd11-d04b-4e93-86d7-665d9aa40c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9004e518-c5eb-40fa-8afd-932d1d8b1625', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8760004670>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a72b3d02-c54a-47fd-bb2f-d82f3048509d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:42:11 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Volume volume-9004e518-c5eb-40fa-8afd-932d1d8b1625 (9004e518-c5eb-40fa-8afd-932d1d8b1625): created successfully
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a72b3d02-c54a-47fd-bb2f-d82f3048509d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:42:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] Flow 'volume_create_manager' (303ce354-563e-43a9-a782-37ba70b267ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:42:11 user cinder-volume[73792]: INFO cinder.action_track [None req-34a59427-8af5-42ae-8bc7-604779e5cb3d tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-929784543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9004e518-c5eb-40fa-8afd-932d1d8b1625,launched_at=2023-04-12T06:42:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP yJSKYpdN mQxMsHlqargGN5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:11Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:42:11Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:42:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:42:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:42:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:42:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753490944', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:42:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:42:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=20,cinder:SELECT=29,cinder:INSERT=8,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:42:37 user cinder-volume[73792]: INFO cinder.action_track [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1057463130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4e3910db-ed08-4a5a-bb85-48c49eccbf9a,launched_at=2023-04-12T06:36:52Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth='CHAP NilzYZIx m31S4a9E5dizOF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:36:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:42:37Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] terminate connection for 4e3910db-ed08-4a5a-bb85-48c49eccbf9a  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:42:37 user cinder-volume[73792]: INFO cinder.action_track [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1057463130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4e3910db-ed08-4a5a-bb85-48c49eccbf9a,launched_at=2023-04-12T06:36:52Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth='CHAP NilzYZIx m31S4a9E5dizOF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:36:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:42:37Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] Deleting attachment 40508e3c-269e-4d91-87cd-befd0381b757. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] remove_export for volume: 4e3910db-ed08-4a5a-bb85-48c49eccbf9a. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1057463130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4e3910db-ed08-4a5a-bb85-48c49eccbf9a,launched_at=2023-04-12T06:36:52Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth='CHAP NilzYZIx m31S4a9E5dizOF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:36:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:42:37Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] detach volume v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a from target iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/luns/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/luns/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/luns/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] delete target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] delete target iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:42:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:42:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:42:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 req-fff73233-3082-45eb-ba52-3f8eb0ee62ae tempest-ServerRescueNegativeTestJSON-1179647693 None] target iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:42:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=23,cinder:INSERT=6,cinder:UPDATE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:43:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:43:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:43:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:43:26 user cinder-volume[73792]: INFO cinder.action_track [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:54Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3b12a713-8214-4892-a05d-c4ae96583b31,launched_at=2023-04-12T06:37:56Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP mHIBytCb k2zJWto3FBZSlg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:54Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:38:04Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:43:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] terminate connection for 3b12a713-8214-4892-a05d-c4ae96583b31  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:43:26 user cinder-volume[73792]: INFO cinder.action_track [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:54Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3b12a713-8214-4892-a05d-c4ae96583b31,launched_at=2023-04-12T06:37:56Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP mHIBytCb k2zJWto3FBZSlg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:54Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:38:04Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:43:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Deleting attachment 360e09a9-ce8b-489d-b13f-b0dd5093cd73. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:43:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] remove_export for volume: 3b12a713-8214-4892-a05d-c4ae96583b31. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:43:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:43:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:37:54Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3b12a713-8214-4892-a05d-c4ae96583b31,launched_at=2023-04-12T06:37:56Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP mHIBytCb k2zJWto3FBZSlg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:37:54Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:38:04Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:43:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] detach volume v_3b12a713-8214-4892-a05d-c4ae96583b31 from target iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:43:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31/luns/v_3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:43:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31/luns/v_3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:43:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31/luns/v_3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:43:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] delete target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:43:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] delete target iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:43:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:43:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:43:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:43:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f558e005-afe2-4581-8975-3a60b1220260 req-3bbc9dbe-5a83-4d71-b419-0070889ebb6a tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] target iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:43:29 user cinder-volume[73792]: INFO cinder.action_track [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1031104917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19ab1977-9c7a-4434-8e2c-2b9b0899eeb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Flow 'volume_create_manager' (7213d885-69f8-4e55-8e95-b595c333fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce32ae6a-936f-46ba-863d-92c0110a63f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce32ae6a-936f-46ba-863d-92c0110a63f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1031104917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19ab1977-9c7a-4434-8e2c-2b9b0899eeb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:43:30Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496a30be-6810-4680-a310-15add68fda88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496a30be-6810-4680-a310-15add68fda88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e1d8a9-902b-458a-a4f0-6f9e0bec091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e1d8a9-902b-458a-a4f0-6f9e0bec091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'volume_name': 'volume-19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789b1f97-ba47-4327-b0ad-2d4dcd3fd858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789b1f97-ba47-4327-b0ad-2d4dcd3fd858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ff2ef1-47b2-45d0-87e0-a86ef2413bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:43:29 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Volume 19ab1977-9c7a-4434-8e2c-2b9b0899eeb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'volume_size': 1}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] creating volume v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] create volume {'name': 'v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:43:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'is_clone': False, 'name': 'v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ff2ef1-47b2-45d0-87e0-a86ef2413bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d8f52d-9159-4d17-9c66-143e38d9b939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:43:30 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Volume volume-19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 (19ab1977-9c7a-4434-8e2c-2b9b0899eeb0): created successfully
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d8f52d-9159-4d17-9c66-143e38d9b939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] Flow 'volume_create_manager' (7213d885-69f8-4e55-8e95-b595c333fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:43:30 user cinder-volume[73792]: INFO cinder.action_track [None req-e3fd30d1-0a59-4dc8-9c17-37ff6028cce3 tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1031104917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19ab1977-9c7a-4434-8e2c-2b9b0899eeb0,launched_at=2023-04-12T06:43:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP yQlRDGcx yiXIfSxvLowd1T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:43:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:43:30Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753421312', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:43:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:43:31 user cinder-volume[73792]: INFO cinder.action_track [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1031104917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19ab1977-9c7a-4434-8e2c-2b9b0899eeb0,launched_at=2023-04-12T06:43:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP yQlRDGcx yiXIfSxvLowd1T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:43:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:43:31Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:43:31 user cinder-volume[73792]: INFO cinder.action_track [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1031104917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19ab1977-9c7a-4434-8e2c-2b9b0899eeb0,launched_at=2023-04-12T06:43:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP yQlRDGcx yiXIfSxvLowd1T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:43:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:43:31Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:43:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] create export for volume: 19ab1977-9c7a-4434-8e2c-2b9b0899eeb0. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:43:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] ensure volume 19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:43:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] check if targe iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:43:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:43:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:43:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:43:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] create target and attach volume 19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:43:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] create target iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:43:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:43:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:43:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:43:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] atach volume v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 to target iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:43:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:43:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:43:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6663616630616164', 'lun': 0, 'mode': 'wt', 'name': 'v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'prod_id': 'Storage', 'scsi_id': 'fcaf0aad20c3172b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:43:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] add credentails to target iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:43:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:43:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:43:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 201, 'error': None, 'data': {'name': 'yQlRDGcx'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:43:35 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=20,cinder:UPDATE=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:43:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] initialize_connection for 19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:43:35 user cinder-volume[73792]: INFO cinder.action_track [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQlRDGcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '8e1742a1-38bf-477b-aed3-cb2bde050367'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1031104917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19ab1977-9c7a-4434-8e2c-2b9b0899eeb0,launched_at=2023-04-12T06:43:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP yQlRDGcx yiXIfSxvLowd1T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:43:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:43:31Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:43:35 user cinder-volume[73792]: INFO cinder.action_track [req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 req-00318640-5824-45b3-989d-90fddc6c895b tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1031104917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19ab1977-9c7a-4434-8e2c-2b9b0899eeb0,launched_at=2023-04-12T06:43:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP yQlRDGcx yiXIfSxvLowd1T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:43:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:43:35Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:43:38 user cinder-volume[73792]: INFO cinder.action_track [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1031104917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19ab1977-9c7a-4434-8e2c-2b9b0899eeb0,launched_at=2023-04-12T06:43:30Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP yQlRDGcx yiXIfSxvLowd1T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:43:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:43:38Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:43:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] terminate connection for 19ab1977-9c7a-4434-8e2c-2b9b0899eeb0  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:43:38 user cinder-volume[73792]: INFO cinder.action_track [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1031104917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19ab1977-9c7a-4434-8e2c-2b9b0899eeb0,launched_at=2023-04-12T06:43:30Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP yQlRDGcx yiXIfSxvLowd1T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:43:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:43:38Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:43:38 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] Deleting attachment 8e1742a1-38bf-477b-aed3-cb2bde050367. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:43:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] remove_export for volume: 19ab1977-9c7a-4434-8e2c-2b9b0899eeb0. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:43:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:43:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1031104917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19ab1977-9c7a-4434-8e2c-2b9b0899eeb0,launched_at=2023-04-12T06:43:30Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP yQlRDGcx yiXIfSxvLowd1T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:43:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:43:38Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:43:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] detach volume v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 from target iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:43:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/luns/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:43:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/luns/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:43:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/luns/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:43:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] delete target: iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:43:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] delete target iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:43:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:43:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:43:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:43:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-42448c89-deb2-4e89-80c9-11719848183f req-13be52c9-b6a9-4b6b-a607-c9f9ee2f669d tempest-AttachVolumeNegativeTest-1905486920 None] target iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:44:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=13,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:44:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=24,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:44:04 user cinder-volume[73792]: INFO cinder.action_track [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-929784543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9004e518-c5eb-40fa-8afd-932d1d8b1625,launched_at=2023-04-12T06:42:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP yJSKYpdN mQxMsHlqargGN5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:11Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:44:04Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:44:04 user cinder-volume[73792]: INFO cinder.action_track [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-929784543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9004e518-c5eb-40fa-8afd-932d1d8b1625,launched_at=2023-04-12T06:42:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP yJSKYpdN mQxMsHlqargGN5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:11Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:44:04Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:44:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] create export for volume: 9004e518-c5eb-40fa-8afd-932d1d8b1625. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:44:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] ensure volume 9004e518-c5eb-40fa-8afd-932d1d8b1625 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:44:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] check if targe iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:44:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] create target and attach volume 9004e518-c5eb-40fa-8afd-932d1d8b1625 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:44:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] create target iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:44:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] atach volume v_9004e518-c5eb-40fa-8afd-932d1d8b1625 to target iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:44:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3431336366616332', 'lun': 0, 'mode': 'wt', 'name': 'v_9004e518-c5eb-40fa-8afd-932d1d8b1625', 'prod_id': 'Storage', 'scsi_id': '413cfac28ab4a371'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] add credentails to target iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:44:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': {'name': 'yJSKYpdN'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] initialize_connection for 9004e518-c5eb-40fa-8afd-932d1d8b1625 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:44:08 user cinder-volume[73792]: INFO cinder.action_track [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJSKYpdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '132c38c7-5faf-4035-8b8c-c5116ac6074e'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-929784543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9004e518-c5eb-40fa-8afd-932d1d8b1625,launched_at=2023-04-12T06:42:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP yJSKYpdN mQxMsHlqargGN5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:11Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:44:04Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:44:08 user cinder-volume[73792]: INFO cinder.action_track [req-e7295922-9023-4fdd-b976-2c67a4453664 req-85722e8e-4cb9-46e9-9140-54f41158a234 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-929784543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9004e518-c5eb-40fa-8afd-932d1d8b1625,launched_at=2023-04-12T06:42:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP yJSKYpdN mQxMsHlqargGN5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:11Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:44:08Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:44:10 user cinder-volume[73792]: INFO cinder.action_track [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Snapshot-193837295',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=99f4b6e2-09da-44b7-85bc-1907f904baac,metadata={},progress='0%',project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume=<?>,volume_id=9004e518-c5eb-40fa-8afd-932d1d8b1625,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:44:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot 99f4b6e2-09da-44b7-85bc-1907f904baac for volume 9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:44:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] cloning v_9004e518-c5eb-40fa-8afd-932d1d8b1625 to s_99f4b6e2-09da-44b7-85bc-1907f904baac {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:44:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot s_99f4b6e2-09da-44b7-85bc-1907f904baac {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:44:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_99f4b6e2-09da-44b7-85bc-1907f904baac'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] create volume s_99f4b6e2-09da-44b7-85bc-1907f904baac from snapshot s_99f4b6e2-09da-44b7-85bc-1907f904baac {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:44:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9004e518-c5eb-40fa-8afd-932d1d8b1625@s_99f4b6e2-09da-44b7-85bc-1907f904baac', 'is_clone': True, 'full_name': 'Pool-0/s_99f4b6e2-09da-44b7-85bc-1907f904baac', 'name': 's_99f4b6e2-09da-44b7-85bc-1907f904baac'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99f4b6e2-09da-44b7-85bc-1907f904baac/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99f4b6e2-09da-44b7-85bc-1907f904baac/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99f4b6e2-09da-44b7-85bc-1907f904baac/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] volume s_99f4b6e2-09da-44b7-85bc-1907f904baac properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:44:11 user cinder-volume[73792]: INFO cinder.volume.manager [None req-d83535b3-385e-4141-a284-6a3ae4ef4df1 tempest-VolumesSnapshotTestJSON-2015355536 None] Create snapshot completed successfully
Apr 12 06:44:12 user cinder-volume[73792]: INFO cinder.action_track [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Snapshot-1566934788',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=916e156c-7e12-46c1-9b4e-109e80956675,metadata={},progress='0%',project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume=<?>,volume_id=9004e518-c5eb-40fa-8afd-932d1d8b1625,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:44:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot 916e156c-7e12-46c1-9b4e-109e80956675 for volume 9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:44:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] cloning v_9004e518-c5eb-40fa-8afd-932d1d8b1625 to s_916e156c-7e12-46c1-9b4e-109e80956675 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:44:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot s_916e156c-7e12-46c1-9b4e-109e80956675 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:44:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_916e156c-7e12-46c1-9b4e-109e80956675'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] create volume s_916e156c-7e12-46c1-9b4e-109e80956675 from snapshot s_916e156c-7e12-46c1-9b4e-109e80956675 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:44:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9004e518-c5eb-40fa-8afd-932d1d8b1625@s_916e156c-7e12-46c1-9b4e-109e80956675', 'is_clone': True, 'full_name': 'Pool-0/s_916e156c-7e12-46c1-9b4e-109e80956675', 'name': 's_916e156c-7e12-46c1-9b4e-109e80956675'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_916e156c-7e12-46c1-9b4e-109e80956675/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_916e156c-7e12-46c1-9b4e-109e80956675/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_916e156c-7e12-46c1-9b4e-109e80956675/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] volume s_916e156c-7e12-46c1-9b4e-109e80956675 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:44:13 user cinder-volume[73792]: INFO cinder.volume.manager [None req-934a9067-942d-4e8a-9142-f5d92b15d9d5 tempest-VolumesSnapshotTestJSON-2015355536 None] Create snapshot completed successfully
Apr 12 06:44:14 user cinder-volume[73792]: INFO cinder.action_track [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Snapshot-657042746',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=b6df29c1-8afb-4813-baa6-6d3f8ad7127a,metadata={},progress='0%',project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume=<?>,volume_id=9004e518-c5eb-40fa-8afd-932d1d8b1625,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:44:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot b6df29c1-8afb-4813-baa6-6d3f8ad7127a for volume 9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:44:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] cloning v_9004e518-c5eb-40fa-8afd-932d1d8b1625 to s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:44:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:44:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_b6df29c1-8afb-4813-baa6-6d3f8ad7127a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] create volume s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a from snapshot s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:44:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9004e518-c5eb-40fa-8afd-932d1d8b1625@s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a', 'is_clone': True, 'full_name': 'Pool-0/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a', 'name': 's_b6df29c1-8afb-4813-baa6-6d3f8ad7127a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] volume s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:44:15 user cinder-volume[73792]: INFO cinder.volume.manager [None req-90f194b6-9dcf-445c-b1f5-419985d0c06e tempest-VolumesSnapshotTestJSON-2015355536 None] Create snapshot completed successfully
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-99f4b6e2-09da-44b7-85bc-1907f904baac-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-99f4b6e2-09da-44b7-85bc-1907f904baac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] deleating snapshot s_99f4b6e2-09da-44b7-85bc-1907f904baac. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume s_99f4b6e2-09da-44b7-85bc-1907f904baac  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99f4b6e2-09da-44b7-85bc-1907f904baac/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99f4b6e2-09da-44b7-85bc-1907f904baac/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99f4b6e2-09da-44b7-85bc-1907f904baac/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] get volume s_99f4b6e2-09da-44b7-85bc-1907f904baac info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99f4b6e2-09da-44b7-85bc-1907f904baac {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99f4b6e2-09da-44b7-85bc-1907f904baac {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9004e518-c5eb-40fa-8afd-932d1d8b1625@s_99f4b6e2-09da-44b7-85bc-1907f904baac', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_99f4b6e2-09da-44b7-85bc-1907f904baac', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283268', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60795', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8509745389793232462', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'faeab9c924ec679f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753298432', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38697', 'name': 's_99f4b6e2-09da-44b7-85bc-1907f904baac', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_99f4b6e2-09da-44b7-85bc-1907f904baac {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] delete snapshot s_99f4b6e2-09da-44b7-85bc-1907f904baac of volume v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots/s_99f4b6e2-09da-44b7-85bc-1907f904baac {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots/s_99f4b6e2-09da-44b7-85bc-1907f904baac {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots/s_99f4b6e2-09da-44b7-85bc-1907f904baac {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] snapshot s_99f4b6e2-09da-44b7-85bc-1907f904baac deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:44:17 user cinder-volume[73792]: DEBUG cinder.quota [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['a7731e81-7f14-4be1-9bf3-5b9d3f8b12f3', '477a46dc-a400-46ad-927c-e2db3758a92c', '8096a81d-4701-462b-ba43-3139757b7035', 'd5c63438-92fc-4b4e-a1ce-08a9262f24e2'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:44:17 user cinder-volume[73792]: INFO cinder.volume.manager [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Delete snapshot completed successfully.
Apr 12 06:44:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f4a89c28-c638-433b-ae7a-aedcaa26cc75 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-99f4b6e2-09da-44b7-85bc-1907f904baac-delete_snapshot" released by "delete_snapshot" :: held 1.329s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.coordination [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Acquiring lock "cinder-4e3910db-ed08-4a5a-bb85-48c49eccbf9a-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.coordination [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Lock "cinder-4e3910db-ed08-4a5a-bb85-48c49eccbf9a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] remove_export for volume: 4e3910db-ed08-4a5a-bb85-48c49eccbf9a. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1057463130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4e3910db-ed08-4a5a-bb85-48c49eccbf9a,launched_at=2023-04-12T06:36:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth='CHAP NilzYZIx m31S4a9E5dizOF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:36:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:44:18Z,updated_at=2023-04-12T06:44:18Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] detach volume v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a from target iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/luns/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/luns/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/luns/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a/luns/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] failed to remove resource iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a because of JDSS resource v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] delete target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] delete target iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] failed to remove resource iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a because of JDSS resource iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] deleating volume v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] get snapshots for volume v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] get volume v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282829', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60626', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1912502146022230100', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c85774141383be27', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753335296', 'san:volume_id': 'c85774141383be272346db14f27828aff5cd45e9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39057', 'name': 'v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] delete volume:v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.coordination [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-b6df29c1-8afb-4813-baa6-6d3f8ad7127a-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.coordination [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-b6df29c1-8afb-4813-baa6-6d3f8ad7127a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] deleating snapshot s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] get volume s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9004e518-c5eb-40fa-8afd-932d1d8b1625@s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283272', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60807', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3000090747816370922', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b3f846897f60c4c8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753335296', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39173', 'name': 's_b6df29c1-8afb-4813-baa6-6d3f8ad7127a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] delete snapshot s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a of volume v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] volume v_4e3910db-ed08-4a5a-bb85-48c49eccbf9a deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG cinder.quota [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Created reservations ['33745b75-d560-4c14-a9dd-8aa2276c9422', '2cb65ade-15a9-4414-bfd7-5909e47ef134', '041a6edb-5989-4c96-b04d-6e7360c7c90a', '9637837e-47e2-4c76-b401-e86f7fa804d7'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots/s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] snapshot s_b6df29c1-8afb-4813-baa6-6d3f8ad7127a deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=53,cinder:UPDATE=21,cinder:INSERT=25,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=61,cinder:UPDATE=18,cinder:INSERT=19,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG cinder.quota [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['52e09224-532b-41b0-a9c7-a482002c7e32', '2cc3cfe4-db0d-4a30-aae9-c8a02d7b0906', '4a2c13e0-195d-44e5-aa0e-772bce30eb9d', '3f9b0505-9100-4664-a93b-536a4163fb38'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:44:19 user cinder-volume[73792]: INFO cinder.volume.manager [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Delete snapshot completed successfully.
Apr 12 06:44:19 user cinder-volume[73792]: DEBUG cinder.coordination [None req-944c7214-b518-48db-b00b-eb2273c80c54 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-b6df29c1-8afb-4813-baa6-6d3f8ad7127a-delete_snapshot" released by "delete_snapshot" :: held 1.206s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753454080', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.manager [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:44:20 user cinder-volume[73792]: INFO cinder.volume.manager [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Deleted volume successfully.
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.coordination [None req-729dbb44-2ba9-429d-8e03-5ce803f127aa tempest-ServerRescueNegativeTestJSON-1179647693 None] Lock "cinder-4e3910db-ed08-4a5a-bb85-48c49eccbf9a-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.coordination [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Acquiring lock "cinder-8ce85a4c-100f-44cd-b4a4-a32bac7351a8-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.coordination [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Lock "cinder-8ce85a4c-100f-44cd-b4a4-a32bac7351a8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] remove_export for volume: 8ce85a4c-100f-44cd-b4a4-a32bac7351a8. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-882481842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8ce85a4c-100f-44cd-b4a4-a32bac7351a8,launched_at=2023-04-12T06:33:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972842dc32ee4687866dfe2fbefe9cb4',provider_auth='CHAP IiJUEloD P5ENf0UXk3wWOS',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:44:20Z,updated_at=2023-04-12T06:44:20Z,use_quota=True,user_id='dc8e6af1db834409a4880040a5ef6a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] detach volume v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 from target iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8/luns/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8/luns/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8/luns/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8/luns/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] failed to remove resource iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 because of JDSS resource v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] delete target: iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] delete target iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] failed to remove resource iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 because of JDSS resource iqn.2010-10.org.openstack:8ce85a4c-100f-44cd-b4a4-a32bac7351a8 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] deleating volume v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] get snapshots for volume v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] get volume v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282606', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60480', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3652224011772949349', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4ef32533d565532c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753454080', 'san:volume_id': '4ef32533d565532c7fffc5a12c3db5a1669c7295', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37866', 'name': 'v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] delete volume:v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.coordination [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-916e156c-7e12-46c1-9b4e-109e80956675-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.coordination [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-916e156c-7e12-46c1-9b4e-109e80956675-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] deleating snapshot s_916e156c-7e12-46c1-9b4e-109e80956675. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume s_916e156c-7e12-46c1-9b4e-109e80956675  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_916e156c-7e12-46c1-9b4e-109e80956675/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_916e156c-7e12-46c1-9b4e-109e80956675/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_916e156c-7e12-46c1-9b4e-109e80956675/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] get volume s_916e156c-7e12-46c1-9b4e-109e80956675 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_916e156c-7e12-46c1-9b4e-109e80956675 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_916e156c-7e12-46c1-9b4e-109e80956675 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_9004e518-c5eb-40fa-8afd-932d1d8b1625@s_916e156c-7e12-46c1-9b4e-109e80956675', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_916e156c-7e12-46c1-9b4e-109e80956675', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283269', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60801', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11641374008719625815', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3a5448afaea41af3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753454080', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37110', 'name': 's_916e156c-7e12-46c1-9b4e-109e80956675', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_916e156c-7e12-46c1-9b4e-109e80956675 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] delete snapshot s_916e156c-7e12-46c1-9b4e-109e80956675 of volume v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots/s_916e156c-7e12-46c1-9b4e-109e80956675 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots/s_916e156c-7e12-46c1-9b4e-109e80956675 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] volume v_8ce85a4c-100f-44cd-b4a4-a32bac7351a8 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.quota [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Created reservations ['609fdfca-79d2-4303-ae1e-ee34b853553e', '5ebeff11-aba4-4131-94aa-aaf053a5c26c', '87684206-ebbf-4918-acd5-4f0db22ae188', '144c0df5-61ac-4cd8-86eb-a7bbb2f3ac47'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots/s_916e156c-7e12-46c1-9b4e-109e80956675 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] snapshot s_916e156c-7e12-46c1-9b4e-109e80956675 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.quota [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['13a13143-ed87-4189-a75c-be1ee1ea09f8', '57807d63-174b-4213-b297-eff51c775af9', 'bf2e5977-2237-4868-af42-970516038d7c', '284af062-82af-4f8c-9cbf-9ceb5daf2e94'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:44:21 user cinder-volume[73792]: INFO cinder.volume.manager [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Delete snapshot completed successfully.
Apr 12 06:44:21 user cinder-volume[73792]: DEBUG cinder.coordination [None req-79882258-1a34-4ac5-be98-958143b20e89 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-916e156c-7e12-46c1-9b4e-109e80956675-delete_snapshot" released by "delete_snapshot" :: held 1.112s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:44:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753548288', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:44:22 user cinder-volume[73792]: DEBUG cinder.manager [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:44:22 user cinder-volume[73792]: INFO cinder.volume.manager [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Deleted volume successfully.
Apr 12 06:44:22 user cinder-volume[73792]: DEBUG cinder.coordination [None req-445f9f6b-f477-4f9e-9352-ae4935d7cef0 tempest-ServerRescueNegativeTestJSON-1179647693 None] Lock "cinder-8ce85a4c-100f-44cd-b4a4-a32bac7351a8-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:44:24 user cinder-volume[73792]: INFO cinder.action_track [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-929784543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9004e518-c5eb-40fa-8afd-932d1d8b1625,launched_at=2023-04-12T06:42:12Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP yJSKYpdN mQxMsHlqargGN5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:11Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:44:23Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] terminate connection for 9004e518-c5eb-40fa-8afd-932d1d8b1625  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:44:24 user cinder-volume[73792]: INFO cinder.action_track [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-929784543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9004e518-c5eb-40fa-8afd-932d1d8b1625,launched_at=2023-04-12T06:42:12Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP yJSKYpdN mQxMsHlqargGN5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:11Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:44:23Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] Deleting attachment 132c38c7-5faf-4035-8b8c-c5116ac6074e. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] remove_export for volume: 9004e518-c5eb-40fa-8afd-932d1d8b1625. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-929784543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9004e518-c5eb-40fa-8afd-932d1d8b1625,launched_at=2023-04-12T06:42:12Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP yJSKYpdN mQxMsHlqargGN5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:11Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:44:23Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume v_9004e518-c5eb-40fa-8afd-932d1d8b1625 from target iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/luns/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/luns/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/luns/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] delete target: iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] delete target iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f60f7268-c51a-4073-9559-ee5d57b07b54 req-ddd67e59-b510-4960-89b4-f4c3ba3d501f tempest-VolumesSnapshotTestJSON-2015355536 None] target iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:44:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:44:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:44:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:44:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753548288', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:44:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:44:45 user cinder-volume[73792]: INFO cinder.action_track [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:40:16Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:44:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] terminate connection for 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:44:45 user cinder-volume[73792]: INFO cinder.action_track [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:40:16Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:44:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] Deleting attachment 5f20b09a-1757-4c0c-a2f8-9cac857e264c. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:44:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] remove_export for volume: 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:44:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:44:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:40:16Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:44:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] detach volume v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 from target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:44:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] delete target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] delete target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-8f4ac3d1-d3b6-4908-a10e-82e72f0d3727 tempest-ServerActionsTestJSON-752347644 None] target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.coordination [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Acquiring lock "cinder-6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.coordination [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Lock "cinder-6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] remove_export for volume: 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1179773749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7,launched_at=2023-04-12T06:38:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP jMIEsORw lOwSgbA1IUe8rv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:38:07Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:44:47Z,updated_at=2023-04-12T06:44:47Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] detach volume v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 from target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/luns/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] failed to remove resource iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 because of JDSS resource v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] delete target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] delete target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] failed to remove resource iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 because of JDSS resource iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] deleating volume v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] get snapshots for volume v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] get volume v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:44:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282905', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26116096', 'sharesmb': None, 'createtxg': '60661', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6890043797728209449', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10137600', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '8ad50f7874045927', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753548288', 'san:volume_id': '8ad50f787404592727031965ada6231adcb41d28', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10137600', 'objsetid': '38858', 'name': 'v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10137600', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] delete snapshot v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 of volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:44:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] snapshot v_6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:44:47 user cinder-volume[73792]: DEBUG cinder.quota [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Created reservations ['79568ee6-6f68-41a5-b456-b651b82be822', '1ff0edb0-0ecb-4c5b-8fdb-76fe4c7ebfc5', 'a1d4f29b-62cd-4215-991e-aeacb346de68', 'f755d477-6793-4091-9250-f40d05198d33'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:44:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:44:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:44:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:44:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:44:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763747328', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:44:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:44:48 user cinder-volume[73792]: DEBUG cinder.manager [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:44:48 user cinder-volume[73792]: INFO cinder.volume.manager [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Deleted volume successfully.
Apr 12 06:44:48 user cinder-volume[73792]: DEBUG cinder.coordination [req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a req-f6b3677d-6ed6-4aca-ab9a-4909aaf66740 tempest-ServerActionsTestJSON-752347644 None] Lock "cinder-6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:44:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=45,cinder:INSERT=11,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:44:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=49,cinder:UPDATE=32,cinder:INSERT=5,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:45:07 user cinder-volume[73792]: INFO cinder.action_track [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:22Z,deleted=False,deleted_at=None,display_description='',display_name='ebb36f74-c4a3-4108-949d-1fb8918f9a8c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9013e447-dbe0-46fc-97fe-c8d65768b297,launched_at=2023-04-12T06:29:23Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP KQizkfug 7qlAL9WOgiYBt6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:22Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:29:32Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] terminate connection for 9013e447-dbe0-46fc-97fe-c8d65768b297  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:45:07 user cinder-volume[73792]: INFO cinder.action_track [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:22Z,deleted=False,deleted_at=None,display_description='',display_name='ebb36f74-c4a3-4108-949d-1fb8918f9a8c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9013e447-dbe0-46fc-97fe-c8d65768b297,launched_at=2023-04-12T06:29:23Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP KQizkfug 7qlAL9WOgiYBt6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:22Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:29:32Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Deleting attachment 86dae585-faec-4479-90d5-f67160f21e09. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] remove_export for volume: 9013e447-dbe0-46fc-97fe-c8d65768b297. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:29:22Z,deleted=False,deleted_at=None,display_description='',display_name='ebb36f74-c4a3-4108-949d-1fb8918f9a8c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9013e447-dbe0-46fc-97fe-c8d65768b297,launched_at=2023-04-12T06:29:23Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',provider_auth='CHAP KQizkfug 7qlAL9WOgiYBt6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:29:22Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:29:32Z,use_quota=True,user_id='2e5e4455358643b8830ce8c96aad5aad',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] detach volume v_9013e447-dbe0-46fc-97fe-c8d65768b297 from target iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297/luns/v_9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297/luns/v_9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297/luns/v_9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] delete target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] delete target iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd343274-5a27-4243-8f35-5945f29017d3 req-6b21655c-22c8-4f00-933d-9140baed3910 tempest-ServerBootFromVolumeStableRescueTest-2063268056 None] target iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-9004e518-c5eb-40fa-8afd-932d1d8b1625-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-9004e518-c5eb-40fa-8afd-932d1d8b1625-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] remove_export for volume: 9004e518-c5eb-40fa-8afd-932d1d8b1625. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-929784543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9004e518-c5eb-40fa-8afd-932d1d8b1625,launched_at=2023-04-12T06:42:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP yJSKYpdN mQxMsHlqargGN5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:11Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:45:14Z,updated_at=2023-04-12T06:45:14Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume v_9004e518-c5eb-40fa-8afd-932d1d8b1625 from target iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/luns/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/luns/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/luns/v_9004e518-c5eb-40fa-8afd-932d1d8b1625'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625/luns/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] failed to remove resource iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 because of JDSS resource v_9004e518-c5eb-40fa-8afd-932d1d8b1625 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] delete target: iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] delete target iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] failed to remove resource iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 because of JDSS resource iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] deleating volume v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume v_9004e518-c5eb-40fa-8afd-932d1d8b1625  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] get volume v_9004e518-c5eb-40fa-8afd-932d1d8b1625 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_9004e518-c5eb-40fa-8afd-932d1d8b1625', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9004e518-c5eb-40fa-8afd-932d1d8b1625', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283148', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60753', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10210092666370708826', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '413cfac28ab4a371', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763735040', 'san:volume_id': '413cfac28ab4a37177a9594f2913cadf34506282', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38582', 'name': 'v_9004e518-c5eb-40fa-8afd-932d1d8b1625', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] delete snapshot v_9004e518-c5eb-40fa-8afd-932d1d8b1625 of volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:45:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_9004e518-c5eb-40fa-8afd-932d1d8b1625 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] snapshot v_9004e518-c5eb-40fa-8afd-932d1d8b1625 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:45:14 user cinder-volume[73792]: DEBUG cinder.quota [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['4a35c968-4f52-45f3-87e4-2dd74b7c5df9', '49ab5b34-4fb8-49b1-92ca-82ce3b9050c3', 'd045ee7e-4baf-4f25-b0de-6d6a36dd2812', '0e9c9e98-cb2e-4278-bcc6-44fbef161124'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:45:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:45:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:45:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763796480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:45:15 user cinder-volume[73792]: DEBUG cinder.manager [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:45:15 user cinder-volume[73792]: INFO cinder.volume.manager [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Deleted volume successfully.
Apr 12 06:45:15 user cinder-volume[73792]: DEBUG cinder.coordination [None req-ef7dba94-6156-4a9b-9335-e14655e9a675 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-9004e518-c5eb-40fa-8afd-932d1d8b1625-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:45:15 user cinder-volume[73792]: INFO cinder.action_track [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Snapshot-272059125',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=5befa471-e63d-405f-ab2f-70659a593c13,metadata={snap-meta1='value1',snap-meta2='value2',snap-meta3='value3'},progress='0%',project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume=<?>,volume_id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:45:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot 5befa471-e63d-405f-ab2f-70659a593c13 for volume 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:45:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] cloning v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 to s_5befa471-e63d-405f-ab2f-70659a593c13 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:45:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot s_5befa471-e63d-405f-ab2f-70659a593c13 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:45:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_5befa471-e63d-405f-ab2f-70659a593c13'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] create volume s_5befa471-e63d-405f-ab2f-70659a593c13 from snapshot s_5befa471-e63d-405f-ab2f-70659a593c13 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:45:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0@s_5befa471-e63d-405f-ab2f-70659a593c13', 'is_clone': True, 'full_name': 'Pool-0/s_5befa471-e63d-405f-ab2f-70659a593c13', 'name': 's_5befa471-e63d-405f-ab2f-70659a593c13'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5befa471-e63d-405f-ab2f-70659a593c13/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5befa471-e63d-405f-ab2f-70659a593c13/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5befa471-e63d-405f-ab2f-70659a593c13/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] volume s_5befa471-e63d-405f-ab2f-70659a593c13 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:45:16 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b39ad847-3992-4693-98ec-a9a7693055c9 tempest-VolumesSnapshotTestJSON-2015355536 None] Create snapshot completed successfully
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-5befa471-e63d-405f-ab2f-70659a593c13-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-5befa471-e63d-405f-ab2f-70659a593c13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] deleating snapshot s_5befa471-e63d-405f-ab2f-70659a593c13. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume s_5befa471-e63d-405f-ab2f-70659a593c13  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5befa471-e63d-405f-ab2f-70659a593c13/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5befa471-e63d-405f-ab2f-70659a593c13/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5befa471-e63d-405f-ab2f-70659a593c13/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] get volume s_5befa471-e63d-405f-ab2f-70659a593c13 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5befa471-e63d-405f-ab2f-70659a593c13 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5befa471-e63d-405f-ab2f-70659a593c13 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0@s_5befa471-e63d-405f-ab2f-70659a593c13', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_5befa471-e63d-405f-ab2f-70659a593c13', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283333', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60845', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16943898066826886709', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2d398e4c10b66d33', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763759616', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39197', 'name': 's_5befa471-e63d-405f-ab2f-70659a593c13', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5befa471-e63d-405f-ab2f-70659a593c13 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] delete snapshot s_5befa471-e63d-405f-ab2f-70659a593c13 of volume v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots/s_5befa471-e63d-405f-ab2f-70659a593c13 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots/s_5befa471-e63d-405f-ab2f-70659a593c13 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots/s_5befa471-e63d-405f-ab2f-70659a593c13 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] snapshot s_5befa471-e63d-405f-ab2f-70659a593c13 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:45:18 user cinder-volume[73792]: DEBUG cinder.quota [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['55e78e99-cabf-429f-8aa3-8e187bcd5cf8', 'd9ae9951-f379-400a-b0eb-a24aa8895bc2', '2ce20805-26e8-416d-bd45-58df0d03bc55', 'caefbda6-8beb-4ab3-ae47-c4cf155cae76'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:45:18 user cinder-volume[73792]: INFO cinder.volume.manager [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Delete snapshot completed successfully.
Apr 12 06:45:18 user cinder-volume[73792]: DEBUG cinder.coordination [None req-93e39158-ed95-4f48-a4ea-baee78d89bef tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-5befa471-e63d-405f-ab2f-70659a593c13-delete_snapshot" released by "delete_snapshot" :: held 1.136s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Acquiring lock "cinder-19ab1977-9c7a-4434-8e2c-2b9b0899eeb0-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Lock "cinder-19ab1977-9c7a-4434-8e2c-2b9b0899eeb0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] remove_export for volume: 19ab1977-9c7a-4434-8e2c-2b9b0899eeb0. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1031104917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=19ab1977-9c7a-4434-8e2c-2b9b0899eeb0,launched_at=2023-04-12T06:43:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP yQlRDGcx yiXIfSxvLowd1T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:43:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:45:19Z,updated_at=2023-04-12T06:45:19Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] detach volume v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 from target iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/luns/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/luns/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/luns/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/luns/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] failed to remove resource iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 because of JDSS resource v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] delete target: iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] delete target iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] failed to remove resource iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 because of JDSS resource iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] deleating volume v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] get snapshots for volume v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] get volume v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:19 user cinder-volume[73792]: INFO cinder.action_track [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Snapshot-926662492',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=630c24df-ec85-47d4-be6c-bf0c28ddc742,metadata={},progress='0%',project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume=<?>,volume_id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot 630c24df-ec85-47d4-be6c-bf0c28ddc742 for volume 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] cloning v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 to s_630c24df-ec85-47d4-be6c-bf0c28ddc742 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot s_630c24df-ec85-47d4-be6c-bf0c28ddc742 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283227', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60775', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11656623924284803418', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fcaf0aad20c3172b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763747328', 'san:volume_id': 'fcaf0aad20c3172b4f3880dc9f0ace4e1543df45', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38679', 'name': 'v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] delete volume:v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_630c24df-ec85-47d4-be6c-bf0c28ddc742'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] create volume s_630c24df-ec85-47d4-be6c-bf0c28ddc742 from snapshot s_630c24df-ec85-47d4-be6c-bf0c28ddc742 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0@s_630c24df-ec85-47d4-be6c-bf0c28ddc742', 'is_clone': True, 'full_name': 'Pool-0/s_630c24df-ec85-47d4-be6c-bf0c28ddc742', 'name': 's_630c24df-ec85-47d4-be6c-bf0c28ddc742'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_630c24df-ec85-47d4-be6c-bf0c28ddc742/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_630c24df-ec85-47d4-be6c-bf0c28ddc742/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_630c24df-ec85-47d4-be6c-bf0c28ddc742/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] volume s_630c24df-ec85-47d4-be6c-bf0c28ddc742 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:45:20 user cinder-volume[73792]: INFO cinder.volume.manager [None req-115eaa38-5926-4bd0-96d2-66dd4853684c tempest-VolumesSnapshotTestJSON-2015355536 None] Create snapshot completed successfully
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] volume v_19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.quota [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Created reservations ['d173d107-a2c9-44ae-a25c-fd07592b2004', '95034a1c-6886-43ae-b5db-06233c6e0632', '874a2319-b374-44e4-99b1-4f0ffe593500', 'ab207d96-3054-4042-b727-7035b13a1fc2'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763816960', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.manager [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:45:21 user cinder-volume[73792]: INFO cinder.volume.manager [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Deleted volume successfully.
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cb18d83b-cda3-4c24-bb7f-fb1884f02ebc tempest-AttachVolumeNegativeTest-1905486920 None] Lock "cinder-19ab1977-9c7a-4434-8e2c-2b9b0899eeb0-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Acquiring lock "cinder-a7204ed1-e658-42f0-b1fd-590e8b56f1f5-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Lock "cinder-a7204ed1-e658-42f0-b1fd-590e8b56f1f5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=47,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=49,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] remove_export for volume: a7204ed1-e658-42f0-b1fd-590e8b56f1f5. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-606824657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a7204ed1-e658-42f0-b1fd-590e8b56f1f5,launched_at=2023-04-12T06:39:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP YmGatSdx 5VGjA2EiRDOrB9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:39:44Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:45:22Z,updated_at=2023-04-12T06:45:22Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] detach volume v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 from target iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/luns/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/luns/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/luns/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5/luns/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] failed to remove resource iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 because of JDSS resource v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] delete target: iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] delete target iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] failed to remove resource iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 because of JDSS resource iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] deleating volume v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] get snapshots for volume v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] get volume v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:45:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283001', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60692', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10723245843691420507', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '856d943fbb33c971', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763816960', 'san:volume_id': '856d943fbb33c971a068f5a0cbb50fede85c6840', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37562', 'name': 'v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] delete volume:v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:45:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] volume v_a7204ed1-e658-42f0-b1fd-590e8b56f1f5 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:45:23 user cinder-volume[73792]: DEBUG cinder.quota [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Created reservations ['87d1a430-0c20-4d00-a31f-3cd790df1864', '3b740f45-0d0f-4933-bc6b-f06f06c93256', 'feed1314-8cf6-42b0-b6a1-d8608779a8e3', 'b1dabe86-cc66-4cce-8aca-acb96d517fdd'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:45:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:45:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:45:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763911168', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.manager [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:45:24 user cinder-volume[73792]: INFO cinder.volume.manager [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Deleted volume successfully.
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cc16daf9-5044-49c4-b182-c87cf352dec0 tempest-AttachVolumeNegativeTest-1905486920 None] Lock "cinder-a7204ed1-e658-42f0-b1fd-590e8b56f1f5-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Acquiring lock "cinder-7604ff57-70fb-4c5c-abde-c58dab75bf44-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Lock "cinder-7604ff57-70fb-4c5c-abde-c58dab75bf44-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] remove_export for volume: 7604ff57-70fb-4c5c-abde-c58dab75bf44. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1072844948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7604ff57-70fb-4c5c-abde-c58dab75bf44,launched_at=2023-04-12T06:33:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b267dce1303d451ca307eeaa38baf685',provider_auth='CHAP SwscbTLM t1j6XwDNM5QUGc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:33:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:45:24Z,updated_at=2023-04-12T06:45:24Z,use_quota=True,user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] detach volume v_7604ff57-70fb-4c5c-abde-c58dab75bf44 from target iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/luns/v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/luns/v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/luns/v_7604ff57-70fb-4c5c-abde-c58dab75bf44'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44/luns/v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] failed to remove resource iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 because of JDSS resource v_7604ff57-70fb-4c5c-abde-c58dab75bf44 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] delete target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] delete target iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] failed to remove resource iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 because of JDSS resource iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] deleating volume v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] get snapshots for volume v_7604ff57-70fb-4c5c-abde-c58dab75bf44  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7604ff57-70fb-4c5c-abde-c58dab75bf44/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7604ff57-70fb-4c5c-abde-c58dab75bf44/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7604ff57-70fb-4c5c-abde-c58dab75bf44/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] get volume v_7604ff57-70fb-4c5c-abde-c58dab75bf44 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7604ff57-70fb-4c5c-abde-c58dab75bf44', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282611', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60484', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8198250569797070600', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4bb3f48d1291569e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763911168', 'san:volume_id': '4bb3f48d1291569e7fe1edc52c3824e610860c06', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37875', 'name': 'v_7604ff57-70fb-4c5c-abde-c58dab75bf44', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] delete volume:v_7604ff57-70fb-4c5c-abde-c58dab75bf44 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7604ff57-70fb-4c5c-abde-c58dab75bf44 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] volume v_7604ff57-70fb-4c5c-abde-c58dab75bf44 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:45:25 user cinder-volume[73792]: DEBUG cinder.quota [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Created reservations ['d99a6c86-4056-42ca-81c9-8bc028a148d8', 'b9307309-fb4a-4fc9-bbce-b369527931d4', '9adc3897-b45a-469f-ab08-59b10a9538ed', '5fed895c-f1c9-453c-ae89-864cb8d17bc3'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:45:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:45:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:45:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764005376', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:45:26 user cinder-volume[73792]: DEBUG cinder.manager [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:45:26 user cinder-volume[73792]: INFO cinder.volume.manager [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Deleted volume successfully.
Apr 12 06:45:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-251e736b-bb5a-4be3-976f-894d366b26ad tempest-AttachVolumeNegativeTest-1905486920 None] Lock "cinder-7604ff57-70fb-4c5c-abde-c58dab75bf44-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:45:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:45:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:45:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:45:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114763993088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:45:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:45:31 user cinder-volume[73792]: INFO cinder.action_track [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-870682519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=904a26e6-6130-4b34-a398-ae7999b06825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6629b520a584784bbb32cf314421c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='ced2c9f52fa34c9c84ff0f6b292b5720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Flow 'volume_create_manager' (4a626347-64eb-4971-b318-a53a30635251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73697092-e00e-4662-9ad7-b74b4dcf343b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73697092-e00e-4662-9ad7-b74b4dcf343b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-870682519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=904a26e6-6130-4b34-a398-ae7999b06825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6629b520a584784bbb32cf314421c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:45:31Z,use_quota=True,user_id='ced2c9f52fa34c9c84ff0f6b292b5720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab3d30f-0962-48c6-be80-083ae43c67f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab3d30f-0962-48c6-be80-083ae43c67f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23788adb-9d0c-4d8d-b5cc-bf8e972c73c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23788adb-9d0c-4d8d-b5cc-bf8e972c73c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '904a26e6-6130-4b34-a398-ae7999b06825', 'volume_name': 'volume-904a26e6-6130-4b34-a398-ae7999b06825', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f5c0e7-3bce-4b04-920d-5fec318e6755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f5c0e7-3bce-4b04-920d-5fec318e6755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca80e139-f5bb-4942-a679-569831d654f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:31 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Volume 904a26e6-6130-4b34-a398-ae7999b06825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-904a26e6-6130-4b34-a398-ae7999b06825', 'volume_size': 1}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] creating volume v_904a26e6-6130-4b34-a398-ae7999b06825. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] create volume {'name': 'v_904a26e6-6130-4b34-a398-ae7999b06825', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_904a26e6-6130-4b34-a398-ae7999b06825', 'is_clone': False, 'name': 'v_904a26e6-6130-4b34-a398-ae7999b06825'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca80e139-f5bb-4942-a679-569831d654f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-904a26e6-6130-4b34-a398-ae7999b06825', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe826b3a-116c-46f8-99dc-e355c70b7ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:31 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Volume volume-904a26e6-6130-4b34-a398-ae7999b06825 (904a26e6-6130-4b34-a398-ae7999b06825): created successfully
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe826b3a-116c-46f8-99dc-e355c70b7ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] Flow 'volume_create_manager' (4a626347-64eb-4971-b318-a53a30635251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:45:31 user cinder-volume[73792]: INFO cinder.action_track [req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 req-5f880c6c-0e6c-4ce7-922e-990abbe7f825 tempest-VolumesSnapshotsTestJSON-1148876356 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-870682519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=904a26e6-6130-4b34-a398-ae7999b06825,launched_at=2023-04-12T06:45:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6629b520a584784bbb32cf314421c23',provider_auth='CHAP nrsYBACJ ZGC7uIBmN462l8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:45:31Z,use_quota=True,user_id='ced2c9f52fa34c9c84ff0f6b292b5720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:45:32 user cinder-volume[73792]: INFO cinder.action_track [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-Snapshot-1204814181',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=a2bd7753-d7fd-4413-89c8-774b76bd0b73,metadata={},progress='0%',project_id='e6629b520a584784bbb32cf314421c23',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='ced2c9f52fa34c9c84ff0f6b292b5720',volume=<?>,volume_id=904a26e6-6130-4b34-a398-ae7999b06825,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:45:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] create snapshot a2bd7753-d7fd-4413-89c8-774b76bd0b73 for volume 904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:45:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] cloning v_904a26e6-6130-4b34-a398-ae7999b06825 to s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:45:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] create snapshot s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:45:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_a2bd7753-d7fd-4413-89c8-774b76bd0b73'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] create volume s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 from snapshot s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:45:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_904a26e6-6130-4b34-a398-ae7999b06825@s_a2bd7753-d7fd-4413-89c8-774b76bd0b73', 'is_clone': True, 'full_name': 'Pool-0/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73', 'name': 's_a2bd7753-d7fd-4413-89c8-774b76bd0b73'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] volume s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:45:33 user cinder-volume[73792]: INFO cinder.volume.manager [req-d1460d84-2ff2-4996-af6e-c2f9941abb0f req-481f6bd6-0971-4fbb-b717-49b1966914e6 tempest-VolumesSnapshotsTestJSON-1148876356 None] Create snapshot completed successfully
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.coordination [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Acquiring lock "cinder-a2bd7753-d7fd-4413-89c8-774b76bd0b73-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.coordination [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Lock "cinder-a2bd7753-d7fd-4413-89c8-774b76bd0b73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] deleating snapshot s_a2bd7753-d7fd-4413-89c8-774b76bd0b73. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] get snapshots for volume s_a2bd7753-d7fd-4413-89c8-774b76bd0b73  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] get volume s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_904a26e6-6130-4b34-a398-ae7999b06825@s_a2bd7753-d7fd-4413-89c8-774b76bd0b73', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283350', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60869', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9973993628416790359', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '44dfac2f2072ef5a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763898880', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39208', 'name': 's_a2bd7753-d7fd-4413-89c8-774b76bd0b73', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] delete snapshot s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 of volume v_904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825/snapshots/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825/snapshots/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825/snapshots/s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] snapshot s_a2bd7753-d7fd-4413-89c8-774b76bd0b73 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:45:34 user cinder-volume[73792]: DEBUG cinder.quota [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Created reservations ['d1f90d4e-f1f9-4f5c-bc57-aa01e4e6fb51', 'c73831c4-3f19-4a81-aedf-3c9e4b57573e', 'cfd84246-6de0-4276-b187-a7bfd805338f', 'd7b82a2d-b850-46f7-83c2-b2fe95aa9031'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:45:34 user cinder-volume[73792]: INFO cinder.volume.manager [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Delete snapshot completed successfully.
Apr 12 06:45:34 user cinder-volume[73792]: DEBUG cinder.coordination [req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb req-29fbcd21-8dce-420e-8cf3-ce3b8ae48204 tempest-VolumesSnapshotsTestJSON-1148876356 None] Lock "cinder-a2bd7753-d7fd-4413-89c8-774b76bd0b73-delete_snapshot" released by "delete_snapshot" :: held 1.174s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.coordination [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Acquiring lock "cinder-904a26e6-6130-4b34-a398-ae7999b06825-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.coordination [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Lock "cinder-904a26e6-6130-4b34-a398-ae7999b06825-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] remove_export for volume: 904a26e6-6130-4b34-a398-ae7999b06825. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-870682519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=904a26e6-6130-4b34-a398-ae7999b06825,launched_at=2023-04-12T06:45:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6629b520a584784bbb32cf314421c23',provider_auth='CHAP nrsYBACJ ZGC7uIBmN462l8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:45:36Z,updated_at=2023-04-12T06:45:36Z,use_quota=True,user_id='ced2c9f52fa34c9c84ff0f6b292b5720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] detach volume v_904a26e6-6130-4b34-a398-ae7999b06825 from target iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825/luns/v_904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825/luns/v_904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825/luns/v_904a26e6-6130-4b34-a398-ae7999b06825'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825/luns/v_904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] failed to remove resource iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 because of JDSS resource v_904a26e6-6130-4b34-a398-ae7999b06825 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] delete target: iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] delete target iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] failed to remove resource iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 because of JDSS resource iqn.2010-10.org.openstack:904a26e6-6130-4b34-a398-ae7999b06825 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] deleating volume v_904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] get snapshots for volume v_904a26e6-6130-4b34-a398-ae7999b06825  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] get volume v_904a26e6-6130-4b34-a398-ae7999b06825 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:45:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_904a26e6-6130-4b34-a398-ae7999b06825', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283348', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60863', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16352306758812158036', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7f3f1fa8d50ddae3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763911168', 'san:volume_id': '7f3f1fa8d50ddae3a93a45c0c840ee7d2efa8fd8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37968', 'name': 'v_904a26e6-6130-4b34-a398-ae7999b06825', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] delete volume:v_904a26e6-6130-4b34-a398-ae7999b06825 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:45:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_904a26e6-6130-4b34-a398-ae7999b06825 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] volume v_904a26e6-6130-4b34-a398-ae7999b06825 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:45:37 user cinder-volume[73792]: DEBUG cinder.quota [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Created reservations ['bc7288b2-2a51-49ec-a915-3ce402fe17a6', 'cf71ab5b-a637-4d79-b82b-3a6b2e60c90e', '5bd164e4-1031-4746-b483-e69391e7a589', '97ae0707-f9de-4ea7-b6cf-e8ef3fe7818e'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:45:37 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=55,cinder:UPDATE=37,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:45:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:45:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:45:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763993088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:45:37 user cinder-volume[73792]: DEBUG cinder.manager [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:45:37 user cinder-volume[73792]: INFO cinder.volume.manager [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Deleted volume successfully.
Apr 12 06:45:37 user cinder-volume[73792]: DEBUG cinder.coordination [req-7039e5c5-f80f-477d-ad2b-beff88330cbd req-fd834ad7-7fb4-4edb-ac2d-9d63d912e0b9 tempest-VolumesSnapshotsTestJSON-1148876356 None] Lock "cinder-904a26e6-6130-4b34-a398-ae7999b06825-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:45:40 user cinder-volume[73792]: INFO cinder.action_track [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-852433196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=02e84623-2f01-4559-bc01-d9055ae08d5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c8e84dc2c0947e2a9f89b466ba70252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='c8b97595d92645c8a4f417da05a48a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Flow 'volume_create_manager' (2209ae8f-186b-4ce4-8c59-968a3d42c576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bca35d0-6e3c-40c1-bee2-bddceee85a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bca35d0-6e3c-40c1-bee2-bddceee85a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-852433196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=02e84623-2f01-4559-bc01-d9055ae08d5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c8e84dc2c0947e2a9f89b466ba70252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:45:40Z,use_quota=True,user_id='c8b97595d92645c8a4f417da05a48a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5305215-db75-40e8-8ed2-17f809da7f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5305215-db75-40e8-8ed2-17f809da7f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1e91ec-f16d-4e14-9690-2a8d85398fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1e91ec-f16d-4e14-9690-2a8d85398fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e84623-2f01-4559-bc01-d9055ae08d5c', 'volume_name': 'volume-02e84623-2f01-4559-bc01-d9055ae08d5c', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd99fbb0-f079-440e-b197-4fd6e14d9a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd99fbb0-f079-440e-b197-4fd6e14d9a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fcbcfd-6d19-4c3b-8c6f-e902e7978330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Volume 02e84623-2f01-4559-bc01-d9055ae08d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e84623-2f01-4559-bc01-d9055ae08d5c', 'volume_size': 1}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] creating volume v_02e84623-2f01-4559-bc01-d9055ae08d5c. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] create volume {'name': 'v_02e84623-2f01-4559-bc01-d9055ae08d5c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_02e84623-2f01-4559-bc01-d9055ae08d5c', 'is_clone': False, 'name': 'v_02e84623-2f01-4559-bc01-d9055ae08d5c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fcbcfd-6d19-4c3b-8c6f-e902e7978330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e84623-2f01-4559-bc01-d9055ae08d5c', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab09cbe-f849-4600-8c50-2d42f88c183c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Volume volume-02e84623-2f01-4559-bc01-d9055ae08d5c (02e84623-2f01-4559-bc01-d9055ae08d5c): created successfully
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab09cbe-f849-4600-8c50-2d42f88c183c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] Flow 'volume_create_manager' (2209ae8f-186b-4ce4-8c59-968a3d42c576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:45:40 user cinder-volume[73792]: INFO cinder.action_track [req-3d5676df-98bc-43ac-bb23-ed651918cba7 req-01932549-4f34-4ec1-a74e-c6cb8084b5ec tempest-VolumesGetTestJSON-921747519 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-852433196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=02e84623-2f01-4559-bc01-d9055ae08d5c,launched_at=2023-04-12T06:45:40Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c8e84dc2c0947e2a9f89b466ba70252',provider_auth='CHAP jSnyrGNJ RaWnrT29N7sb3o',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:45:40Z,use_quota=True,user_id='c8b97595d92645c8a4f417da05a48a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:45:40 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=57,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.coordination [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Acquiring lock "cinder-02e84623-2f01-4559-bc01-d9055ae08d5c-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.coordination [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Lock "cinder-02e84623-2f01-4559-bc01-d9055ae08d5c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] remove_export for volume: 02e84623-2f01-4559-bc01-d9055ae08d5c. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-852433196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=02e84623-2f01-4559-bc01-d9055ae08d5c,launched_at=2023-04-12T06:45:41Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c8e84dc2c0947e2a9f89b466ba70252',provider_auth='CHAP jSnyrGNJ RaWnrT29N7sb3o',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:45:41Z,updated_at=2023-04-12T06:45:41Z,use_quota=True,user_id='c8b97595d92645c8a4f417da05a48a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] detach volume v_02e84623-2f01-4559-bc01-d9055ae08d5c from target iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c/luns/v_02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c/luns/v_02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c/luns/v_02e84623-2f01-4559-bc01-d9055ae08d5c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c/luns/v_02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] failed to remove resource iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c because of JDSS resource v_02e84623-2f01-4559-bc01-d9055ae08d5c DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] delete target: iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] delete target iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] failed to remove resource iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c because of JDSS resource iqn.2010-10.org.openstack:02e84623-2f01-4559-bc01-d9055ae08d5c DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] deleating volume v_02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] get snapshots for volume v_02e84623-2f01-4559-bc01-d9055ae08d5c  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_02e84623-2f01-4559-bc01-d9055ae08d5c/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_02e84623-2f01-4559-bc01-d9055ae08d5c/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_02e84623-2f01-4559-bc01-d9055ae08d5c/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] get volume v_02e84623-2f01-4559-bc01-d9055ae08d5c info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_02e84623-2f01-4559-bc01-d9055ae08d5c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283357', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60878', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7593472215609230446', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c315c65faa4491c6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763923456', 'san:volume_id': 'c315c65faa4491c60ed09ba06973ea9cbcc02bcd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38712', 'name': 'v_02e84623-2f01-4559-bc01-d9055ae08d5c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] delete volume:v_02e84623-2f01-4559-bc01-d9055ae08d5c recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_02e84623-2f01-4559-bc01-d9055ae08d5c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] volume v_02e84623-2f01-4559-bc01-d9055ae08d5c deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:45:42 user cinder-volume[73792]: DEBUG cinder.quota [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Created reservations ['a0f80caa-50a3-4596-acd9-479b888d452f', '73081c50-968a-482f-9ac7-820e05442150', 'a4573c74-ace5-478e-9d19-32b954c41d98', '5b449c3e-fd3a-498b-892a-ece37fefe2c2'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:45:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:45:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:45:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764017664', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:45:43 user cinder-volume[73792]: DEBUG cinder.manager [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:45:43 user cinder-volume[73792]: INFO cinder.volume.manager [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Deleted volume successfully.
Apr 12 06:45:43 user cinder-volume[73792]: DEBUG cinder.coordination [req-5b46cde7-390f-4ad4-bfb5-74706aa7576f req-2396afa6-de17-4375-8af2-3d9df39ebe72 tempest-VolumesGetTestJSON-921747519 None] Lock "cinder-02e84623-2f01-4559-bc01-d9055ae08d5c-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:45:46 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0d4ff1ee-6372-4b4c-9cba-8e719ff01447 tempest-GroupsV314Test-530576273 None] Group tempest-GroupsV314Test-Group-1402631909: creating
Apr 12 06:45:46 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0d4ff1ee-6372-4b4c-9cba-8e719ff01447 tempest-GroupsV314Test-530576273 None] Group tempest-GroupsV314Test-Group-1402631909: created successfully
Apr 12 06:45:46 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0d4ff1ee-6372-4b4c-9cba-8e719ff01447 tempest-GroupsV314Test-530576273 None] Create group completed successfully.
Apr 12 06:45:47 user cinder-volume[73792]: INFO cinder.action_track [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-985129226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=994c2668-0a4f-4058-aa00-946f804e423e,host='user@joviandss-2#joviandss-2',id=62d67b35-8aad-4a86-9573-bd479316a93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29b33cad0d34bcd84df4f67748abe60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='aefec3c23a094c11b689d4920df3fa92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85044c04-610c-4189-921c-293ac0514024),volume_type_id=85044c04-610c-4189-921c-293ac0514024) 
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Flow 'volume_create_manager' (a67e7500-db4f-477f-a663-0d9871aeb691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26492788-b90a-4195-9488-9ba1da67f302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26492788-b90a-4195-9488-9ba1da67f302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-985129226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=994c2668-0a4f-4058-aa00-946f804e423e,host='user@joviandss-2#joviandss-2',id=62d67b35-8aad-4a86-9573-bd479316a93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29b33cad0d34bcd84df4f67748abe60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:45:47Z,use_quota=True,user_id='aefec3c23a094c11b689d4920df3fa92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85044c04-610c-4189-921c-293ac0514024),volume_type_id=85044c04-610c-4189-921c-293ac0514024)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc025b3f-66ab-4885-8757-b6f14c6f7225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc025b3f-66ab-4885-8757-b6f14c6f7225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd4c5bf-7e92-4c45-b7a6-b4b01e9f6e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd4c5bf-7e92-4c45-b7a6-b4b01e9f6e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62d67b35-8aad-4a86-9573-bd479316a93d', 'volume_name': 'volume-62d67b35-8aad-4a86-9573-bd479316a93d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78bfc40-bd31-4087-8b4b-fa2bee10b2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78bfc40-bd31-4087-8b4b-fa2bee10b2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5becc220-9d72-4a79-9710-9e4ea2f1d098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:47 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Volume 62d67b35-8aad-4a86-9573-bd479316a93d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62d67b35-8aad-4a86-9573-bd479316a93d', 'volume_size': 1}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] creating volume v_62d67b35-8aad-4a86-9573-bd479316a93d. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] create volume {'name': 'v_62d67b35-8aad-4a86-9573-bd479316a93d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_62d67b35-8aad-4a86-9573-bd479316a93d', 'is_clone': False, 'name': 'v_62d67b35-8aad-4a86-9573-bd479316a93d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:48 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5becc220-9d72-4a79-9710-9e4ea2f1d098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d67b35-8aad-4a86-9573-bd479316a93d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:48 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37790ade-64a8-4c95-b3b7-6aa28d698232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:48 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Volume volume-62d67b35-8aad-4a86-9573-bd479316a93d (62d67b35-8aad-4a86-9573-bd479316a93d): created successfully
Apr 12 06:45:48 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37790ade-64a8-4c95-b3b7-6aa28d698232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:48 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] Flow 'volume_create_manager' (a67e7500-db4f-477f-a663-0d9871aeb691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:45:48 user cinder-volume[73792]: INFO cinder.action_track [None req-e8b0b920-d3f4-4217-b82a-f103a1a236a4 tempest-GroupsV314Test-530576273 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-985129226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=994c2668-0a4f-4058-aa00-946f804e423e,host='user@joviandss-2#joviandss-2',id=62d67b35-8aad-4a86-9573-bd479316a93d,launched_at=2023-04-12T06:45:48Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29b33cad0d34bcd84df4f67748abe60',provider_auth='CHAP jwgPykXT KjrOxhE6e2FIpM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:47Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:45:47Z,use_quota=True,user_id='aefec3c23a094c11b689d4920df3fa92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85044c04-610c-4189-921c-293ac0514024),volume_type_id=85044c04-610c-4189-921c-293ac0514024) 
Apr 12 06:45:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] cloned volume 62d67b35-8aad-4a86-9573-bd479316a93d to ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:45:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] cloning v_62d67b35-8aad-4a86-9573-bd479316a93d to v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:45:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] create snapshot v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:45:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] create volume v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 from snapshot v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:45:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_62d67b35-8aad-4a86-9573-bd479316a93d@v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17', 'is_clone': True, 'full_name': 'Pool-0/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17', 'name': 'v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] get volume v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:45:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_62d67b35-8aad-4a86-9573-bd479316a93d@v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283366', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60890', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16000534347739114763', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '10df72bb885bfc77', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763886592', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38205', 'name': 'v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:50 user cinder-volume[73792]: INFO cinder.volume.manager [None req-f2ab5e13-8179-4873-b2dc-ab469c14fd20 tempest-GroupsV314Test-530576273 None] Create group from source-group-994c2668-0a4f-4058-aa00-946f804e423e completed successfully.
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] remove_export for volume: ca43ecdb-0d0d-4116-a1ab-1fad0909da17. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a2ad25e5-3771-430e-ae34-24119ca96980,host='user@joviandss-2#joviandss-2',id=ca43ecdb-0d0d-4116-a1ab-1fad0909da17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29b33cad0d34bcd84df4f67748abe60',provider_auth='CHAP JmfkNwpH EyFu7o0XGUJtVp',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=62d67b35-8aad-4a86-9573-bd479316a93d,status='deleting',terminated_at=None,updated_at=2023-04-12T06:45:50Z,use_quota=True,user_id='aefec3c23a094c11b689d4920df3fa92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85044c04-610c-4189-921c-293ac0514024),volume_type_id=85044c04-610c-4189-921c-293ac0514024) from target:iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] detach volume v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 from target iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17/luns/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17/luns/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17/luns/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17/luns/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] failed to remove resource iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17 because of JDSS resource v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] delete target: iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] delete target iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] failed to remove resource iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17 because of JDSS resource iqn.2010-10.org.openstack:ca43ecdb-0d0d-4116-a1ab-1fad0909da17 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] deleating volume v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] get snapshots for volume v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] get volume v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_62d67b35-8aad-4a86-9573-bd479316a93d@v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283366', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60890', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16000534347739114763', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '10df72bb885bfc77', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763874304', 'san:volume_id': '10df72bb885bfc7721ac4f20e38522ce8429303a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38205', 'name': 'v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] delete snapshot v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 of volume v_62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d/snapshots/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d/snapshots/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d/snapshots/v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] snapshot v_ca43ecdb-0d0d-4116-a1ab-1fad0909da17 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:45:51 user cinder-volume[73792]: DEBUG cinder.quota [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Created reservations ['5cb39546-1c7a-4e65-bf88-5bbdd74ba789'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:45:51 user cinder-volume[73792]: WARNING cinder.quota [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2098725895 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2098725895, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:45:51 user cinder-volume[73792]: WARNING cinder.quota [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2098725895 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2098725895, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:45:51 user cinder-volume[73792]: DEBUG cinder.quota [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Created reservations ['edd87685-4003-4289-8573-a01501e3fd65', '58d4f567-0c81-4f52-89af-4885397dede3', '3b81b9db-cd75-452c-8520-d47d898c21e2', '872bf81d-3853-45da-8d60-850e18afe181'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:45:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:45:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:45:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763898880', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.manager [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:45:52 user cinder-volume[73792]: INFO cinder.volume.manager [None req-1671b62c-0716-4d35-afa8-a3c8ef7edf56 tempest-GroupsV314Test-530576273 None] Delete group completed successfully.
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] remove_export for volume: 62d67b35-8aad-4a86-9573-bd479316a93d. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-985129226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=994c2668-0a4f-4058-aa00-946f804e423e,host='user@joviandss-2#joviandss-2',id=62d67b35-8aad-4a86-9573-bd479316a93d,launched_at=2023-04-12T06:45:48Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29b33cad0d34bcd84df4f67748abe60',provider_auth='CHAP jwgPykXT KjrOxhE6e2FIpM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:47Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-12T06:45:53Z,use_quota=True,user_id='aefec3c23a094c11b689d4920df3fa92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85044c04-610c-4189-921c-293ac0514024),volume_type_id=85044c04-610c-4189-921c-293ac0514024) from target:iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] detach volume v_62d67b35-8aad-4a86-9573-bd479316a93d from target iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d/luns/v_62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d/luns/v_62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d/luns/v_62d67b35-8aad-4a86-9573-bd479316a93d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d/luns/v_62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] failed to remove resource iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d because of JDSS resource v_62d67b35-8aad-4a86-9573-bd479316a93d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] delete target: iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] delete target iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] failed to remove resource iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d because of JDSS resource iqn.2010-10.org.openstack:62d67b35-8aad-4a86-9573-bd479316a93d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] deleating volume v_62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] get snapshots for volume v_62d67b35-8aad-4a86-9573-bd479316a93d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] get volume v_62d67b35-8aad-4a86-9573-bd479316a93d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:45:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_62d67b35-8aad-4a86-9573-bd479316a93d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283365', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60884', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10375826544147475586', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'aeacc4b251792cf5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763898880', 'san:volume_id': 'aeacc4b251792cf56f2b574d0f25be256fca870c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39223', 'name': 'v_62d67b35-8aad-4a86-9573-bd479316a93d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] delete volume:v_62d67b35-8aad-4a86-9573-bd479316a93d recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:45:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62d67b35-8aad-4a86-9573-bd479316a93d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] volume v_62d67b35-8aad-4a86-9573-bd479316a93d deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=66,cinder:DELETE=1,cinder:UPDATE=28,cinder:INSERT=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG cinder.quota [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Created reservations ['0f77878f-9e7b-4418-bf7d-055012f36bea'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG cinder.quota [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Created reservations ['5f895788-0a25-443e-8bde-98511ecf866e', '01d7fb76-ee3f-4d72-a8f0-95888989451f', 'f411e306-e72d-47ed-a18e-abd61dff7270', '773dcfd6-e4a0-47e4-9b0a-2828c355abb6'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=63,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763980800', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:45:54 user cinder-volume[73792]: DEBUG cinder.manager [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:45:54 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7205fb04-ce55-4625-9f53-5742600e02cf tempest-GroupsV314Test-530576273 None] Delete group completed successfully.
Apr 12 06:45:58 user cinder-volume[73792]: INFO cinder.action_track [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1436801445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc35391d-c862-4d2a-9bd8-ad7d3e557cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b8874d4c6440b84ab50469e51d1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='4e9d80fc9c3e4fd39b62ac2bbbed5d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Flow 'volume_create_manager' (30a97a63-de9a-488d-8d93-a10994f479f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1dfb16-ec9f-4ccf-81f0-620e3c443fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1dfb16-ec9f-4ccf-81f0-620e3c443fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1436801445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc35391d-c862-4d2a-9bd8-ad7d3e557cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b8874d4c6440b84ab50469e51d1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:45:58Z,use_quota=True,user_id='4e9d80fc9c3e4fd39b62ac2bbbed5d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803f9863-561c-4374-ac5d-fe3861183927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803f9863-561c-4374-ac5d-fe3861183927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccba0150-7e62-48d8-b084-b7ef617a6ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccba0150-7e62-48d8-b084-b7ef617a6ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc35391d-c862-4d2a-9bd8-ad7d3e557cab', 'volume_name': 'volume-fc35391d-c862-4d2a-9bd8-ad7d3e557cab', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df264aa-bbaa-409f-8551-cc7bd87ebce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df264aa-bbaa-409f-8551-cc7bd87ebce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd13b35-4fb1-4ed5-b05c-eaca3808e698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:58 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Volume fc35391d-c862-4d2a-9bd8-ad7d3e557cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc35391d-c862-4d2a-9bd8-ad7d3e557cab', 'volume_size': 1}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] creating volume v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] create volume {'name': 'v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab', 'is_clone': False, 'name': 'v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd13b35-4fb1-4ed5-b05c-eaca3808e698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc35391d-c862-4d2a-9bd8-ad7d3e557cab', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf0c0e9-f948-4588-9fd9-4f0017640f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:59 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Volume volume-fc35391d-c862-4d2a-9bd8-ad7d3e557cab (fc35391d-c862-4d2a-9bd8-ad7d3e557cab): created successfully
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf0c0e9-f948-4588-9fd9-4f0017640f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] Flow 'volume_create_manager' (30a97a63-de9a-488d-8d93-a10994f479f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:45:59 user cinder-volume[73792]: INFO cinder.action_track [None req-5254e534-fe09-4ffa-81e9-e437d98e17c4 tempest-VolumesListAdminTestJSON-1884284561 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1436801445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc35391d-c862-4d2a-9bd8-ad7d3e557cab,launched_at=2023-04-12T06:45:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b8874d4c6440b84ab50469e51d1cd',provider_auth='CHAP FCfNoOZd Upl4mOsBdZ6iPK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:58Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:45:58Z,use_quota=True,user_id='4e9d80fc9c3e4fd39b62ac2bbbed5d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:45:59 user cinder-volume[73792]: INFO cinder.action_track [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-802469052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4841d2c9-adf6-4e6a-9a65-05bbbf8143a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b8874d4c6440b84ab50469e51d1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='4e9d80fc9c3e4fd39b62ac2bbbed5d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Flow 'volume_create_manager' (806316e1-320b-45e7-9dc5-4c4c0dbd8033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce95d73-99c9-41f9-9c96-04c2fb8d822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce95d73-99c9-41f9-9c96-04c2fb8d822a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-802469052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4841d2c9-adf6-4e6a-9a65-05bbbf8143a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b8874d4c6440b84ab50469e51d1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:00Z,use_quota=True,user_id='4e9d80fc9c3e4fd39b62ac2bbbed5d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da909045-f528-4816-8913-58685a7cd57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da909045-f528-4816-8913-58685a7cd57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d72891-e7ee-4ee1-bc8f-8ad8f77021c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d72891-e7ee-4ee1-bc8f-8ad8f77021c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4841d2c9-adf6-4e6a-9a65-05bbbf8143a1', 'volume_name': 'volume-4841d2c9-adf6-4e6a-9a65-05bbbf8143a1', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81b1525-9529-4f11-a12c-cc5ea44d9104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81b1525-9529-4f11-a12c-cc5ea44d9104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186c8d59-322b-4af8-9863-9d75a467c5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:45:59 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Volume 4841d2c9-adf6-4e6a-9a65-05bbbf8143a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4841d2c9-adf6-4e6a-9a65-05bbbf8143a1', 'volume_size': 1}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] creating volume v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] create volume {'name': 'v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:45:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1', 'is_clone': False, 'name': 'v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186c8d59-322b-4af8-9863-9d75a467c5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4841d2c9-adf6-4e6a-9a65-05bbbf8143a1', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94953dfa-895a-44d4-ba4c-29f47c16e8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:00 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Volume volume-4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 (4841d2c9-adf6-4e6a-9a65-05bbbf8143a1): created successfully
Apr 12 06:46:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94953dfa-895a-44d4-ba4c-29f47c16e8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] Flow 'volume_create_manager' (806316e1-320b-45e7-9dc5-4c4c0dbd8033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:00 user cinder-volume[73792]: INFO cinder.action_track [None req-ec75d935-1fba-4ffc-b262-104b9380f73a tempest-VolumesListAdminTestJSON-1884284561 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-802469052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4841d2c9-adf6-4e6a-9a65-05bbbf8143a1,launched_at=2023-04-12T06:46:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b8874d4c6440b84ab50469e51d1cd',provider_auth='CHAP kETRubhZ So6KQWthwGXONr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:46:00Z,use_quota=True,user_id='4e9d80fc9c3e4fd39b62ac2bbbed5d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:01 user cinder-volume[73792]: INFO cinder.action_track [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1739635788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9f9b2d48-2f46-4e07-ab46-bdf164f04142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b8874d4c6440b84ab50469e51d1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='4e9d80fc9c3e4fd39b62ac2bbbed5d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Flow 'volume_create_manager' (4bf78530-71c0-4aaf-aa36-1add7e32962f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d672ea1-9cd8-41ab-a76a-dbc6ae55fe43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d672ea1-9cd8-41ab-a76a-dbc6ae55fe43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1739635788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9f9b2d48-2f46-4e07-ab46-bdf164f04142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b8874d4c6440b84ab50469e51d1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:01Z,use_quota=True,user_id='4e9d80fc9c3e4fd39b62ac2bbbed5d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd90913-08cc-4cf5-b95b-3d4ff5863eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd90913-08cc-4cf5-b95b-3d4ff5863eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cf714a-3bbd-4c47-953c-7ca011b205c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cf714a-3bbd-4c47-953c-7ca011b205c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9b2d48-2f46-4e07-ab46-bdf164f04142', 'volume_name': 'volume-9f9b2d48-2f46-4e07-ab46-bdf164f04142', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10242a1-edd6-4361-bcd2-77d1298b963e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10242a1-edd6-4361-bcd2-77d1298b963e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0f2397-115c-4cce-9723-bc0b1cf4019c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:01 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Volume 9f9b2d48-2f46-4e07-ab46-bdf164f04142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9b2d48-2f46-4e07-ab46-bdf164f04142', 'volume_size': 1}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] creating volume v_9f9b2d48-2f46-4e07-ab46-bdf164f04142. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] create volume {'name': 'v_9f9b2d48-2f46-4e07-ab46-bdf164f04142', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142', 'is_clone': False, 'name': 'v_9f9b2d48-2f46-4e07-ab46-bdf164f04142'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0f2397-115c-4cce-9723-bc0b1cf4019c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9b2d48-2f46-4e07-ab46-bdf164f04142', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b0be7a-addd-452f-b4ad-92800b438fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:01 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Volume volume-9f9b2d48-2f46-4e07-ab46-bdf164f04142 (9f9b2d48-2f46-4e07-ab46-bdf164f04142): created successfully
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b0be7a-addd-452f-b4ad-92800b438fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:01 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] Flow 'volume_create_manager' (4bf78530-71c0-4aaf-aa36-1add7e32962f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:01 user cinder-volume[73792]: INFO cinder.action_track [None req-7674f373-a2ea-4e85-8790-ad7983c04603 tempest-VolumesListAdminTestJSON-1884284561 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1739635788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9f9b2d48-2f46-4e07-ab46-bdf164f04142,launched_at=2023-04-12T06:46:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b8874d4c6440b84ab50469e51d1cd',provider_auth='CHAP DYtjKSIA L43vTdG7mSjJsO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:01Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:46:01Z,use_quota=True,user_id='4e9d80fc9c3e4fd39b62ac2bbbed5d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:02 user cinder-volume[73792]: INFO cinder.action_track [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=197479f4-c335-4be3-aaba-84d9e74db537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca93ecfb30b94eafb1d2e8adf212193f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='7ee87c06ed994b9b98d4a42e7f4d26d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Flow 'volume_create_manager' (512e8dfe-0690-4065-936b-9ba8413b0e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f70470e-165d-4a72-8ca4-afe451e3d69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f70470e-165d-4a72-8ca4-afe451e3d69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=197479f4-c335-4be3-aaba-84d9e74db537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca93ecfb30b94eafb1d2e8adf212193f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:03Z,use_quota=True,user_id='7ee87c06ed994b9b98d4a42e7f4d26d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6129e704-1908-4a82-b339-511cb2fdaad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6129e704-1908-4a82-b339-511cb2fdaad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004b805c-8750-4342-a8ef-7b02a043d6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004b805c-8750-4342-a8ef-7b02a043d6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197479f4-c335-4be3-aaba-84d9e74db537', 'volume_name': 'volume-197479f4-c335-4be3-aaba-84d9e74db537', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44dbc876-ee7c-4b11-a552-9b1468c3ba5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44dbc876-ee7c-4b11-a552-9b1468c3ba5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb98dc2-5d23-4415-b20d-e5a6ee8721d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:02 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Volume 197479f4-c335-4be3-aaba-84d9e74db537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197479f4-c335-4be3-aaba-84d9e74db537', 'volume_size': 1}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] creating volume v_197479f4-c335-4be3-aaba-84d9e74db537. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] create volume {'name': 'v_197479f4-c335-4be3-aaba-84d9e74db537', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_197479f4-c335-4be3-aaba-84d9e74db537', 'is_clone': False, 'name': 'v_197479f4-c335-4be3-aaba-84d9e74db537'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb98dc2-5d23-4415-b20d-e5a6ee8721d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197479f4-c335-4be3-aaba-84d9e74db537', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a439c4-9abf-48f7-9aad-b4405c70471f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:03 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Volume volume-197479f4-c335-4be3-aaba-84d9e74db537 (197479f4-c335-4be3-aaba-84d9e74db537): created successfully
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a439c4-9abf-48f7-9aad-b4405c70471f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] Flow 'volume_create_manager' (512e8dfe-0690-4065-936b-9ba8413b0e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:03 user cinder-volume[73792]: INFO cinder.action_track [None req-969ef4c2-f15c-41ae-8ec9-f2a59bc89a82 tempest-VolumesListAdminTestJSON-1050619109 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=197479f4-c335-4be3-aaba-84d9e74db537,launched_at=2023-04-12T06:46:03Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca93ecfb30b94eafb1d2e8adf212193f',provider_auth='CHAP zGVXeAwm NfvYe3T6wyjno2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:46:03Z,use_quota=True,user_id='7ee87c06ed994b9b98d4a42e7f4d26d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Acquiring lock "cinder-197479f4-c335-4be3-aaba-84d9e74db537-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Lock "cinder-197479f4-c335-4be3-aaba-84d9e74db537-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] remove_export for volume: 197479f4-c335-4be3-aaba-84d9e74db537. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=197479f4-c335-4be3-aaba-84d9e74db537,launched_at=2023-04-12T06:46:03Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca93ecfb30b94eafb1d2e8adf212193f',provider_auth='CHAP zGVXeAwm NfvYe3T6wyjno2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:03Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:04Z,updated_at=2023-04-12T06:46:04Z,use_quota=True,user_id='7ee87c06ed994b9b98d4a42e7f4d26d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] detach volume v_197479f4-c335-4be3-aaba-84d9e74db537 from target iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537/luns/v_197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537/luns/v_197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537/luns/v_197479f4-c335-4be3-aaba-84d9e74db537'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537/luns/v_197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] failed to remove resource iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 because of JDSS resource v_197479f4-c335-4be3-aaba-84d9e74db537 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] delete target: iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] delete target iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] failed to remove resource iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 because of JDSS resource iqn.2010-10.org.openstack:197479f4-c335-4be3-aaba-84d9e74db537 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] deleating volume v_197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] get snapshots for volume v_197479f4-c335-4be3-aaba-84d9e74db537  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_197479f4-c335-4be3-aaba-84d9e74db537/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_197479f4-c335-4be3-aaba-84d9e74db537/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Acquiring lock "cinder-9f9b2d48-2f46-4e07-ab46-bdf164f04142-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Lock "cinder-9f9b2d48-2f46-4e07-ab46-bdf164f04142-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] remove_export for volume: 9f9b2d48-2f46-4e07-ab46-bdf164f04142. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1739635788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9f9b2d48-2f46-4e07-ab46-bdf164f04142,launched_at=2023-04-12T06:46:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b8874d4c6440b84ab50469e51d1cd',provider_auth='CHAP DYtjKSIA L43vTdG7mSjJsO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:01Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:04Z,updated_at=2023-04-12T06:46:04Z,use_quota=True,user_id='4e9d80fc9c3e4fd39b62ac2bbbed5d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] detach volume v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 from target iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142/luns/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142/luns/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142/luns/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142/luns/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] failed to remove resource iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 because of JDSS resource v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] delete target: iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] delete target iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] failed to remove resource iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 because of JDSS resource iqn.2010-10.org.openstack:9f9b2d48-2f46-4e07-ab46-bdf164f04142 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] deleating volume v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] get snapshots for volume v_9f9b2d48-2f46-4e07-ab46-bdf164f04142  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_197479f4-c335-4be3-aaba-84d9e74db537/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] get volume v_197479f4-c335-4be3-aaba-84d9e74db537 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_197479f4-c335-4be3-aaba-84d9e74db537', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283380', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60910', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6841370285079873741', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '458f6ed8704d249b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763653120', 'san:volume_id': '458f6ed8704d249b1de82fa8213841e286d0449f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39264', 'name': 'v_197479f4-c335-4be3-aaba-84d9e74db537', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] delete volume:v_197479f4-c335-4be3-aaba-84d9e74db537 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] get volume v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283378', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60906', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13551009357621422700', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '01f27c898c8fbf38', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763653120', 'san:volume_id': '01f27c898c8fbf38c419a68332bbc7a0c23c2d43', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39255', 'name': 'v_9f9b2d48-2f46-4e07-ab46-bdf164f04142', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] delete volume:v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_197479f4-c335-4be3-aaba-84d9e74db537 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] volume v_197479f4-c335-4be3-aaba-84d9e74db537 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.quota [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Created reservations ['5a13ed3a-e642-489c-8164-4f1d520458ef', 'be0a9cb7-494c-4d61-bab1-b22b5b97d0a4', '24750f0f-a192-4071-ac9e-ee00374c3177', '78863751-f6ed-4de1-84d4-51c9b414adb1'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] volume v_9f9b2d48-2f46-4e07-ab46-bdf164f04142 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.quota [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Created reservations ['d258f4bf-d0df-4047-a6b7-4e7bc559e13e', '6ec232b2-e5b9-46c4-9e14-0214b1e17942', '26255bef-ec52-4aec-9fd6-a522b2c3831f', '53289307-06e4-4885-ad48-06037f6c797b'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763980800', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.manager [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:05 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Deleted volume successfully.
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7f6e57cc-f0fb-4bbd-a33b-1d925e5a2425 tempest-VolumesListAdminTestJSON-1884284561 None] Lock "cinder-9f9b2d48-2f46-4e07-ab46-bdf164f04142-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763804672', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.manager [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:05 user cinder-volume[73792]: INFO cinder.volume.manager [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Deleted volume successfully.
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=54,cinder:INSERT=6,cinder:UPDATE=36,cinder:DELETE=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:46:05 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5e4b8495-5f64-40ad-8ac6-80dc8e8d7197 tempest-VolumesListAdminTestJSON-1050619109 None] Lock "cinder-197479f4-c335-4be3-aaba-84d9e74db537-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Acquiring lock "cinder-4841d2c9-adf6-4e6a-9a65-05bbbf8143a1-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Lock "cinder-4841d2c9-adf6-4e6a-9a65-05bbbf8143a1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] remove_export for volume: 4841d2c9-adf6-4e6a-9a65-05bbbf8143a1. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-802469052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=4841d2c9-adf6-4e6a-9a65-05bbbf8143a1,launched_at=2023-04-12T06:46:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b8874d4c6440b84ab50469e51d1cd',provider_auth='CHAP kETRubhZ So6KQWthwGXONr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:06Z,updated_at=2023-04-12T06:46:06Z,use_quota=True,user_id='4e9d80fc9c3e4fd39b62ac2bbbed5d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] detach volume v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 from target iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1/luns/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1/luns/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1/luns/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1/luns/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] failed to remove resource iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 because of JDSS resource v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] delete target: iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] delete target iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] failed to remove resource iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 because of JDSS resource iqn.2010-10.org.openstack:4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] deleating volume v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] get snapshots for volume v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] get volume v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283377', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60902', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14238166147862212825', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6ec9d01520ffdc16', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763804672', 'san:volume_id': '6ec9d01520ffdc16948c9664778087b173d1dc80', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39246', 'name': 'v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] delete volume:v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] volume v_4841d2c9-adf6-4e6a-9a65-05bbbf8143a1 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:46:07 user cinder-volume[73792]: DEBUG cinder.quota [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Created reservations ['b6fdd419-efc7-4e2b-af18-b92b228f5c4b', '5907ef69-1322-4541-99d2-57cb1a2c6e13', '44785735-b273-4314-af47-135b668876f0', 'ccdace3a-caf3-4c3e-9000-1896b48ce346'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:07 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=34,cinder:SELECT=58,cinder:INSERT=6,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:46:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763886592', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.manager [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:08 user cinder-volume[73792]: INFO cinder.volume.manager [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Deleted volume successfully.
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5fa25f13-3b74-46d8-87d7-c2c96abac656 tempest-VolumesListAdminTestJSON-1884284561 None] Lock "cinder-4841d2c9-adf6-4e6a-9a65-05bbbf8143a1-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Acquiring lock "cinder-fc35391d-c862-4d2a-9bd8-ad7d3e557cab-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Lock "cinder-fc35391d-c862-4d2a-9bd8-ad7d3e557cab-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] remove_export for volume: fc35391d-c862-4d2a-9bd8-ad7d3e557cab. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1436801445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=fc35391d-c862-4d2a-9bd8-ad7d3e557cab,launched_at=2023-04-12T06:45:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b8874d4c6440b84ab50469e51d1cd',provider_auth='CHAP FCfNoOZd Upl4mOsBdZ6iPK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:45:58Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:09Z,updated_at=2023-04-12T06:46:09Z,use_quota=True,user_id='4e9d80fc9c3e4fd39b62ac2bbbed5d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] detach volume v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab from target iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab/luns/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab/luns/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab/luns/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab/luns/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] failed to remove resource iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab because of JDSS resource v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] delete target: iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] delete target iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] failed to remove resource iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab because of JDSS resource iqn.2010-10.org.openstack:fc35391d-c862-4d2a-9bd8-ad7d3e557cab DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] deleating volume v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] get snapshots for volume v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] get volume v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283376', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60898', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6348517900747063438', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '276fff9af069c238', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763886592', 'san:volume_id': '276fff9af069c238fa05b53f020660ec5da3a7b0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39239', 'name': 'v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] delete volume:v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:09 user cinder-volume[73792]: INFO cinder.action_track [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-652141193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7194d3da-8e90-40da-93e9-07c4e4245bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5691cd6906234439bb15aca47cdee77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='ef426065bb714306aff8be694a281b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eb14091-e858-467f-88f1-524b7d7a7f98),volume_type_id=5eb14091-e858-467f-88f1-524b7d7a7f98) 
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Flow 'volume_create_manager' (c21efaab-2aac-4a47-9422-5a4926fd93fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7954b0f7-23be-4bb1-b021-554042cd8d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7954b0f7-23be-4bb1-b021-554042cd8d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-652141193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7194d3da-8e90-40da-93e9-07c4e4245bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5691cd6906234439bb15aca47cdee77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:09Z,use_quota=True,user_id='ef426065bb714306aff8be694a281b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eb14091-e858-467f-88f1-524b7d7a7f98),volume_type_id=5eb14091-e858-467f-88f1-524b7d7a7f98)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc19f969-e0b0-41c7-93e3-e662f5174fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc19f969-e0b0-41c7-93e3-e662f5174fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4f9ab0-aa4c-4629-9499-25fbd32bf272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4f9ab0-aa4c-4629-9499-25fbd32bf272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7194d3da-8e90-40da-93e9-07c4e4245bcf', 'volume_name': 'volume-7194d3da-8e90-40da-93e9-07c4e4245bcf', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b87321f-caed-4b0d-9f11-5e7cbeb69a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b87321f-caed-4b0d-9f11-5e7cbeb69a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e61be70-c73d-43ea-98a4-e743da9c1a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:09 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Volume 7194d3da-8e90-40da-93e9-07c4e4245bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7194d3da-8e90-40da-93e9-07c4e4245bcf', 'volume_size': 1}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] creating volume v_7194d3da-8e90-40da-93e9-07c4e4245bcf. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] create volume {'name': 'v_7194d3da-8e90-40da-93e9-07c4e4245bcf', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7194d3da-8e90-40da-93e9-07c4e4245bcf', 'is_clone': False, 'name': 'v_7194d3da-8e90-40da-93e9-07c4e4245bcf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e61be70-c73d-43ea-98a4-e743da9c1a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7194d3da-8e90-40da-93e9-07c4e4245bcf', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd4744a-d90f-4cc9-be9b-cdb033dde907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] volume v_fc35391d-c862-4d2a-9bd8-ad7d3e557cab deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:46:10 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Volume volume-7194d3da-8e90-40da-93e9-07c4e4245bcf (7194d3da-8e90-40da-93e9-07c4e4245bcf): created successfully
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd4744a-d90f-4cc9-be9b-cdb033dde907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] Flow 'volume_create_manager' (c21efaab-2aac-4a47-9422-5a4926fd93fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:10 user cinder-volume[73792]: INFO cinder.action_track [None req-bf81408b-9f09-4b08-902b-fbbd03a77666 tempest-VolumeTypesTest-1624174945 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-652141193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7194d3da-8e90-40da-93e9-07c4e4245bcf,launched_at=2023-04-12T06:46:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5691cd6906234439bb15aca47cdee77f',provider_auth='CHAP yhFMOXmi j1UpS2xbAHzl9g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:46:09Z,use_quota=True,user_id='ef426065bb714306aff8be694a281b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eb14091-e858-467f-88f1-524b7d7a7f98),volume_type_id=5eb14091-e858-467f-88f1-524b7d7a7f98) 
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.quota [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Created reservations ['aa20c255-0233-4a4e-ad42-d5bee18204ce', '71d25008-239d-4987-9df7-9a15c14ecfd8', 'da4898ad-ed25-4597-8a04-34e527cbfd99', '9a356045-b330-4fa7-b42f-4cc733cf2d29'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:10 user cinder-volume[73792]: INFO cinder.action_track [None req-01344b18-e10d-46ac-b9e4-94c7de41f448 tempest-VolumeTypesTest-1624174945 None] ACTION:'volume_retype' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-652141193',ec2_id=None,encryption_key_id=None,glance_metadata={},group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7194d3da-8e90-40da-93e9-07c4e4245bcf,launched_at=2023-04-12T06:46:10Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='5691cd6906234439bb15aca47cdee77f',provider_auth='CHAP yhFMOXmi j1UpS2xbAHzl9g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=SnapshotList,source_volid=None,status='retyping',terminated_at=None,updated_at=2023-04-12T06:46:10Z,use_quota=True,user_id='ef426065bb714306aff8be694a281b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eb14091-e858-467f-88f1-524b7d7a7f98),volume_type_id=5eb14091-e858-467f-88f1-524b7d7a7f98) 
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-01344b18-e10d-46ac-b9e4-94c7de41f448 tempest-VolumeTypesTest-1624174945 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-01344b18-e10d-46ac-b9e4-94c7de41f448 tempest-VolumeTypesTest-1624174945 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01344b18-e10d-46ac-b9e4-94c7de41f448 tempest-VolumeTypesTest-1624174945 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01344b18-e10d-46ac-b9e4-94c7de41f448 tempest-VolumeTypesTest-1624174945 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-01344b18-e10d-46ac-b9e4-94c7de41f448 tempest-VolumeTypesTest-1624174945 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763886592', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-01344b18-e10d-46ac-b9e4-94c7de41f448 tempest-VolumeTypesTest-1624174945 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.manager [None req-01344b18-e10d-46ac-b9e4-94c7de41f448 tempest-VolumeTypesTest-1624174945 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:10 user cinder-volume[73792]: INFO cinder.volume.manager [None req-01344b18-e10d-46ac-b9e4-94c7de41f448 tempest-VolumeTypesTest-1624174945 None] Retype volume completed successfully.
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763886592', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.manager [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:10 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Deleted volume successfully.
Apr 12 06:46:10 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a90cd9c2-258b-4175-8e62-bc7f6f21c2bb tempest-VolumesListAdminTestJSON-1884284561 None] Lock "cinder-fc35391d-c862-4d2a-9bd8-ad7d3e557cab-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.coordination [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Acquiring lock "cinder-7194d3da-8e90-40da-93e9-07c4e4245bcf-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.coordination [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Lock "cinder-7194d3da-8e90-40da-93e9-07c4e4245bcf-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] remove_export for volume: 7194d3da-8e90-40da-93e9-07c4e4245bcf. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-652141193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7194d3da-8e90-40da-93e9-07c4e4245bcf,launched_at=2023-04-12T06:46:10Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='5691cd6906234439bb15aca47cdee77f',provider_auth='CHAP yhFMOXmi j1UpS2xbAHzl9g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:12Z,updated_at=2023-04-12T06:46:12Z,use_quota=True,user_id='ef426065bb714306aff8be694a281b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c4020d-22e9-4745-90ab-318bd67b5257),volume_type_id=75c4020d-22e9-4745-90ab-318bd67b5257) from target:iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] detach volume v_7194d3da-8e90-40da-93e9-07c4e4245bcf from target iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf/luns/v_7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf/luns/v_7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf/luns/v_7194d3da-8e90-40da-93e9-07c4e4245bcf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf/luns/v_7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] failed to remove resource iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf because of JDSS resource v_7194d3da-8e90-40da-93e9-07c4e4245bcf DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] delete target: iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] delete target iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] failed to remove resource iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf because of JDSS resource iqn.2010-10.org.openstack:7194d3da-8e90-40da-93e9-07c4e4245bcf DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] deleating volume v_7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] get snapshots for volume v_7194d3da-8e90-40da-93e9-07c4e4245bcf  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7194d3da-8e90-40da-93e9-07c4e4245bcf/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7194d3da-8e90-40da-93e9-07c4e4245bcf/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7194d3da-8e90-40da-93e9-07c4e4245bcf/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] get volume v_7194d3da-8e90-40da-93e9-07c4e4245bcf info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7194d3da-8e90-40da-93e9-07c4e4245bcf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283386', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60918', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15747739443027499283', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b57eacd9f338fbc6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763886592', 'san:volume_id': 'b57eacd9f338fbc6555039476f667ec6dfc0b385', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39276', 'name': 'v_7194d3da-8e90-40da-93e9-07c4e4245bcf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] delete volume:v_7194d3da-8e90-40da-93e9-07c4e4245bcf recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:46:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7194d3da-8e90-40da-93e9-07c4e4245bcf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] volume v_7194d3da-8e90-40da-93e9-07c4e4245bcf deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:46:13 user cinder-volume[73792]: WARNING cinder.quota [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1652348564 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1652348564, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:46:13 user cinder-volume[73792]: WARNING cinder.quota [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1652348564 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1652348564, it is now deprecated. Please use the default quota class for default quota.
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.quota [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Created reservations ['0ec96bc7-c87f-4b74-9192-b4a2e5b6ad9e', '5919114c-c13c-45cd-9329-3453ccb7523f', '8de6f62d-9471-46af-bae4-f469303ee34e', '3cfc91e4-0d69-403c-9229-f76176279073'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:13 user cinder-volume[73792]: INFO cinder.action_track [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-251395452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e40707fa-d698-4379-b6fb-6566d9fc5d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Flow 'volume_create_manager' (d5fcfdf2-ac75-4bf3-aff4-e83e74066c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ba86c1-99d1-4d98-b994-30b6e59e2e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ba86c1-99d1-4d98-b994-30b6e59e2e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-251395452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e40707fa-d698-4379-b6fb-6566d9fc5d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:14Z,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9305ca2-8493-439e-a0ef-e3cf25ae04b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9305ca2-8493-439e-a0ef-e3cf25ae04b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1d15d4-46b7-434c-81ef-60b416e1e758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1d15d4-46b7-434c-81ef-60b416e1e758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e40707fa-d698-4379-b6fb-6566d9fc5d85', 'volume_name': 'volume-e40707fa-d698-4379-b6fb-6566d9fc5d85', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769d3fc40>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d51a560-e9d4-4b26-ab64-0f0337e3737c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d51a560-e9d4-4b26-ab64-0f0337e3737c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc690ae-d7e7-4ae2-ba09-73da9db4db7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:13 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Volume e40707fa-d698-4379-b6fb-6566d9fc5d85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e40707fa-d698-4379-b6fb-6566d9fc5d85', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769d3fc40>}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Cloning e40707fa-d698-4379-b6fb-6566d9fc5d85 from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=55,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 46, 13, 880673)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Found cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 46, 13, 904040)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Creating from source image-volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] cloned volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] cloning v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] create snapshot v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763968512', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.manager [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:13 user cinder-volume[73792]: INFO cinder.volume.manager [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Deleted volume successfully.
Apr 12 06:46:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-216407ef-512a-430e-9119-d9d0f202158a tempest-VolumeTypesTest-1624174945 None] Lock "cinder-7194d3da-8e90-40da-93e9-07c4e4245bcf-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_e40707fa-d698-4379-b6fb-6566d9fc5d85'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] create volume v_e40707fa-d698-4379-b6fb-6566d9fc5d85 from snapshot v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:46:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_e40707fa-d698-4379-b6fb-6566d9fc5d85', 'is_clone': True, 'full_name': 'Pool-0/v_e40707fa-d698-4379-b6fb-6566d9fc5d85', 'name': 'v_e40707fa-d698-4379-b6fb-6566d9fc5d85'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] get volume v_e40707fa-d698-4379-b6fb-6566d9fc5d85 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_e40707fa-d698-4379-b6fb-6566d9fc5d85', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e40707fa-d698-4379-b6fb-6566d9fc5d85', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283391', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60925', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7635866771657921567', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0cfa9e377b5dedfe', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763919360', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37451', 'name': 'v_e40707fa-d698-4379-b6fb-6566d9fc5d85', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:14 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Marking volume e40707fa-d698-4379-b6fb-6566d9fc5d85 as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:46:14 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to e40707fa-d698-4379-b6fb-6566d9fc5d85. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:46:14 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Creating volume glance metadata for volume e40707fa-d698-4379-b6fb-6566d9fc5d85 backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:46:15 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc690ae-d7e7-4ae2-ba09-73da9db4db7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e40707fa-d698-4379-b6fb-6566d9fc5d85', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769d3fc40>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:15 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fa3d2c-aab1-4255-b481-20aaf0a207b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:15 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Volume volume-e40707fa-d698-4379-b6fb-6566d9fc5d85 (e40707fa-d698-4379-b6fb-6566d9fc5d85): created successfully
Apr 12 06:46:15 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fa3d2c-aab1-4255-b481-20aaf0a207b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:15 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] Flow 'volume_create_manager' (d5fcfdf2-ac75-4bf3-aff4-e83e74066c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:15 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:DELETE=1,cinder:SELECT=62,cinder:UPDATE=28,cinder:INSERT=9 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:46:15 user cinder-volume[73792]: INFO cinder.action_track [None req-16650ac8-8035-4d75-9aac-de9668e12ec8 tempest-VolumesCloneTest-1338014755 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-251395452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e40707fa-d698-4379-b6fb-6566d9fc5d85,launched_at=2023-04-12T06:46:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth='CHAP glitQXdf ZyMv3Ygir7Bcps',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:46:14Z,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:16 user cinder-volume[73792]: INFO cinder.action_track [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-537630826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e40707fa-d698-4379-b6fb-6566d9fc5d85,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Flow 'volume_create_manager' (b3854e05-f2bc-4f9a-9acd-1255d304b2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335b3019-add2-46be-941f-3e5318bd83df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335b3019-add2-46be-941f-3e5318bd83df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-537630826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e40707fa-d698-4379-b6fb-6566d9fc5d85,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:16Z,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3369bbd-763c-4bd3-a390-9c5a11561295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3369bbd-763c-4bd3-a390-9c5a11561295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca0f611-1c9f-4425-80b8-6313bac735cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca0f611-1c9f-4425-80b8-6313bac735cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d', 'volume_name': 'volume-8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d', 'volume_size': 1, 'source_volid': 'e40707fa-d698-4379-b6fb-6566d9fc5d85', 'source_volstatus': 'available'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70998a0f-d119-48da-82e9-378567e5f0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70998a0f-d119-48da-82e9-378567e5f0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c9c1cc-f334-4d0e-a900-b4172ffbeb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:16 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Volume 8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d', 'volume_size': 1, 'source_volid': 'e40707fa-d698-4379-b6fb-6566d9fc5d85', 'source_volstatus': 'available'}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] cloned volume e40707fa-d698-4379-b6fb-6566d9fc5d85 to 8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] cloning v_e40707fa-d698-4379-b6fb-6566d9fc5d85 to v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] create snapshot v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] create volume v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d from snapshot v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e40707fa-d698-4379-b6fb-6566d9fc5d85@v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d', 'is_clone': True, 'full_name': 'Pool-0/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d', 'name': 'v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] get volume v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e40707fa-d698-4379-b6fb-6566d9fc5d85@v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283394', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60931', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10270864173590563779', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd72c30a2709bc9ac', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763894784', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37466', 'name': 'v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Marking volume 8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Copying metadata from source volume e40707fa-d698-4379-b6fb-6566d9fc5d85 to 8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:440}}
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c9c1cc-f334-4d0e-a900-b4172ffbeb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d', 'volume_size': 1, 'source_volid': 'e40707fa-d698-4379-b6fb-6566d9fc5d85', 'source_volstatus': 'available'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31b0188-6d59-472f-9bf2-5ac151c42871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:17 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Volume volume-8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d (8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d): created successfully
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31b0188-6d59-472f-9bf2-5ac151c42871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] Flow 'volume_create_manager' (b3854e05-f2bc-4f9a-9acd-1255d304b2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:17 user cinder-volume[73792]: INFO cinder.action_track [None req-97dda578-d2be-4e5c-b940-caeba6f21e86 tempest-VolumesCloneTest-1338014755 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-537630826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d,launched_at=2023-04-12T06:46:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth='CHAP AvpGWoIY eirZWJOplLtYPX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:16Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e40707fa-d698-4379-b6fb-6566d9fc5d85,status='available',terminated_at=None,updated_at=2023-04-12T06:46:16Z,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:17 user cinder-volume[73792]: INFO cinder.action_track [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1314363085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e576c659-6613-4633-aea2-bfcc2cfbb7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5098984b6bda4c2d9a71023292e7815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='c93cca7970df482f8c3a00f15ef12fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Flow 'volume_create_manager' (4307bf31-6742-4ce2-908a-3791829ab215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c83ab10-da35-4d5f-8e54-5b22fc5990e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c83ab10-da35-4d5f-8e54-5b22fc5990e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1314363085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e576c659-6613-4633-aea2-bfcc2cfbb7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5098984b6bda4c2d9a71023292e7815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:18Z,use_quota=True,user_id='c93cca7970df482f8c3a00f15ef12fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f38a63-1bae-4a84-b919-a2b99915c4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f38a63-1bae-4a84-b919-a2b99915c4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a429fc-f24d-4f3e-b9ec-8b79549f9864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a429fc-f24d-4f3e-b9ec-8b79549f9864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e576c659-6613-4633-aea2-bfcc2cfbb7ad', 'volume_name': 'volume-e576c659-6613-4633-aea2-bfcc2cfbb7ad', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fa0290-dc52-48ed-bad6-11e35c158ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fa0290-dc52-48ed-bad6-11e35c158ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc4bb1e-5e49-4dd2-b4fa-aba181f53f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:18 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Volume e576c659-6613-4633-aea2-bfcc2cfbb7ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e576c659-6613-4633-aea2-bfcc2cfbb7ad', 'volume_size': 1}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] creating volume v_e576c659-6613-4633-aea2-bfcc2cfbb7ad. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] create volume {'name': 'v_e576c659-6613-4633-aea2-bfcc2cfbb7ad', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.coordination [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Acquiring lock "cinder-8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.coordination [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Lock "cinder-8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] remove_export for volume: 8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-537630826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d,launched_at=2023-04-12T06:46:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth='CHAP AvpGWoIY eirZWJOplLtYPX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:16Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e40707fa-d698-4379-b6fb-6566d9fc5d85,status='deleting',terminated_at=2023-04-12T06:46:18Z,updated_at=2023-04-12T06:46:18Z,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] detach volume v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d from target iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d/luns/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d/luns/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d/luns/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d/luns/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] failed to remove resource iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d because of JDSS resource v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] delete target: iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] delete target iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] failed to remove resource iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d because of JDSS resource iqn.2010-10.org.openstack:8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] deleating volume v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] get snapshots for volume v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad', 'is_clone': False, 'name': 'v_e576c659-6613-4633-aea2-bfcc2cfbb7ad'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc4bb1e-5e49-4dd2-b4fa-aba181f53f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e576c659-6613-4633-aea2-bfcc2cfbb7ad', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4627825c-f58b-40a7-ae48-92b36614018a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:18 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Volume volume-e576c659-6613-4633-aea2-bfcc2cfbb7ad (e576c659-6613-4633-aea2-bfcc2cfbb7ad): created successfully
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4627825c-f58b-40a7-ae48-92b36614018a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] Flow 'volume_create_manager' (4307bf31-6742-4ce2-908a-3791829ab215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:18 user cinder-volume[73792]: INFO cinder.action_track [None req-7356a95e-f5b9-45c2-bc35-d025c246f5f5 tempest-VolumesNegativeTest-289347363 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1314363085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e576c659-6613-4633-aea2-bfcc2cfbb7ad,launched_at=2023-04-12T06:46:18Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5098984b6bda4c2d9a71023292e7815c',provider_auth='CHAP YPfFrgoC WwPj0YOpB3SJhu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:18Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:46:18Z,use_quota=True,user_id='c93cca7970df482f8c3a00f15ef12fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] get volume v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e40707fa-d698-4379-b6fb-6566d9fc5d85@v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283394', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60931', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10270864173590563779', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd72c30a2709bc9ac', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763800576', 'san:volume_id': 'd72c30a2709bc9acc3abbcd939b037066ee6d03a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37466', 'name': 'v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] delete snapshot v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d of volume v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85/snapshots/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85/snapshots/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85/snapshots/v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] snapshot v_8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:46:19 user cinder-volume[73792]: DEBUG cinder.quota [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Created reservations ['30fc761f-4ada-4da0-9721-254b03573dd8', '1b229389-a0e4-4c18-ab00-c17da637cb4e', '3f0c480c-1b4f-4032-bb09-0b95b015536e', 'a42b9181-827c-49a5-8f0e-e86c58fdbd5f'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763825152', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.manager [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:20 user cinder-volume[73792]: INFO cinder.volume.manager [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Deleted volume successfully.
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.coordination [None req-97b35aaf-7180-4702-8261-126ac9e5c308 tempest-VolumesCloneTest-1338014755 None] Lock "cinder-8bbfa52d-8bb5-45c3-bfe7-6322d80fdd1d-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Acquiring lock "cinder-e40707fa-d698-4379-b6fb-6566d9fc5d85-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Lock "cinder-e40707fa-d698-4379-b6fb-6566d9fc5d85-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] remove_export for volume: e40707fa-d698-4379-b6fb-6566d9fc5d85. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-251395452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e40707fa-d698-4379-b6fb-6566d9fc5d85,launched_at=2023-04-12T06:46:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth='CHAP glitQXdf ZyMv3Ygir7Bcps',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:21Z,updated_at=2023-04-12T06:46:21Z,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] detach volume v_e40707fa-d698-4379-b6fb-6566d9fc5d85 from target iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85/luns/v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85/luns/v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85/luns/v_e40707fa-d698-4379-b6fb-6566d9fc5d85'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85/luns/v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] failed to remove resource iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 because of JDSS resource v_e40707fa-d698-4379-b6fb-6566d9fc5d85 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] delete target: iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] delete target iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] failed to remove resource iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 because of JDSS resource iqn.2010-10.org.openstack:e40707fa-d698-4379-b6fb-6566d9fc5d85 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] deleating volume v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] get snapshots for volume v_e40707fa-d698-4379-b6fb-6566d9fc5d85  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] get volume v_e40707fa-d698-4379-b6fb-6566d9fc5d85 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_e40707fa-d698-4379-b6fb-6566d9fc5d85', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e40707fa-d698-4379-b6fb-6566d9fc5d85', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283391', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60925', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7635866771657921567', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0cfa9e377b5dedfe', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763825152', 'san:volume_id': '0cfa9e377b5dedfe73e115fde96e94f0d83e598e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37451', 'name': 'v_e40707fa-d698-4379-b6fb-6566d9fc5d85', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] delete snapshot v_e40707fa-d698-4379-b6fb-6566d9fc5d85 of volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_e40707fa-d698-4379-b6fb-6566d9fc5d85 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] snapshot v_e40707fa-d698-4379-b6fb-6566d9fc5d85 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:46:21 user cinder-volume[73792]: DEBUG cinder.quota [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Created reservations ['199fd31f-faf8-4ac1-97e6-ed8f7da890cf', 'ae77c762-7dad-4e13-b86b-c0d1ea3032ac', '4e89e990-f36a-44e9-baef-f7872ba21cca', 'cc191952-e56c-45a4-a795-03c15ba8a0de'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763849728', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:22 user cinder-volume[73792]: DEBUG cinder.manager [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:22 user cinder-volume[73792]: INFO cinder.volume.manager [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Deleted volume successfully.
Apr 12 06:46:22 user cinder-volume[73792]: DEBUG cinder.coordination [None req-6ee8adcd-36df-4ebd-8c9b-16ddb94315b6 tempest-VolumesCloneTest-1338014755 None] Lock "cinder-e40707fa-d698-4379-b6fb-6566d9fc5d85-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:23 user cinder-volume[73792]: INFO cinder.action_track [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-498351260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=2e0bff88-15b8-4880-b61b-3eb260237a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Flow 'volume_create_manager' (fa0c2361-f91e-455a-854f-ed6ae9c40671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a139c58-fb46-4eee-ae74-20ba1fc87ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a139c58-fb46-4eee-ae74-20ba1fc87ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-498351260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=2e0bff88-15b8-4880-b61b-3eb260237a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:23Z,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f61699-b054-41fe-a88e-32e00fe60765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f61699-b054-41fe-a88e-32e00fe60765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0b632c-fb2c-492d-8ff7-c7b553b73d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0b632c-fb2c-492d-8ff7-c7b553b73d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e0bff88-15b8-4880-b61b-3eb260237a30', 'volume_name': 'volume-2e0bff88-15b8-4880-b61b-3eb260237a30', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fcd4cf-2990-476e-aaaa-b915d3c37c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fcd4cf-2990-476e-aaaa-b915d3c37c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d551cad7-4f05-4b54-9c57-1d3a7163282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:23 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Volume 2e0bff88-15b8-4880-b61b-3eb260237a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e0bff88-15b8-4880-b61b-3eb260237a30', 'volume_size': 1}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] creating volume v_2e0bff88-15b8-4880-b61b-3eb260237a30. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] create volume {'name': 'v_2e0bff88-15b8-4880-b61b-3eb260237a30', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2e0bff88-15b8-4880-b61b-3eb260237a30', 'is_clone': False, 'name': 'v_2e0bff88-15b8-4880-b61b-3eb260237a30'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d551cad7-4f05-4b54-9c57-1d3a7163282e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e0bff88-15b8-4880-b61b-3eb260237a30', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933a4759-bd1f-4057-b4d4-d7b71c2bd0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:23 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Volume volume-2e0bff88-15b8-4880-b61b-3eb260237a30 (2e0bff88-15b8-4880-b61b-3eb260237a30): created successfully
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933a4759-bd1f-4057-b4d4-d7b71c2bd0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] Flow 'volume_create_manager' (fa0c2361-f91e-455a-854f-ed6ae9c40671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:23 user cinder-volume[73792]: INFO cinder.action_track [None req-666beb17-92e5-4328-9f38-a6054f04118b tempest-VolumesCloneTest-1338014755 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-498351260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=2e0bff88-15b8-4880-b61b-3eb260237a30,launched_at=2023-04-12T06:46:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth='CHAP dtFfawPr rij1Q7ex0Tsfwa',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:23Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:46:23Z,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:24 user cinder-volume[73792]: INFO cinder.action_track [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1659004844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7155bc31-0486-40f9-a13e-d2398fe6f026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=2e0bff88-15b8-4880-b61b-3eb260237a30,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Flow 'volume_create_manager' (5391a2f3-183f-4454-9e0f-15badf8918fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813d0a85-503c-46e3-b5e4-d284c5d6d2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813d0a85-503c-46e3-b5e4-d284c5d6d2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1659004844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7155bc31-0486-40f9-a13e-d2398fe6f026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=2e0bff88-15b8-4880-b61b-3eb260237a30,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:25Z,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbfb9ca-4f98-482e-b0a0-1bcbc6ef79f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbfb9ca-4f98-482e-b0a0-1bcbc6ef79f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915674c4-a75b-4f9c-8b0a-a295e563475a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Acquiring lock "cinder-c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915674c4-a75b-4f9c-8b0a-a295e563475a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7155bc31-0486-40f9-a13e-d2398fe6f026', 'volume_name': 'volume-7155bc31-0486-40f9-a13e-d2398fe6f026', 'volume_size': 2, 'source_volid': '2e0bff88-15b8-4880-b61b-3eb260237a30', 'source_volstatus': 'available'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b670521-fabc-49dd-be06-21569759bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b670521-fabc-49dd-be06-21569759bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cb8e92-5ea2-49b1-aae4-50768e17c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:24 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Volume 7155bc31-0486-40f9-a13e-d2398fe6f026: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7155bc31-0486-40f9-a13e-d2398fe6f026', 'volume_size': 2, 'source_volid': '2e0bff88-15b8-4880-b61b-3eb260237a30', 'source_volstatus': 'available'}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Lock "cinder-c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] cloned volume 2e0bff88-15b8-4880-b61b-3eb260237a30 to 7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] cloning v_2e0bff88-15b8-4880-b61b-3eb260237a30 to v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] create snapshot v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=63,cinder:DELETE=4,cinder:INSERT=13,cinder:UPDATE=20 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] remove_export for volume: c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1591689999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7,launched_at=2023-04-12T06:30:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP akKCItqp nVuiUh6J8ZmKle',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:30:32Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:25Z,updated_at=2023-04-12T06:46:25Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] detach volume v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 from target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/luns/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] failed to remove resource iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 because of JDSS resource v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] delete target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] delete target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] failed to remove resource iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 because of JDSS resource iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] deleating volume v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] get snapshots for volume v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] get volume v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282449', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60385', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13390040879097244897', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e84dd9fa7eb9e238', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763780096', 'san:volume_id': 'e84dd9fa7eb9e23859dec713f65966f25eb804ad', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37834', 'name': 'v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] delete volume:v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_7155bc31-0486-40f9-a13e-d2398fe6f026'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] create volume v_7155bc31-0486-40f9-a13e-d2398fe6f026 from snapshot v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2e0bff88-15b8-4880-b61b-3eb260237a30@v_7155bc31-0486-40f9-a13e-d2398fe6f026', 'is_clone': True, 'full_name': 'Pool-0/v_7155bc31-0486-40f9-a13e-d2398fe6f026', 'name': 'v_7155bc31-0486-40f9-a13e-d2398fe6f026'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] get volume v_7155bc31-0486-40f9-a13e-d2398fe6f026 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2e0bff88-15b8-4880-b61b-3eb260237a30@v_7155bc31-0486-40f9-a13e-d2398fe6f026', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7155bc31-0486-40f9-a13e-d2398fe6f026', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283402', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60951', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3567647234931782876', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fee3a65e7701d004', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763862016', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38239', 'name': 'v_7155bc31-0486-40f9-a13e-d2398fe6f026', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Extend volume 7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] jdss extend volume v_7155bc31-0486-40f9-a13e-d2398fe6f026 to 2147483648 {{(pid=73792) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cb8e92-5ea2-49b1-aae4-50768e17c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7155bc31-0486-40f9-a13e-d2398fe6f026', 'volume_size': 2, 'source_volid': '2e0bff88-15b8-4880-b61b-3eb260237a30', 'source_volstatus': 'available'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3389b9-5259-4a27-8d6e-7bacad3b653a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:26 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Volume volume-7155bc31-0486-40f9-a13e-d2398fe6f026 (7155bc31-0486-40f9-a13e-d2398fe6f026): created successfully
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3389b9-5259-4a27-8d6e-7bacad3b653a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] Flow 'volume_create_manager' (5391a2f3-183f-4454-9e0f-15badf8918fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:26 user cinder-volume[73792]: INFO cinder.action_track [None req-a0be6eee-8f76-44dd-9f56-1f3992415377 tempest-VolumesCloneTest-1338014755 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1659004844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7155bc31-0486-40f9-a13e-d2398fe6f026,launched_at=2023-04-12T06:46:26Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth='CHAP scPTAvgN KtzV4adfAF2jib',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:25Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=2e0bff88-15b8-4880-b61b-3eb260237a30,status='available',terminated_at=None,updated_at=2023-04-12T06:46:25Z,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] volume v_c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=33,cinder:SELECT=52,cinder:INSERT=12,cinder:DELETE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG cinder.quota [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Created reservations ['e46e4f44-2c1b-4b8a-826f-0f9d94488835', 'cd5e7e3f-454b-486e-8eeb-158589f5d131', '82a7766d-801a-4c56-9158-2623b570f5cc', '3982a0ef-87f6-497b-b3a2-341e69384bcf'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Acquiring lock "cinder-7155bc31-0486-40f9-a13e-d2398fe6f026-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Lock "cinder-7155bc31-0486-40f9-a13e-d2398fe6f026-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] remove_export for volume: 7155bc31-0486-40f9-a13e-d2398fe6f026. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1659004844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=7155bc31-0486-40f9-a13e-d2398fe6f026,launched_at=2023-04-12T06:46:26Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth='CHAP scPTAvgN KtzV4adfAF2jib',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:25Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=2e0bff88-15b8-4880-b61b-3eb260237a30,status='deleting',terminated_at=2023-04-12T06:46:27Z,updated_at=2023-04-12T06:46:27Z,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] detach volume v_7155bc31-0486-40f9-a13e-d2398fe6f026 from target iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026/luns/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026/luns/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026/luns/v_7155bc31-0486-40f9-a13e-d2398fe6f026'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026/luns/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] failed to remove resource iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 because of JDSS resource v_7155bc31-0486-40f9-a13e-d2398fe6f026 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] delete target: iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] delete target iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Acquiring lock "cinder-d96a84d2-2151-4f60-a72b-25e84b80c975-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Lock "cinder-d96a84d2-2151-4f60-a72b-25e84b80c975-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] failed to remove resource iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 because of JDSS resource iqn.2010-10.org.openstack:7155bc31-0486-40f9-a13e-d2398fe6f026 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] deleating volume v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] get snapshots for volume v_7155bc31-0486-40f9-a13e-d2398fe6f026  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7155bc31-0486-40f9-a13e-d2398fe6f026/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7155bc31-0486-40f9-a13e-d2398fe6f026/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763780096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.manager [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:27 user cinder-volume[73792]: INFO cinder.volume.manager [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Deleted volume successfully.
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.coordination [None req-2ef849d3-66bf-4bf3-8de2-cc59055bf094 tempest-ServerActionsTestJSON-752347644 None] Lock "cinder-c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] remove_export for volume: d96a84d2-2151-4f60-a72b-25e84b80c975. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2015142299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d96a84d2-2151-4f60-a72b-25e84b80c975,launched_at=2023-04-12T06:25:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd87c4105246c1ac1bdf424c83b7aa',provider_auth='CHAP AoTzegHP Bb8QxLYWjXOD0w',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:25:37Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:27Z,updated_at=2023-04-12T06:46:27Z,use_quota=True,user_id='ad316acdc89947bbba60c75e9a24d7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] detach volume v_d96a84d2-2151-4f60-a72b-25e84b80c975 from target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns/v_d96a84d2-2151-4f60-a72b-25e84b80c975'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975/luns/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] failed to remove resource iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 because of JDSS resource v_d96a84d2-2151-4f60-a72b-25e84b80c975 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] delete target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] delete target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] failed to remove resource iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 because of JDSS resource iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] deleating volume v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] get snapshots for volume v_d96a84d2-2151-4f60-a72b-25e84b80c975  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d96a84d2-2151-4f60-a72b-25e84b80c975/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d96a84d2-2151-4f60-a72b-25e84b80c975/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7155bc31-0486-40f9-a13e-d2398fe6f026/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] get volume v_7155bc31-0486-40f9-a13e-d2398fe6f026 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2e0bff88-15b8-4880-b61b-3eb260237a30@v_7155bc31-0486-40f9-a13e-d2398fe6f026', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7155bc31-0486-40f9-a13e-d2398fe6f026', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283402', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60951', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3567647234931782876', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fee3a65e7701d004', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763780096', 'san:volume_id': 'fee3a65e7701d00489c1e20e37646011bdc969e5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38239', 'name': 'v_7155bc31-0486-40f9-a13e-d2398fe6f026', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] delete snapshot v_7155bc31-0486-40f9-a13e-d2398fe6f026 of volume v_2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30/snapshots/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30/snapshots/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d96a84d2-2151-4f60-a72b-25e84b80c975/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] get volume v_d96a84d2-2151-4f60-a72b-25e84b80c975 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d96a84d2-2151-4f60-a72b-25e84b80c975', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681282154', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60124', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5559922048754783291', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '80e0cde4d5d119c9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763780096', 'san:volume_id': '80e0cde4d5d119c941780b55a7af903d7d40dfeb', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38091', 'name': 'v_d96a84d2-2151-4f60-a72b-25e84b80c975', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] delete volume:v_d96a84d2-2151-4f60-a72b-25e84b80c975 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30/snapshots/v_7155bc31-0486-40f9-a13e-d2398fe6f026 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] snapshot v_7155bc31-0486-40f9-a13e-d2398fe6f026 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.quota [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Created reservations ['9f059b57-e682-4b9f-bc25-bd66a87e5f03', '3f4a0479-3dd4-49ee-8bbf-48a360f4e964', 'c146fc49-b66e-4003-9b46-e6732640f729', '135a561c-d9d5-4785-8c3a-8aa5787b8b50'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d96a84d2-2151-4f60-a72b-25e84b80c975 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] volume v_d96a84d2-2151-4f60-a72b-25e84b80c975 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.quota [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Created reservations ['31638fae-45a1-4538-b352-5df46159109e', 'fa565bb7-d67d-4d4f-9237-6e4eca2e1149', '260adeae-eec6-4618-9e16-3d3e37f66360', '297e536d-6aeb-46e6-b3d9-71ae40bfa22e'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763780096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.manager [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:28 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Deleted volume successfully.
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0638d17a-f2f6-4bde-9048-d884a2ea76ea tempest-ServerActionsTestJSON-752347644 None] Lock "cinder-d96a84d2-2151-4f60-a72b-25e84b80c975-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763968512', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.manager [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:28 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Deleted volume successfully.
Apr 12 06:46:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b7a883df-7bf4-42be-959f-90d89fd445f2 tempest-VolumesCloneTest-1338014755 None] Lock "cinder-7155bc31-0486-40f9-a13e-d2398fe6f026-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.coordination [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Acquiring lock "cinder-2e0bff88-15b8-4880-b61b-3eb260237a30-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.coordination [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Lock "cinder-2e0bff88-15b8-4880-b61b-3eb260237a30-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] remove_export for volume: 2e0bff88-15b8-4880-b61b-3eb260237a30. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-498351260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=2e0bff88-15b8-4880-b61b-3eb260237a30,launched_at=2023-04-12T06:46:24Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d90bffd1441059c046c4697db2663',provider_auth='CHAP dtFfawPr rij1Q7ex0Tsfwa',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:23Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:29Z,updated_at=2023-04-12T06:46:29Z,use_quota=True,user_id='27ab18452c0e47519fb0ae77d0981660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] detach volume v_2e0bff88-15b8-4880-b61b-3eb260237a30 from target iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30/luns/v_2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30/luns/v_2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30/luns/v_2e0bff88-15b8-4880-b61b-3eb260237a30'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30/luns/v_2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] failed to remove resource iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 because of JDSS resource v_2e0bff88-15b8-4880-b61b-3eb260237a30 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] delete target: iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] delete target iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] failed to remove resource iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 because of JDSS resource iqn.2010-10.org.openstack:2e0bff88-15b8-4880-b61b-3eb260237a30 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] deleating volume v_2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] get snapshots for volume v_2e0bff88-15b8-4880-b61b-3eb260237a30  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] get volume v_2e0bff88-15b8-4880-b61b-3eb260237a30 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2e0bff88-15b8-4880-b61b-3eb260237a30', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283400', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60945', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6770324115764764702', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '759834aec440613c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763968512', 'san:volume_id': '759834aec440613ca91fd07dcb6b0d67f3b4a853', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38226', 'name': 'v_2e0bff88-15b8-4880-b61b-3eb260237a30', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] delete volume:v_2e0bff88-15b8-4880-b61b-3eb260237a30 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2e0bff88-15b8-4880-b61b-3eb260237a30 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] volume v_2e0bff88-15b8-4880-b61b-3eb260237a30 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114764050432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.quota [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Created reservations ['82715824-220f-4cf5-8841-4c3ea16596c0', '28b2a3ac-92af-43f7-9dd6-a7906cdefa3f', '8351e8f9-e7b2-40cc-80a3-93a16c2d4350', 'e74c7507-7c57-4d50-988f-6b9e53778977'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764050432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:31 user cinder-volume[73792]: DEBUG cinder.manager [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:31 user cinder-volume[73792]: INFO cinder.volume.manager [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Deleted volume successfully.
Apr 12 06:46:31 user cinder-volume[73792]: DEBUG cinder.coordination [None req-261312ea-7977-4f3f-80b8-2091847d330a tempest-VolumesCloneTest-1338014755 None] Lock "cinder-2e0bff88-15b8-4880-b61b-3eb260237a30-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:33 user cinder-volume[73792]: INFO cinder.action_track [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1601622203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=69e8aa70-9e19-40bf-b82c-e2aa5b562bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f031a9b772094dcc96883f448d418344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='b00e1b0aded8436d849dc4089ae96fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Flow 'volume_create_manager' (4e332af6-3a7f-49f3-92f6-a8ddbe78272f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff679d00-7833-46d9-855c-bf55aa89869f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff679d00-7833-46d9-855c-bf55aa89869f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1601622203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=69e8aa70-9e19-40bf-b82c-e2aa5b562bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f031a9b772094dcc96883f448d418344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:34Z,use_quota=True,user_id='b00e1b0aded8436d849dc4089ae96fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a7c381-057f-4bfc-8042-5df6da7cdd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a7c381-057f-4bfc-8042-5df6da7cdd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854f21f9-c571-4db6-8e51-5157ec36c373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854f21f9-c571-4db6-8e51-5157ec36c373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69e8aa70-9e19-40bf-b82c-e2aa5b562bd6', 'volume_name': 'volume-69e8aa70-9e19-40bf-b82c-e2aa5b562bd6', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8760006b60>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93effaac-1ebb-44da-9333-437f12d38f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93effaac-1ebb-44da-9333-437f12d38f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f22079-4b34-46a6-bf5b-a0beb9aa5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:33 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Volume 69e8aa70-9e19-40bf-b82c-e2aa5b562bd6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69e8aa70-9e19-40bf-b82c-e2aa5b562bd6', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8760006b60>}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Cloning 69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.coordination [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.coordination [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 46, 33, 837911)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Found cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.coordination [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 0.013s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 46, 33, 850585)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Creating from source image-volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] cloned volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to 69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] cloning v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] create snapshot v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] create volume v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 from snapshot v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6', 'is_clone': True, 'full_name': 'Pool-0/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6', 'name': 'v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] get volume v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283411', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60964', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17229135825627358960', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9061713148e71c5f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114764038144', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37992', 'name': 'v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Marking volume 69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to 69e8aa70-9e19-40bf-b82c-e2aa5b562bd6. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Creating volume glance metadata for volume 69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=53,cinder:DELETE=2,cinder:INSERT=10,cinder:UPDATE=35 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:INSERT=9,cinder:UPDATE=33,cinder:SELECT=55,cinder:DELETE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f22079-4b34-46a6-bf5b-a0beb9aa5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e8aa70-9e19-40bf-b82c-e2aa5b562bd6', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8760006b60>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8707879-d955-4045-8118-37c546868992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:34 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Volume volume-69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 (69e8aa70-9e19-40bf-b82c-e2aa5b562bd6): created successfully
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8707879-d955-4045-8118-37c546868992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] Flow 'volume_create_manager' (4e332af6-3a7f-49f3-92f6-a8ddbe78272f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:34 user cinder-volume[73792]: INFO cinder.action_track [None req-50ee8e8c-5a2d-4b18-a036-3da623856075 tempest-VolumesExtendTest-2061027765 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1601622203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=69e8aa70-9e19-40bf-b82c-e2aa5b562bd6,launched_at=2023-04-12T06:46:34Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f031a9b772094dcc96883f448d418344',provider_auth='CHAP BROXEfSQ GMC6dZH9AB2X7K',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:46:34Z,use_quota=True,user_id='b00e1b0aded8436d849dc4089ae96fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:35 user cinder-volume[73792]: INFO cinder.action_track [None req-2207db85-30a3-48f8-9699-cebc4a980ec4 tempest-VolumesExtendTest-2061027765 None] ACTION:'volume_extend' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1601622203',ec2_id=None,encryption_key_id=None,glance_metadata={checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',disk_format='qcow2',hw_rng_model='virtio',image_id='4f2549ed-915f-4494-87f3-9269834fa9da',image_name='cirros-0.5.2-x86_64-disk',min_disk='0',min_ram='0',owner_specified.openstack.md5='',owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',owner_specified.openstack.sha256='',size='16300544'},group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=69e8aa70-9e19-40bf-b82c-e2aa5b562bd6,launched_at=2023-04-12T06:46:35Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='f031a9b772094dcc96883f448d418344',provider_auth='CHAP BROXEfSQ GMC6dZH9AB2X7K',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='extending',terminated_at=None,updated_at=2023-04-12T06:46:35Z,use_quota=True,user_id='b00e1b0aded8436d849dc4089ae96fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2207db85-30a3-48f8-9699-cebc4a980ec4 tempest-VolumesExtendTest-2061027765 None] Extend volume 69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}}
Apr 12 06:46:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2207db85-30a3-48f8-9699-cebc4a980ec4 tempest-VolumesExtendTest-2061027765 None] jdss extend volume v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 to 2147483648 {{(pid=73792) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}}
Apr 12 06:46:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2207db85-30a3-48f8-9699-cebc4a980ec4 tempest-VolumesExtendTest-2061027765 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2207db85-30a3-48f8-9699-cebc4a980ec4 tempest-VolumesExtendTest-2061027765 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2207db85-30a3-48f8-9699-cebc4a980ec4 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:36 user cinder-volume[73792]: INFO cinder.volume.manager [None req-2207db85-30a3-48f8-9699-cebc4a980ec4 tempest-VolumesExtendTest-2061027765 None] Extend volume completed successfully.
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.coordination [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Acquiring lock "cinder-69e8aa70-9e19-40bf-b82c-e2aa5b562bd6-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.coordination [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Lock "cinder-69e8aa70-9e19-40bf-b82c-e2aa5b562bd6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] remove_export for volume: 69e8aa70-9e19-40bf-b82c-e2aa5b562bd6. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1601622203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=69e8aa70-9e19-40bf-b82c-e2aa5b562bd6,launched_at=2023-04-12T06:46:35Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='f031a9b772094dcc96883f448d418344',provider_auth='CHAP BROXEfSQ GMC6dZH9AB2X7K',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:34Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:37Z,updated_at=2023-04-12T06:46:37Z,use_quota=True,user_id='b00e1b0aded8436d849dc4089ae96fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] detach volume v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 from target iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6/luns/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6/luns/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6/luns/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6/luns/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] failed to remove resource iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 because of JDSS resource v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] delete target: iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] delete target iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] failed to remove resource iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 because of JDSS resource iqn.2010-10.org.openstack:69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] deleating volume v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] get snapshots for volume v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] get volume v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283411', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '60964', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17229135825627358960', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9061713148e71c5f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763931648', 'san:volume_id': '9061713148e71c5fdc0445fa6b6ca5953188142d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37992', 'name': 'v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] delete snapshot v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 of volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] snapshot v_69e8aa70-9e19-40bf-b82c-e2aa5b562bd6 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:46:38 user cinder-volume[73792]: DEBUG cinder.quota [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Created reservations ['d54cf40e-e213-4b89-99e3-1870fa00b3d6', '2e24b2b4-8ce6-4497-8dc8-7927575c6737', '3dc82e96-c07c-420e-b5d0-7cba3b3b0822', 'a9960142-cf7b-4347-bf45-253d4fbce335'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764062720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.manager [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:39 user cinder-volume[73792]: INFO cinder.volume.manager [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Deleted volume successfully.
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.coordination [None req-95c4ddd6-fc1f-4bf0-8b95-ffd9660ccd53 tempest-VolumesExtendTest-2061027765 None] Lock "cinder-69e8aa70-9e19-40bf-b82c-e2aa5b562bd6-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:39 user cinder-volume[73792]: INFO cinder.action_track [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1148003203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=60a3ac69-9753-4731-b6fc-42927fd75088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f031a9b772094dcc96883f448d418344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='b00e1b0aded8436d849dc4089ae96fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Flow 'volume_create_manager' (46567773-698a-4318-8a1e-d57d268e1693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5c6a8e-b529-4c48-ac3e-9e2cdab6bb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5c6a8e-b529-4c48-ac3e-9e2cdab6bb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1148003203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=60a3ac69-9753-4731-b6fc-42927fd75088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f031a9b772094dcc96883f448d418344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:40Z,use_quota=True,user_id='b00e1b0aded8436d849dc4089ae96fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b955b08-9dfe-4e9d-b520-6d357b1ca329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b955b08-9dfe-4e9d-b520-6d357b1ca329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc294095-02cb-4d7c-9520-b7209b1371d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc294095-02cb-4d7c-9520-b7209b1371d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60a3ac69-9753-4731-b6fc-42927fd75088', 'volume_name': 'volume-60a3ac69-9753-4731-b6fc-42927fd75088', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd46b10d-4a62-4f89-adef-4ece86d3696e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd46b10d-4a62-4f89-adef-4ece86d3696e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab20e06-53f8-4a51-89f0-d50599688a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:39 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Volume 60a3ac69-9753-4731-b6fc-42927fd75088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60a3ac69-9753-4731-b6fc-42927fd75088', 'volume_size': 1}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] creating volume v_60a3ac69-9753-4731-b6fc-42927fd75088. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] create volume {'name': 'v_60a3ac69-9753-4731-b6fc-42927fd75088', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_60a3ac69-9753-4731-b6fc-42927fd75088', 'is_clone': False, 'name': 'v_60a3ac69-9753-4731-b6fc-42927fd75088'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab20e06-53f8-4a51-89f0-d50599688a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a3ac69-9753-4731-b6fc-42927fd75088', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120a01fb-769c-4fd5-b6eb-b4f233dee2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:40 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Volume volume-60a3ac69-9753-4731-b6fc-42927fd75088 (60a3ac69-9753-4731-b6fc-42927fd75088): created successfully
Apr 12 06:46:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120a01fb-769c-4fd5-b6eb-b4f233dee2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] Flow 'volume_create_manager' (46567773-698a-4318-8a1e-d57d268e1693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:40 user cinder-volume[73792]: INFO cinder.action_track [None req-b95a397b-d301-482a-a538-945274a89d99 tempest-VolumesExtendTest-2061027765 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1148003203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=60a3ac69-9753-4731-b6fc-42927fd75088,launched_at=2023-04-12T06:46:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f031a9b772094dcc96883f448d418344',provider_auth='CHAP wlZOHgKd BN7wblKOZoUtcE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:46:40Z,use_quota=True,user_id='b00e1b0aded8436d849dc4089ae96fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:40 user cinder-volume[73792]: INFO cinder.action_track [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Snapshot-108762022',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=35202c96-2dc3-4cfb-9119-f52c33a77f21,metadata={},progress='0%',project_id='f031a9b772094dcc96883f448d418344',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='b00e1b0aded8436d849dc4089ae96fbf',volume=<?>,volume_id=60a3ac69-9753-4731-b6fc-42927fd75088,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] create snapshot 35202c96-2dc3-4cfb-9119-f52c33a77f21 for volume 60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] cloning v_60a3ac69-9753-4731-b6fc-42927fd75088 to s_35202c96-2dc3-4cfb-9119-f52c33a77f21 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] create snapshot s_35202c96-2dc3-4cfb-9119-f52c33a77f21 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_35202c96-2dc3-4cfb-9119-f52c33a77f21'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] create volume s_35202c96-2dc3-4cfb-9119-f52c33a77f21 from snapshot s_35202c96-2dc3-4cfb-9119-f52c33a77f21 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_60a3ac69-9753-4731-b6fc-42927fd75088@s_35202c96-2dc3-4cfb-9119-f52c33a77f21', 'is_clone': True, 'full_name': 'Pool-0/s_35202c96-2dc3-4cfb-9119-f52c33a77f21', 'name': 's_35202c96-2dc3-4cfb-9119-f52c33a77f21'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_35202c96-2dc3-4cfb-9119-f52c33a77f21/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_35202c96-2dc3-4cfb-9119-f52c33a77f21/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_35202c96-2dc3-4cfb-9119-f52c33a77f21/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] volume s_35202c96-2dc3-4cfb-9119-f52c33a77f21 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:46:41 user cinder-volume[73792]: INFO cinder.volume.manager [None req-70decc3c-520a-4c8f-b56a-420e4bf6ed1d tempest-VolumesExtendTest-2061027765 None] Create snapshot completed successfully
Apr 12 06:46:42 user cinder-volume[73792]: INFO cinder.action_track [None req-7415845c-f8ed-4e13-bd8d-dea1e35ea431 tempest-VolumesExtendTest-2061027765 None] ACTION:'volume_extend' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1148003203',ec2_id=None,encryption_key_id=None,glance_metadata={},group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=60a3ac69-9753-4731-b6fc-42927fd75088,launched_at=2023-04-12T06:46:40Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='f031a9b772094dcc96883f448d418344',provider_auth='CHAP wlZOHgKd BN7wblKOZoUtcE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='extending',terminated_at=None,updated_at=2023-04-12T06:46:40Z,use_quota=True,user_id='b00e1b0aded8436d849dc4089ae96fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7415845c-f8ed-4e13-bd8d-dea1e35ea431 tempest-VolumesExtendTest-2061027765 None] Extend volume 60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}}
Apr 12 06:46:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7415845c-f8ed-4e13-bd8d-dea1e35ea431 tempest-VolumesExtendTest-2061027765 None] jdss extend volume v_60a3ac69-9753-4731-b6fc-42927fd75088 to 2147483648 {{(pid=73792) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}}
Apr 12 06:46:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7415845c-f8ed-4e13-bd8d-dea1e35ea431 tempest-VolumesExtendTest-2061027765 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7415845c-f8ed-4e13-bd8d-dea1e35ea431 tempest-VolumesExtendTest-2061027765 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7415845c-f8ed-4e13-bd8d-dea1e35ea431 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:42 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7415845c-f8ed-4e13-bd8d-dea1e35ea431 tempest-VolumesExtendTest-2061027765 None] Extend volume completed successfully.
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Acquiring lock "cinder-35202c96-2dc3-4cfb-9119-f52c33a77f21-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Lock "cinder-35202c96-2dc3-4cfb-9119-f52c33a77f21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] deleating snapshot s_35202c96-2dc3-4cfb-9119-f52c33a77f21. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] get snapshots for volume s_35202c96-2dc3-4cfb-9119-f52c33a77f21  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_35202c96-2dc3-4cfb-9119-f52c33a77f21/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_35202c96-2dc3-4cfb-9119-f52c33a77f21/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_35202c96-2dc3-4cfb-9119-f52c33a77f21/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] get volume s_35202c96-2dc3-4cfb-9119-f52c33a77f21 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_35202c96-2dc3-4cfb-9119-f52c33a77f21 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_35202c96-2dc3-4cfb-9119-f52c33a77f21 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_60a3ac69-9753-4731-b6fc-42927fd75088@s_35202c96-2dc3-4cfb-9119-f52c33a77f21', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_35202c96-2dc3-4cfb-9119-f52c33a77f21', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283418', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60979', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11674919641665967259', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5f07f450ee435567', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763898880', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38595', 'name': 's_35202c96-2dc3-4cfb-9119-f52c33a77f21', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_35202c96-2dc3-4cfb-9119-f52c33a77f21 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] delete snapshot s_35202c96-2dc3-4cfb-9119-f52c33a77f21 of volume v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088/snapshots/s_35202c96-2dc3-4cfb-9119-f52c33a77f21 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088/snapshots/s_35202c96-2dc3-4cfb-9119-f52c33a77f21 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088/snapshots/s_35202c96-2dc3-4cfb-9119-f52c33a77f21 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] snapshot s_35202c96-2dc3-4cfb-9119-f52c33a77f21 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:46:44 user cinder-volume[73792]: DEBUG cinder.quota [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Created reservations ['22039559-97ea-4873-83ec-07077fe04543', '29959a7a-4400-4bd2-8f07-bf3a00199c3d', '1434ddc4-0137-4a94-b38d-dc4cad21d8d4', '83baf189-3165-4750-aeb9-c93d11853fd2'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:44 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Delete snapshot completed successfully.
Apr 12 06:46:44 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7fa07625-3948-48a9-a994-be90af754bc7 tempest-VolumesExtendTest-2061027765 None] Lock "cinder-35202c96-2dc3-4cfb-9119-f52c33a77f21-delete_snapshot" released by "delete_snapshot" :: held 1.243s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Acquiring lock "cinder-60a3ac69-9753-4731-b6fc-42927fd75088-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Lock "cinder-60a3ac69-9753-4731-b6fc-42927fd75088-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] remove_export for volume: 60a3ac69-9753-4731-b6fc-42927fd75088. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1148003203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=60a3ac69-9753-4731-b6fc-42927fd75088,launched_at=2023-04-12T06:46:40Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='f031a9b772094dcc96883f448d418344',provider_auth='CHAP wlZOHgKd BN7wblKOZoUtcE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:40Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:46Z,updated_at=2023-04-12T06:46:46Z,use_quota=True,user_id='b00e1b0aded8436d849dc4089ae96fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] detach volume v_60a3ac69-9753-4731-b6fc-42927fd75088 from target iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088/luns/v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088/luns/v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088/luns/v_60a3ac69-9753-4731-b6fc-42927fd75088'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088/luns/v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] failed to remove resource iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 because of JDSS resource v_60a3ac69-9753-4731-b6fc-42927fd75088 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] delete target: iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] delete target iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] failed to remove resource iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 because of JDSS resource iqn.2010-10.org.openstack:60a3ac69-9753-4731-b6fc-42927fd75088 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] deleating volume v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] get snapshots for volume v_60a3ac69-9753-4731-b6fc-42927fd75088  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] get volume v_60a3ac69-9753-4731-b6fc-42927fd75088 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_60a3ac69-9753-4731-b6fc-42927fd75088', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283417', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60973', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7101970244767133399', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '11ac0b8b879f9c8a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763943936', 'san:volume_id': '11ac0b8b879f9c8a471623f7f25e67433770fe77', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39286', 'name': 'v_60a3ac69-9753-4731-b6fc-42927fd75088', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] delete volume:v_60a3ac69-9753-4731-b6fc-42927fd75088 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60a3ac69-9753-4731-b6fc-42927fd75088 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] volume v_60a3ac69-9753-4731-b6fc-42927fd75088 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:46:46 user cinder-volume[73792]: DEBUG cinder.quota [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Created reservations ['89e33849-8ebf-4ecb-a7b8-65c413a4122d', '658fa431-3900-4131-bba0-0cc808fd1413', 'b08812ac-0924-4ff3-a316-bf54395c4171', '00bd919d-1aaa-4a25-9c3f-6703736cc9bf'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:46 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=60,cinder:INSERT=12,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:46:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764025856', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:47 user cinder-volume[73792]: DEBUG cinder.manager [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:47 user cinder-volume[73792]: INFO cinder.volume.manager [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Deleted volume successfully.
Apr 12 06:46:47 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f4327939-4823-4b0b-acab-4a6fc8e4710c tempest-VolumesExtendTest-2061027765 None] Lock "cinder-60a3ac69-9753-4731-b6fc-42927fd75088-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:51 user cinder-volume[73792]: INFO cinder.action_track [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1303147822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=82f2eeb4-dc21-4cef-b208-ca62e4284bc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31febc55693d48a08f6aba42cda528fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='25c904f58bd44ac78b6248a321da2cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:51 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Flow 'volume_create_manager' (818f0c6e-e0b9-4b4c-83ad-882e63742e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ad433b-d593-4d75-9131-514f30c36132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=51,cinder:INSERT=9,cinder:UPDATE=36,cinder:DELETE=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ad433b-d593-4d75-9131-514f30c36132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1303147822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=82f2eeb4-dc21-4cef-b208-ca62e4284bc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31febc55693d48a08f6aba42cda528fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:52Z,use_quota=True,user_id='25c904f58bd44ac78b6248a321da2cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f9081e-0c37-495c-9601-d6e9c3ed6e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f9081e-0c37-495c-9601-d6e9c3ed6e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794d64f0-291d-4eb0-9533-fac1b31567cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794d64f0-291d-4eb0-9533-fac1b31567cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f2eeb4-dc21-4cef-b208-ca62e4284bc9', 'volume_name': 'volume-82f2eeb4-dc21-4cef-b208-ca62e4284bc9', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1862fa75-ee0c-488a-ac3a-9666a2b49807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1862fa75-ee0c-488a-ac3a-9666a2b49807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db58527-c805-4530-9b82-97eb0201d255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:52 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Volume 82f2eeb4-dc21-4cef-b208-ca62e4284bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f2eeb4-dc21-4cef-b208-ca62e4284bc9', 'volume_size': 1}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] creating volume v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] create volume {'name': 'v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9', 'is_clone': False, 'name': 'v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db58527-c805-4530-9b82-97eb0201d255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f2eeb4-dc21-4cef-b208-ca62e4284bc9', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82dc54e7-eaad-4c8d-ba87-14d89b234e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:52 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Volume volume-82f2eeb4-dc21-4cef-b208-ca62e4284bc9 (82f2eeb4-dc21-4cef-b208-ca62e4284bc9): created successfully
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82dc54e7-eaad-4c8d-ba87-14d89b234e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] Flow 'volume_create_manager' (818f0c6e-e0b9-4b4c-83ad-882e63742e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:52 user cinder-volume[73792]: INFO cinder.action_track [None req-a3c57cb9-fb88-4308-89b6-9b9e691d4fa1 tempest-VolumesTestJSON-1073101300 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1303147822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=82f2eeb4-dc21-4cef-b208-ca62e4284bc9,launched_at=2023-04-12T06:46:52Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31febc55693d48a08f6aba42cda528fa',provider_auth='CHAP RQTcxPXq k96ovcXHKALu2T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:46:52Z,use_quota=True,user_id='25c904f58bd44ac78b6248a321da2cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:53 user cinder-volume[73792]: INFO cinder.action_track [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1660013515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31febc55693d48a08f6aba42cda528fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='25c904f58bd44ac78b6248a321da2cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Flow 'volume_create_manager' (9ebdb587-e7d6-44e9-9c0a-bda7122a6e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4420f8b5-24fe-4618-a682-b3193576a0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4420f8b5-24fe-4618-a682-b3193576a0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1660013515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31febc55693d48a08f6aba42cda528fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:53Z,use_quota=True,user_id='25c904f58bd44ac78b6248a321da2cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226b9548-b158-41fb-a159-481bc782bbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226b9548-b158-41fb-a159-481bc782bbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22a5794-4f5f-464e-b1d9-cfd0c735b711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22a5794-4f5f-464e-b1d9-cfd0c735b711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555', 'volume_name': 'volume-f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6135374-f9a7-4227-8a1e-e3b8a3a32834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6135374-f9a7-4227-8a1e-e3b8a3a32834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3dea04-81bc-44cd-a92b-d76c924c1077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:53 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Volume f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555', 'volume_size': 1}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] creating volume v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] create volume {'name': 'v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555', 'is_clone': False, 'name': 'v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3dea04-81bc-44cd-a92b-d76c924c1077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46778051-9ef1-48f1-b042-84ceb493b4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:53 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Volume volume-f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 (f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555): created successfully
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46778051-9ef1-48f1-b042-84ceb493b4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:53 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] Flow 'volume_create_manager' (9ebdb587-e7d6-44e9-9c0a-bda7122a6e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:53 user cinder-volume[73792]: INFO cinder.action_track [None req-4504f541-6d9a-4b39-be02-700d9ee868de tempest-VolumesTestJSON-1073101300 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1660013515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555,launched_at=2023-04-12T06:46:53Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31febc55693d48a08f6aba42cda528fa',provider_auth='CHAP PTVuFKps u1y7XBfwjvPr5Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:53Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:46:53Z,use_quota=True,user_id='25c904f58bd44ac78b6248a321da2cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:54 user cinder-volume[73792]: INFO cinder.action_track [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1320123841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=83bcd90e-163c-401e-8582-c288f038ea64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31febc55693d48a08f6aba42cda528fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='25c904f58bd44ac78b6248a321da2cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Flow 'volume_create_manager' (792345f6-5bce-4374-af3f-cb117628fcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d7f359-f4f1-4eec-b936-7ff3fdf1ba78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d7f359-f4f1-4eec-b936-7ff3fdf1ba78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1320123841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=83bcd90e-163c-401e-8582-c288f038ea64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31febc55693d48a08f6aba42cda528fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:46:55Z,use_quota=True,user_id='25c904f58bd44ac78b6248a321da2cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6294aa1e-ab11-46c8-9b97-2f8db01a9d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6294aa1e-ab11-46c8-9b97-2f8db01a9d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d96d94-2cca-4c7c-aa0c-eb92c597b98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d96d94-2cca-4c7c-aa0c-eb92c597b98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83bcd90e-163c-401e-8582-c288f038ea64', 'volume_name': 'volume-83bcd90e-163c-401e-8582-c288f038ea64', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9629e97-b311-4778-bf29-5cc3c689b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9629e97-b311-4778-bf29-5cc3c689b496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f13bf3e-58ed-44bd-90da-8c9007a6f573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:54 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Volume 83bcd90e-163c-401e-8582-c288f038ea64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83bcd90e-163c-401e-8582-c288f038ea64', 'volume_size': 1}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] creating volume v_83bcd90e-163c-401e-8582-c288f038ea64. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] create volume {'name': 'v_83bcd90e-163c-401e-8582-c288f038ea64', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_83bcd90e-163c-401e-8582-c288f038ea64', 'is_clone': False, 'name': 'v_83bcd90e-163c-401e-8582-c288f038ea64'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f13bf3e-58ed-44bd-90da-8c9007a6f573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83bcd90e-163c-401e-8582-c288f038ea64', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cc4d7f-7c1b-480f-a790-1f3690e82d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:46:55 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Volume volume-83bcd90e-163c-401e-8582-c288f038ea64 (83bcd90e-163c-401e-8582-c288f038ea64): created successfully
Apr 12 06:46:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cc4d7f-7c1b-480f-a790-1f3690e82d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:46:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] Flow 'volume_create_manager' (792345f6-5bce-4374-af3f-cb117628fcb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:46:55 user cinder-volume[73792]: INFO cinder.action_track [None req-99c5f49b-a22d-4204-a347-5a9a48f2f588 tempest-VolumesTestJSON-1073101300 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1320123841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=83bcd90e-163c-401e-8582-c288f038ea64,launched_at=2023-04-12T06:46:55Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31febc55693d48a08f6aba42cda528fa',provider_auth='CHAP mcePtknK evn15o9UfPzabj',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:55Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:46:55Z,use_quota=True,user_id='25c904f58bd44ac78b6248a321da2cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Acquiring lock "cinder-83bcd90e-163c-401e-8582-c288f038ea64-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Lock "cinder-83bcd90e-163c-401e-8582-c288f038ea64-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] remove_export for volume: 83bcd90e-163c-401e-8582-c288f038ea64. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1320123841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=83bcd90e-163c-401e-8582-c288f038ea64,launched_at=2023-04-12T06:46:55Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31febc55693d48a08f6aba42cda528fa',provider_auth='CHAP mcePtknK evn15o9UfPzabj',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:55Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:57Z,updated_at=2023-04-12T06:46:57Z,use_quota=True,user_id='25c904f58bd44ac78b6248a321da2cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] detach volume v_83bcd90e-163c-401e-8582-c288f038ea64 from target iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64/luns/v_83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64/luns/v_83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64/luns/v_83bcd90e-163c-401e-8582-c288f038ea64'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64/luns/v_83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] failed to remove resource iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 because of JDSS resource v_83bcd90e-163c-401e-8582-c288f038ea64 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] delete target: iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] delete target iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] failed to remove resource iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 because of JDSS resource iqn.2010-10.org.openstack:83bcd90e-163c-401e-8582-c288f038ea64 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] deleating volume v_83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] get snapshots for volume v_83bcd90e-163c-401e-8582-c288f038ea64  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_83bcd90e-163c-401e-8582-c288f038ea64/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_83bcd90e-163c-401e-8582-c288f038ea64/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_83bcd90e-163c-401e-8582-c288f038ea64/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] get volume v_83bcd90e-163c-401e-8582-c288f038ea64 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_83bcd90e-163c-401e-8582-c288f038ea64', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283432', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60999', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5785671046792027983', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9a7cde82bbb10700', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763755520', 'san:volume_id': '9a7cde82bbb107001e85fd0d8604e4ef6ae8da6a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37759', 'name': 'v_83bcd90e-163c-401e-8582-c288f038ea64', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] delete volume:v_83bcd90e-163c-401e-8582-c288f038ea64 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:46:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_83bcd90e-163c-401e-8582-c288f038ea64 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] volume v_83bcd90e-163c-401e-8582-c288f038ea64 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:46:58 user cinder-volume[73792]: DEBUG cinder.quota [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Created reservations ['7bd37c99-5e49-4e9f-a4c6-70f9c92e7dd6', 'b072e69a-7b9e-4755-9bd8-f8f191278a16', '0661cea1-0e8e-4692-8a0a-d92508827310', 'baa5fd7b-26ee-4fea-bd4a-7c972fe8ee98'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:46:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:46:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:46:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763837440', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:58 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:46:58 user cinder-volume[73792]: DEBUG cinder.manager [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:46:58 user cinder-volume[73792]: INFO cinder.volume.manager [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Deleted volume successfully.
Apr 12 06:46:58 user cinder-volume[73792]: DEBUG cinder.coordination [None req-f21ee7a6-abf5-4665-a1ca-39b66fb7737a tempest-VolumesTestJSON-1073101300 None] Lock "cinder-83bcd90e-163c-401e-8582-c288f038ea64-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.coordination [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Acquiring lock "cinder-f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.coordination [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Lock "cinder-f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] remove_export for volume: f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1660013515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555,launched_at=2023-04-12T06:46:54Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31febc55693d48a08f6aba42cda528fa',provider_auth='CHAP PTVuFKps u1y7XBfwjvPr5Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:53Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:46:59Z,updated_at=2023-04-12T06:46:59Z,use_quota=True,user_id='25c904f58bd44ac78b6248a321da2cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] detach volume v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 from target iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555/luns/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555/luns/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555/luns/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555/luns/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] failed to remove resource iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 because of JDSS resource v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] delete target: iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] delete target iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] failed to remove resource iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 because of JDSS resource iqn.2010-10.org.openstack:f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] deleating volume v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] get snapshots for volume v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] get volume v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283430', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60995', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8533556337429510574', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9d3d0a7c65be7cb4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763837440', 'san:volume_id': '9d3d0a7c65be7cb4176936934de65b769c93d0dc', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37750', 'name': 'v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] delete volume:v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:46:59 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] volume v_f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:47:00 user cinder-volume[73792]: DEBUG cinder.quota [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Created reservations ['e065c2db-76b7-478f-84ff-f11c3370e923', '474eb943-969d-4091-9fa0-3f8e4f6dd642', '5460edf4-04a5-4dd2-808f-5eee2e982f7e', 'f269a9c9-745e-43d6-8e8f-2aaadb8a5472'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:47:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:47:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:47:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763919360', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.manager [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:47:01 user cinder-volume[73792]: INFO cinder.volume.manager [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Deleted volume successfully.
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.coordination [None req-987dc37f-ba96-4964-8778-74d11bbc5aa8 tempest-VolumesTestJSON-1073101300 None] Lock "cinder-f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Acquiring lock "cinder-82f2eeb4-dc21-4cef-b208-ca62e4284bc9-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Lock "cinder-82f2eeb4-dc21-4cef-b208-ca62e4284bc9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] remove_export for volume: 82f2eeb4-dc21-4cef-b208-ca62e4284bc9. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1303147822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=82f2eeb4-dc21-4cef-b208-ca62e4284bc9,launched_at=2023-04-12T06:46:53Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31febc55693d48a08f6aba42cda528fa',provider_auth='CHAP RQTcxPXq k96ovcXHKALu2T',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:52Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:47:01Z,updated_at=2023-04-12T06:47:01Z,use_quota=True,user_id='25c904f58bd44ac78b6248a321da2cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] detach volume v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 from target iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9/luns/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9/luns/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9/luns/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9/luns/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] failed to remove resource iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 because of JDSS resource v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] delete target: iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] delete target iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] failed to remove resource iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 because of JDSS resource iqn.2010-10.org.openstack:82f2eeb4-dc21-4cef-b208-ca62e4284bc9 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] deleating volume v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] get snapshots for volume v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] get volume v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283429', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60991', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1115161743597079459', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6727ef014f62c754', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763919360', 'san:volume_id': '6727ef014f62c754c13d67e3704dc162a75155dd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38256', 'name': 'v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] delete volume:v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] volume v_82f2eeb4-dc21-4cef-b208-ca62e4284bc9 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:47:02 user cinder-volume[73792]: DEBUG cinder.quota [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Created reservations ['c3c26d0d-fd97-41cc-a06c-3a94177a053c', 'd31cac34-65bc-4d34-8cef-20135c82e130', '9cc565c8-18d1-4492-b37b-acf107b6878a', '92c8e7ad-07fd-4b43-a1d6-a5900ecce692'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:47:02 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=52,cinder:UPDATE=38,cinder:DELETE=2,cinder:INSERT=8 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:47:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:47:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:47:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764001280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:47:03 user cinder-volume[73792]: DEBUG cinder.manager [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:47:03 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Deleted volume successfully.
Apr 12 06:47:03 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a09e49e5-1b0e-44e5-abe2-c78cda893a54 tempest-VolumesTestJSON-1073101300 None] Lock "cinder-82f2eeb4-dc21-4cef-b208-ca62e4284bc9-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:47:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7e3cc1f8-5a5b-4b21-af3c-5a05d7b36050 tempest-BackendsCapabilitiesAdminTestsJSON-316159665 None] Obtained capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73792) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4815}}
Apr 12 06:47:05 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d61e3a44-961a-46dd-a239-8e4bd055b08a tempest-BackendsCapabilitiesAdminTestsJSON-316159665 None] Obtained capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73792) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4815}}
Apr 12 06:47:12 user cinder-volume[73792]: INFO cinder.action_track [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1481584220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,launched_at=2023-04-12T06:42:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP zodFkufL JDsnwSP6ObUd9Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:47:12Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:47:12 user cinder-volume[73792]: INFO cinder.action_track [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1481584220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,launched_at=2023-04-12T06:42:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP zodFkufL JDsnwSP6ObUd9Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:47:12Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] create export for volume: 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] ensure volume 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] check if targe iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:12 user cinder-volume[73792]: INFO cinder.action_track [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2019281400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3806cd47-94df-4f4f-b8ac-7f358d589bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d12ad460cad4a138fb18eea0990bf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='d9469175513d4232a26ee898ea19c58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Flow 'volume_create_manager' (45fecd5d-fe0b-4850-ab28-ff1bb0fdbd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60c052c-ce7d-4cff-8d90-6bb12fb2db77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] create target and attach volume 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] create target iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60c052c-ce7d-4cff-8d90-6bb12fb2db77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2019281400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3806cd47-94df-4f4f-b8ac-7f358d589bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d12ad460cad4a138fb18eea0990bf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:47:12Z,use_quota=True,user_id='d9469175513d4232a26ee898ea19c58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb48f08-911b-44c5-b993-a6aa3ab479bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb48f08-911b-44c5-b993-a6aa3ab479bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298daf4e-b17c-4091-abeb-728b42a3c27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298daf4e-b17c-4091-abeb-728b42a3c27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3806cd47-94df-4f4f-b8ac-7f358d589bf1', 'volume_name': 'volume-3806cd47-94df-4f4f-b8ac-7f358d589bf1', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae417cfa-dc07-48a6-902b-771076ed6c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae417cfa-dc07-48a6-902b-771076ed6c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f78418-e2b1-426c-ab92-77c488b2c4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:47:12 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Volume 3806cd47-94df-4f4f-b8ac-7f358d589bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3806cd47-94df-4f4f-b8ac-7f358d589bf1', 'volume_size': 1}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] creating volume v_3806cd47-94df-4f4f-b8ac-7f358d589bf1. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] create volume {'name': 'v_3806cd47-94df-4f4f-b8ac-7f358d589bf1', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1', 'is_clone': False, 'name': 'v_3806cd47-94df-4f4f-b8ac-7f358d589bf1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f78418-e2b1-426c-ab92-77c488b2c4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3806cd47-94df-4f4f-b8ac-7f358d589bf1', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:47:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c606ba1-ab20-461a-b92b-7ba8c25a0177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:47:13 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Volume volume-3806cd47-94df-4f4f-b8ac-7f358d589bf1 (3806cd47-94df-4f4f-b8ac-7f358d589bf1): created successfully
Apr 12 06:47:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c606ba1-ab20-461a-b92b-7ba8c25a0177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:47:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Flow 'volume_create_manager' (45fecd5d-fe0b-4850-ab28-ff1bb0fdbd89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:47:13 user cinder-volume[73792]: INFO cinder.action_track [None req-4f8d89cd-68d8-4d75-9df4-4cdd1ec3d494 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2019281400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3806cd47-94df-4f4f-b8ac-7f358d589bf1,launched_at=2023-04-12T06:47:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d12ad460cad4a138fb18eea0990bf50',provider_auth='CHAP KIgFjNsi 3bJAhVrYlxGa4e',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:47:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:47:12Z,use_quota=True,user_id='d9469175513d4232a26ee898ea19c58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:47:13 user cinder-volume[73792]: INFO cinder.action_track [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Snapshot-898999312',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=b8469d65-0eeb-447c-9c1d-e1a13db8dcb2,metadata={},progress='0%',project_id='2d12ad460cad4a138fb18eea0990bf50',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='d9469175513d4232a26ee898ea19c58e',volume=<?>,volume_id=3806cd47-94df-4f4f-b8ac-7f358d589bf1,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:47:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] create snapshot b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 for volume 3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:47:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] cloning v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 to s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:47:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] create snapshot s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:47:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] create volume s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 from snapshot s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:47:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1@s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2', 'is_clone': True, 'full_name': 'Pool-0/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2', 'name': 's_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] volume s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:47:14 user cinder-volume[73792]: INFO cinder.volume.manager [None req-817e544d-953f-4eca-8b98-cfc1ada7cbaf tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Create snapshot completed successfully
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] atach volume v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 to target iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.coordination [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Acquiring lock "cinder-b8469d65-0eeb-447c-9c1d-e1a13db8dcb2-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.coordination [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Lock "cinder-b8469d65-0eeb-447c-9c1d-e1a13db8dcb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] deleating snapshot s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] get snapshots for volume s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] get volume s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1@s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283451', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61014', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16065810352700950312', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2520389c50f3041f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763894784', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39324', 'name': 's_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] delete snapshot s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 of volume v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1/snapshots/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1/snapshots/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3535656430653363', 'lun': 0, 'mode': 'wt', 'name': 'v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'prod_id': 'Storage', 'scsi_id': '55ed0e3c681b8098'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] add credentails to target iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:47:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1/snapshots/s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] snapshot s_b8469d65-0eeb-447c-9c1d-e1a13db8dcb2 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:47:16 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=63,cinder:UPDATE=28,cinder:DELETE=5,cinder:INSERT=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:47:16 user cinder-volume[73792]: DEBUG cinder.quota [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Created reservations ['1295f4f0-8ff0-4576-9838-463faee971e4', '6114f1ed-4c55-42ff-baf2-10a99c82a9ae', '37ec5595-b3fd-4f6c-893c-298e3be85fe8', '18e17338-2e4b-4dcf-b2c6-2f575c5fe539'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:47:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': {'name': 'zodFkufL'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] initialize_connection for 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:47:16 user cinder-volume[73792]: INFO cinder.volume.manager [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Delete snapshot completed successfully.
Apr 12 06:47:16 user cinder-volume[73792]: DEBUG cinder.coordination [None req-04470919-8f1c-4c3a-b5c2-4c1f65819cef tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Lock "cinder-b8469d65-0eeb-447c-9c1d-e1a13db8dcb2-delete_snapshot" released by "delete_snapshot" :: held 1.180s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:47:16 user cinder-volume[73792]: INFO cinder.action_track [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zodFkufL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'ff4523fc-5bea-495f-b3e4-f8d215954385'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1481584220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,launched_at=2023-04-12T06:42:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP zodFkufL JDsnwSP6ObUd9Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:47:12Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:47:16 user cinder-volume[73792]: INFO cinder.action_track [req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d req-2c472420-49d0-453d-9828-376c84c83b98 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1481584220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,launched_at=2023-04-12T06:42:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP zodFkufL JDsnwSP6ObUd9Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:47:16Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Acquiring lock "cinder-3806cd47-94df-4f4f-b8ac-7f358d589bf1-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Lock "cinder-3806cd47-94df-4f4f-b8ac-7f358d589bf1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] remove_export for volume: 3806cd47-94df-4f4f-b8ac-7f358d589bf1. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2019281400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3806cd47-94df-4f4f-b8ac-7f358d589bf1,launched_at=2023-04-12T06:47:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d12ad460cad4a138fb18eea0990bf50',provider_auth='CHAP KIgFjNsi 3bJAhVrYlxGa4e',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:47:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:47:17Z,updated_at=2023-04-12T06:47:17Z,use_quota=True,user_id='d9469175513d4232a26ee898ea19c58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] detach volume v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 from target iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1/luns/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1/luns/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1/luns/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1/luns/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] failed to remove resource iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 because of JDSS resource v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] delete target: iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] delete target iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] failed to remove resource iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 because of JDSS resource iqn.2010-10.org.openstack:3806cd47-94df-4f4f-b8ac-7f358d589bf1 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] deleating volume v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] get snapshots for volume v_3806cd47-94df-4f4f-b8ac-7f358d589bf1  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] get volume v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283450', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61008', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2441492462427856150', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a191a91c73355551', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763919360', 'san:volume_id': 'a191a91c73355551881113bc71cc5c38d226c1aa', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39311', 'name': 'v_3806cd47-94df-4f4f-b8ac-7f358d589bf1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] delete volume:v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] volume v_3806cd47-94df-4f4f-b8ac-7f358d589bf1 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:47:18 user cinder-volume[73792]: DEBUG cinder.quota [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Created reservations ['d35105c8-ab19-4413-b52a-995e2c8e3c28', '433a5683-48ba-4129-bb15-fd82549c9351', '468acaf6-80c6-4e85-b103-b6023bf06142', '008e2d4e-f4ff-4e06-90d1-75ee09eba9ea'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:47:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:47:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:47:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764013568', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:47:19 user cinder-volume[73792]: DEBUG cinder.manager [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:47:19 user cinder-volume[73792]: INFO cinder.volume.manager [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Deleted volume successfully.
Apr 12 06:47:19 user cinder-volume[73792]: DEBUG cinder.coordination [None req-59620f03-c44d-4a79-83ed-8be1e41313d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-100397236 None] Lock "cinder-3806cd47-94df-4f4f-b8ac-7f358d589bf1-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:47:19 user cinder-volume[73792]: INFO cinder.action_track [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Snapshot-113518649',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1,metadata={},progress='0%',project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume=<?>,volume_id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:47:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 for volume 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:47:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] cloning v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 to s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:47:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:47:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] create volume s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 from snapshot s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:47:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0@s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1', 'is_clone': True, 'full_name': 'Pool-0/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1', 'name': 's_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] volume s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:47:20 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7cec053e-0cfe-46cd-bf51-f13a7b9ddac3 tempest-VolumesSnapshotTestJSON-2015355536 None] Create snapshot completed successfully
Apr 12 06:47:22 user cinder-volume[73792]: INFO cinder.action_track [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Snapshot-408803525',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=5c410e73-bace-45dc-ae05-58968e989d0f,metadata={},progress='0%',project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume=<?>,volume_id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot 5c410e73-bace-45dc-ae05-58968e989d0f for volume 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] cloning v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 to s_5c410e73-bace-45dc-ae05-58968e989d0f {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot s_5c410e73-bace-45dc-ae05-58968e989d0f {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_5c410e73-bace-45dc-ae05-58968e989d0f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] create volume s_5c410e73-bace-45dc-ae05-58968e989d0f from snapshot s_5c410e73-bace-45dc-ae05-58968e989d0f {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0@s_5c410e73-bace-45dc-ae05-58968e989d0f', 'is_clone': True, 'full_name': 'Pool-0/s_5c410e73-bace-45dc-ae05-58968e989d0f', 'name': 's_5c410e73-bace-45dc-ae05-58968e989d0f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5c410e73-bace-45dc-ae05-58968e989d0f/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5c410e73-bace-45dc-ae05-58968e989d0f/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5c410e73-bace-45dc-ae05-58968e989d0f/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] volume s_5c410e73-bace-45dc-ae05-58968e989d0f properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:47:22 user cinder-volume[73792]: INFO cinder.volume.manager [None req-fa21117a-2186-4161-be0e-6f056d583904 tempest-VolumesSnapshotTestJSON-2015355536 None] Create snapshot completed successfully
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-5c410e73-bace-45dc-ae05-58968e989d0f-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-5c410e73-bace-45dc-ae05-58968e989d0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] deleating snapshot s_5c410e73-bace-45dc-ae05-58968e989d0f. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume s_5c410e73-bace-45dc-ae05-58968e989d0f  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5c410e73-bace-45dc-ae05-58968e989d0f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5c410e73-bace-45dc-ae05-58968e989d0f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5c410e73-bace-45dc-ae05-58968e989d0f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] get volume s_5c410e73-bace-45dc-ae05-58968e989d0f info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5c410e73-bace-45dc-ae05-58968e989d0f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5c410e73-bace-45dc-ae05-58968e989d0f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0@s_5c410e73-bace-45dc-ae05-58968e989d0f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_5c410e73-bace-45dc-ae05-58968e989d0f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283459', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61035', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12692872363484307226', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fdaf919d11deb14d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763964416', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39427', 'name': 's_5c410e73-bace-45dc-ae05-58968e989d0f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5c410e73-bace-45dc-ae05-58968e989d0f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] delete snapshot s_5c410e73-bace-45dc-ae05-58968e989d0f of volume v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots/s_5c410e73-bace-45dc-ae05-58968e989d0f {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots/s_5c410e73-bace-45dc-ae05-58968e989d0f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots/s_5c410e73-bace-45dc-ae05-58968e989d0f {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] snapshot s_5c410e73-bace-45dc-ae05-58968e989d0f deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.quota [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['9b1bbec7-0ec8-492e-964d-fca4bc7bb8d2', '5ddb136b-d6f0-4001-952d-5efa226158b6', '1c459066-28a6-4d8a-b827-fcaf6105580e', 'c6dfb472-22d3-4abc-a39a-6f88a1834fa8'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=66,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=8 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:47:24 user cinder-volume[73792]: INFO cinder.volume.manager [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Delete snapshot completed successfully.
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3990661f-e521-4769-895d-57c546d091c3 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-5c410e73-bace-45dc-ae05-58968e989d0f-delete_snapshot" released by "delete_snapshot" :: held 1.123s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-630c24df-ec85-47d4-be6c-bf0c28ddc742-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-630c24df-ec85-47d4-be6c-bf0c28ddc742-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] deleating snapshot s_630c24df-ec85-47d4-be6c-bf0c28ddc742. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume s_630c24df-ec85-47d4-be6c-bf0c28ddc742  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_630c24df-ec85-47d4-be6c-bf0c28ddc742/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_630c24df-ec85-47d4-be6c-bf0c28ddc742/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_630c24df-ec85-47d4-be6c-bf0c28ddc742/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] get volume s_630c24df-ec85-47d4-be6c-bf0c28ddc742 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_630c24df-ec85-47d4-be6c-bf0c28ddc742 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_630c24df-ec85-47d4-be6c-bf0c28ddc742 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0@s_630c24df-ec85-47d4-be6c-bf0c28ddc742', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_630c24df-ec85-47d4-be6c-bf0c28ddc742', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283337', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60856', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17559367428671997011', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ee916c7a3aa6ed0e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763976704', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '37575', 'name': 's_630c24df-ec85-47d4-be6c-bf0c28ddc742', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_630c24df-ec85-47d4-be6c-bf0c28ddc742 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] delete snapshot s_630c24df-ec85-47d4-be6c-bf0c28ddc742 of volume v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots/s_630c24df-ec85-47d4-be6c-bf0c28ddc742 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots/s_630c24df-ec85-47d4-be6c-bf0c28ddc742 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots/s_630c24df-ec85-47d4-be6c-bf0c28ddc742 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] snapshot s_630c24df-ec85-47d4-be6c-bf0c28ddc742 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:47:25 user cinder-volume[73792]: DEBUG cinder.quota [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['2c73b65a-1b57-4729-8e7a-d56fff1601ab', '9a661049-9a7a-4f69-bd00-3f902c9c9bcd', '6521e0bd-d3d4-4aae-8b4e-2e838932b413', '0c3d41dd-ebc0-43c4-a234-afdbfa39dbf8'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:47:25 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Delete snapshot completed successfully.
Apr 12 06:47:25 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c95bd311-76fc-41a9-826d-e2a549403d57 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-630c24df-ec85-47d4-be6c-bf0c28ddc742-delete_snapshot" released by "delete_snapshot" :: held 1.294s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] deleating snapshot s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] get volume s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0@s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283457', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61029', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16514797399690763387', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '97c56154c8a3c7ae', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763988992', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38010', 'name': 's_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] delete snapshot s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 of volume v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots/s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] snapshot s_fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:47:27 user cinder-volume[73792]: DEBUG cinder.quota [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['5ca53b7c-50dd-4629-94e3-3d65f2d6fa67', '4d60d475-01a5-4e80-9c52-916af2ac1713', '207576f1-369a-4d6c-9be0-03154a485356', 'b40a32a1-b793-4bcd-b6e4-33b6855c9419'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:47:27 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=30,cinder:SELECT=60,cinder:INSERT=8,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:47:27 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Delete snapshot completed successfully.
Apr 12 06:47:27 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a486dd3b-24c8-439c-b481-6107289bee1d tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-fa4e5b53-904d-4cf5-aa1e-733c0bcf82e1-delete_snapshot" released by "delete_snapshot" :: held 1.134s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:47:30 user cinder-volume[73792]: INFO cinder.action_track [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1481584220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,launched_at=2023-04-12T06:42:10Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP zodFkufL JDsnwSP6ObUd9Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:47:29Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] terminate connection for 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:47:30 user cinder-volume[73792]: INFO cinder.action_track [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1481584220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,launched_at=2023-04-12T06:42:10Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP zodFkufL JDsnwSP6ObUd9Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:47:29Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] Deleting attachment ff4523fc-5bea-495f-b3e4-f8d215954385. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] remove_export for volume: 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1481584220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,launched_at=2023-04-12T06:42:10Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP zodFkufL JDsnwSP6ObUd9Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:47:29Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 from target iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/luns/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/luns/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/luns/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] delete target: iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] delete target iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-78979514-82af-48bc-af84-1e6996d54551 req-667dc324-9cae-4073-a6a6-b027cae9a32b tempest-VolumesSnapshotTestJSON-2015355536 None] target iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114764013568', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:47:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:47:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=18,cinder:SELECT=18,cinder:INSERT=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:48:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:48:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:48:19 user cinder-volume[73792]: INFO cinder.action_track [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1300384984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f07e5b2d-dd0d-47a6-88e4-0d220a4ca930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:48:19 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:48:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Flow 'volume_create_manager' (242698a0-1d17-442c-bfb7-24124b0e6ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:48:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ed3fb3-e4e1-4edf-af6e-9b6b2bef1222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ed3fb3-e4e1-4edf-af6e-9b6b2bef1222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1300384984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f07e5b2d-dd0d-47a6-88e4-0d220a4ca930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:48:20Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9525f67-b4cb-449c-b50a-caa8f0dd70eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9525f67-b4cb-449c-b50a-caa8f0dd70eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60addcc6-bec2-48f4-badc-c1f991d543d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60addcc6-bec2-48f4-badc-c1f991d543d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f07e5b2d-dd0d-47a6-88e4-0d220a4ca930', 'volume_name': 'volume-f07e5b2d-dd0d-47a6-88e4-0d220a4ca930', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c0a1ca-a292-4b7d-820c-d933d5a1ed4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c0a1ca-a292-4b7d-820c-d933d5a1ed4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e95363-05ae-45fe-b3ef-882c87704ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:20 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Volume f07e5b2d-dd0d-47a6-88e4-0d220a4ca930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f07e5b2d-dd0d-47a6-88e4-0d220a4ca930', 'volume_size': 1}
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] creating volume v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] create volume {'name': 'v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930', 'is_clone': False, 'name': 'v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e95363-05ae-45fe-b3ef-882c87704ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f07e5b2d-dd0d-47a6-88e4-0d220a4ca930', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1deaa83-a783-4ad7-afcd-9e81bd8479b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:20 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Volume volume-f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 (f07e5b2d-dd0d-47a6-88e4-0d220a4ca930): created successfully
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1deaa83-a783-4ad7-afcd-9e81bd8479b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] Flow 'volume_create_manager' (242698a0-1d17-442c-bfb7-24124b0e6ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:48:20 user cinder-volume[73792]: INFO cinder.action_track [None req-2a78c40d-03df-4704-b383-32716104f036 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1300384984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f07e5b2d-dd0d-47a6-88e4-0d220a4ca930,launched_at=2023-04-12T06:48:20Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP BtJHSbNA Qj75KRvbXPT1Ha',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:20Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:48:20Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:48:21 user cinder-volume[73792]: INFO cinder.action_track [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Snapshot-1089992884',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=22766a70-c7dd-4179-8464-627a49390f4a,metadata={},progress='0%',project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume=<?>,volume_id=f07e5b2d-dd0d-47a6-88e4-0d220a4ca930,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:48:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot 22766a70-c7dd-4179-8464-627a49390f4a for volume f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:48:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] cloning v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 to s_22766a70-c7dd-4179-8464-627a49390f4a {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:48:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot s_22766a70-c7dd-4179-8464-627a49390f4a {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:48:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_22766a70-c7dd-4179-8464-627a49390f4a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] create volume s_22766a70-c7dd-4179-8464-627a49390f4a from snapshot s_22766a70-c7dd-4179-8464-627a49390f4a {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:48:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930@s_22766a70-c7dd-4179-8464-627a49390f4a', 'is_clone': True, 'full_name': 'Pool-0/s_22766a70-c7dd-4179-8464-627a49390f4a', 'name': 's_22766a70-c7dd-4179-8464-627a49390f4a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] volume s_22766a70-c7dd-4179-8464-627a49390f4a properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:48:22 user cinder-volume[73792]: INFO cinder.volume.manager [None req-1f3c2bdd-369f-4982-b32b-d0f490431202 tempest-VolumesSnapshotTestJSON-2015355536 None] Create snapshot completed successfully
Apr 12 06:48:22 user cinder-volume[73792]: INFO cinder.action_track [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1071757185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=22766a70-c7dd-4179-8464-627a49390f4a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Flow 'volume_create_manager' (faeacb2d-ca5e-41c7-aacb-c7170e1a9d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db177333-6424-47af-9e1e-756f9d7313ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db177333-6424-47af-9e1e-756f9d7313ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1071757185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=22766a70-c7dd-4179-8464-627a49390f4a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:48:22Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dae55ba-0c08-4664-9e9f-c0202066ecde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dae55ba-0c08-4664-9e9f-c0202066ecde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb5eeb3-ebcc-4547-827f-9d8cce5c3a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb5eeb3-ebcc-4547-827f-9d8cce5c3a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad', 'volume_name': 'volume-433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad', 'volume_size': 2, 'snapshot_id': '22766a70-c7dd-4179-8464-627a49390f4a'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16c4927-a7e4-4ff5-a4a8-e3aea4b29e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16c4927-a7e4-4ff5-a4a8-e3aea4b29e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f045d4a-261a-43e4-b717-1610155975ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:22 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Volume 433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad', 'volume_size': 2, 'snapshot_id': '22766a70-c7dd-4179-8464-627a49390f4a'}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] create volume 433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad from snapshot 22766a70-c7dd-4179-8464-627a49390f4a {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] cloning s_22766a70-c7dd-4179-8464-627a49390f4a to v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] create volume v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad from snapshot v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_22766a70-c7dd-4179-8464-627a49390f4a@v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad', 'is_clone': True, 'full_name': 'Pool-0/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad', 'name': 'v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] get volume v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_22766a70-c7dd-4179-8464-627a49390f4a@v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283520', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61073', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16881032395394364378', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0264dc0f8b3008b6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763882496', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39351', 'name': 'v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Extend volume 433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] jdss extend volume v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad to 2147483648 {{(pid=73792) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f045d4a-261a-43e4-b717-1610155975ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad', 'volume_size': 2, 'snapshot_id': '22766a70-c7dd-4179-8464-627a49390f4a'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc145659-7840-46b6-a774-ab4d993a6ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:23 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Volume volume-433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad (433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad): created successfully
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc145659-7840-46b6-a774-ab4d993a6ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] Flow 'volume_create_manager' (faeacb2d-ca5e-41c7-aacb-c7170e1a9d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:48:23 user cinder-volume[73792]: INFO cinder.action_track [None req-5c1edb27-88bb-4d18-8e7f-70967b4adb6a tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1071757185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad,launched_at=2023-04-12T06:48:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP GkmqNQAw L6TgzmhGuaAR7c',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:22Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=2,snapshot_id=22766a70-c7dd-4179-8464-627a49390f4a,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:48:22Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] remove_export for volume: 433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1071757185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad,launched_at=2023-04-12T06:48:24Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP GkmqNQAw L6TgzmhGuaAR7c',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:22Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=2,snapshot_id=22766a70-c7dd-4179-8464-627a49390f4a,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:48:25Z,updated_at=2023-04-12T06:48:25Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad from target iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad/luns/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad/luns/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad/luns/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad/luns/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] failed to remove resource iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad because of JDSS resource v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] delete target: iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] delete target iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] failed to remove resource iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad because of JDSS resource iqn.2010-10.org.openstack:433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] deleating volume v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] get volume v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_22766a70-c7dd-4179-8464-627a49390f4a@v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283520', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61073', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16881032395394364378', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0264dc0f8b3008b6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763788288', 'san:volume_id': '0264dc0f8b3008b677af3aee83a11ae5d62ad6ce', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39351', 'name': 'v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] delete snapshot v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad of volume s_22766a70-c7dd-4179-8464-627a49390f4a {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/snapshots/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/snapshots/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/snapshots/v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] snapshot v_433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.quota [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['f5baff4b-ab65-4cd3-8b59-74856a21a359', 'fa0bf240-80af-4ac0-9c80-d21ba3a9a42b', '042e9421-32ba-4725-9d29-e73f69444520', '4c607000-a22d-4338-89e3-86b395b8a721'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763882496', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:48:26 user cinder-volume[73792]: DEBUG cinder.manager [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:48:26 user cinder-volume[73792]: INFO cinder.volume.manager [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Deleted volume successfully.
Apr 12 06:48:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-149d9a15-5e91-42d0-baff-b136322f2b7f tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-433fc0ac-9b0f-4b53-b0f7-8cc3c89957ad-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.coordination [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-22766a70-c7dd-4179-8464-627a49390f4a-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.coordination [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-22766a70-c7dd-4179-8464-627a49390f4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] deleating snapshot s_22766a70-c7dd-4179-8464-627a49390f4a. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume s_22766a70-c7dd-4179-8464-627a49390f4a  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] get volume s_22766a70-c7dd-4179-8464-627a49390f4a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930@s_22766a70-c7dd-4179-8464-627a49390f4a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_22766a70-c7dd-4179-8464-627a49390f4a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283518', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61067', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17847324717180549525', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '35f7009590ca50d8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763882496', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39117', 'name': 's_22766a70-c7dd-4179-8464-627a49390f4a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_22766a70-c7dd-4179-8464-627a49390f4a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] delete snapshot s_22766a70-c7dd-4179-8464-627a49390f4a of volume v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/snapshots/s_22766a70-c7dd-4179-8464-627a49390f4a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/snapshots/s_22766a70-c7dd-4179-8464-627a49390f4a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/snapshots/s_22766a70-c7dd-4179-8464-627a49390f4a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] snapshot s_22766a70-c7dd-4179-8464-627a49390f4a deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.quota [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['34b28bbc-36e8-4126-9f24-8b165165be37', 'a53aa24f-91cc-4796-9ea0-6556de8ed6c7', '4fa1a96e-f37a-41f8-a329-9897dfdce67e', '6362a382-45ed-48b0-b499-86b2f5b9cea5'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:48:28 user cinder-volume[73792]: INFO cinder.volume.manager [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Delete snapshot completed successfully.
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-379c25b6-de48-4dc0-9d9d-119795247cd5 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-22766a70-c7dd-4179-8464-627a49390f4a-delete_snapshot" released by "delete_snapshot" :: held 1.026s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-f07e5b2d-dd0d-47a6-88e4-0d220a4ca930-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-f07e5b2d-dd0d-47a6-88e4-0d220a4ca930-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] remove_export for volume: f07e5b2d-dd0d-47a6-88e4-0d220a4ca930. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1300384984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f07e5b2d-dd0d-47a6-88e4-0d220a4ca930,launched_at=2023-04-12T06:48:21Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP BtJHSbNA Qj75KRvbXPT1Ha',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:20Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:48:28Z,updated_at=2023-04-12T06:48:28Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 from target iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/luns/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/luns/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/luns/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/luns/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] failed to remove resource iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 because of JDSS resource v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] delete target: iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] delete target iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] failed to remove resource iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 because of JDSS resource iqn.2010-10.org.openstack:f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] deleating volume v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] get volume v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283517', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61061', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8039010597630705670', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'eaf4e212b705950b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763894784', 'san:volume_id': 'eaf4e212b705950b60ef7f6d5d0b1c0c806855fa', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39682', 'name': 'v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] delete volume:v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] volume v_f07e5b2d-dd0d-47a6-88e4-0d220a4ca930 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:48:29 user cinder-volume[73792]: DEBUG cinder.quota [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['c277e0e0-7472-4381-9fcd-e8903068c498', 'dcac45e2-7404-4031-b025-abc5135ded90', 'f8e087e2-f591-42c0-9016-71426663516e', '420ac210-c10a-4d96-9f4e-647722afb0a6'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:48:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:48:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:48:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763976704', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:48:30 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Deleted volume successfully.
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c073a5b0-4612-48e8-9b10-489b9c21e967 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-f07e5b2d-dd0d-47a6-88e4-0d220a4ca930-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:30 user cinder-volume[73792]: INFO cinder.action_track [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-375134821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Flow 'volume_create_manager' (3c10677a-1323-4a54-8eb7-0560eb08b5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d38e4c4-f176-4c46-b573-b4697cf67536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114763976704', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d38e4c4-f176-4c46-b573-b4697cf67536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-375134821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:48:31Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c525a7f3-07c2-4234-97d1-485bdb9d4f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c525a7f3-07c2-4234-97d1-485bdb9d4f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265bd666-5509-459c-958f-b9ef7187cfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265bd666-5509-459c-958f-b9ef7187cfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b', 'volume_name': 'volume-2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8560ca5-bbb6-4bb9-a4ad-3aebaf1562c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8560ca5-bbb6-4bb9-a4ad-3aebaf1562c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f22036b-8460-4e15-a054-209ae6a47507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:30 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Volume 2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b', 'volume_size': 1}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] creating volume v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] create volume {'name': 'v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b', 'is_clone': False, 'name': 'v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f22036b-8460-4e15-a054-209ae6a47507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c479c78-f3a8-4950-8447-510bf761bfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:31 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Volume volume-2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b (2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b): created successfully
Apr 12 06:48:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c479c78-f3a8-4950-8447-510bf761bfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] Flow 'volume_create_manager' (3c10677a-1323-4a54-8eb7-0560eb08b5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:48:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=59,cinder:UPDATE=33,cinder:INSERT=6,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:48:31 user cinder-volume[73792]: INFO cinder.action_track [None req-a5657e2c-3808-45d2-8552-234b827ce4da tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-375134821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b,launched_at=2023-04-12T06:48:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP NwWFeYsf jVgDi5lWYMRnav',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:48:31Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:48:31 user cinder-volume[73792]: INFO cinder.action_track [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Snapshot-1644677052',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=c1d7422a-d219-4ffd-8e23-f2826371fd2e,metadata={},progress='0%',project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume=<?>,volume_id=2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:48:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=56,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=6 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:48:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot c1d7422a-d219-4ffd-8e23-f2826371fd2e for volume 2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:48:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] cloning v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b to s_c1d7422a-d219-4ffd-8e23-f2826371fd2e {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:48:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot s_c1d7422a-d219-4ffd-8e23-f2826371fd2e {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:48:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c1d7422a-d219-4ffd-8e23-f2826371fd2e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] create volume s_c1d7422a-d219-4ffd-8e23-f2826371fd2e from snapshot s_c1d7422a-d219-4ffd-8e23-f2826371fd2e {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:48:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b@s_c1d7422a-d219-4ffd-8e23-f2826371fd2e', 'is_clone': True, 'full_name': 'Pool-0/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e', 'name': 's_c1d7422a-d219-4ffd-8e23-f2826371fd2e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] volume s_c1d7422a-d219-4ffd-8e23-f2826371fd2e properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:48:32 user cinder-volume[73792]: INFO cinder.volume.manager [None req-1e82624a-9ae8-4867-9dba-f49c9d51d5b8 tempest-VolumesSnapshotTestJSON-2015355536 None] Create snapshot completed successfully
Apr 12 06:48:33 user cinder-volume[73792]: INFO cinder.action_track [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-527414010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a6341b3f-ec8c-48eb-abf3-59d6ba7f7614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c1d7422a-d219-4ffd-8e23-f2826371fd2e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Flow 'volume_create_manager' (e5e50fdf-92f9-47eb-8ad8-7a05ed972e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9719fa-65de-42ad-9a1f-d52495af03ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9719fa-65de-42ad-9a1f-d52495af03ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-527414010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a6341b3f-ec8c-48eb-abf3-59d6ba7f7614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c1d7422a-d219-4ffd-8e23-f2826371fd2e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:48:33Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58989549-2309-4ea9-85ae-da819f8a67e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58989549-2309-4ea9-85ae-da819f8a67e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472a2f3e-ffb7-4499-9f56-ffcd32afbb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472a2f3e-ffb7-4499-9f56-ffcd32afbb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a6341b3f-ec8c-48eb-abf3-59d6ba7f7614', 'volume_name': 'volume-a6341b3f-ec8c-48eb-abf3-59d6ba7f7614', 'volume_size': 1, 'snapshot_id': 'c1d7422a-d219-4ffd-8e23-f2826371fd2e'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd0557c-89c2-48be-bdfa-763a42e61032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd0557c-89c2-48be-bdfa-763a42e61032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15ab7b9-1897-4af4-a1b3-57ceecd28004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:33 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Volume a6341b3f-ec8c-48eb-abf3-59d6ba7f7614: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a6341b3f-ec8c-48eb-abf3-59d6ba7f7614', 'volume_size': 1, 'snapshot_id': 'c1d7422a-d219-4ffd-8e23-f2826371fd2e'}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] create volume a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 from snapshot c1d7422a-d219-4ffd-8e23-f2826371fd2e {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] cloning s_c1d7422a-d219-4ffd-8e23-f2826371fd2e to v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] create snapshot v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] create volume v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 from snapshot v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e@v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614', 'is_clone': True, 'full_name': 'Pool-0/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614', 'name': 'v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] get volume v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e@v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283531', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61098', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16943245054751452062', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'eee1788345dbfafe', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763907072', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39581', 'name': 'v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15ab7b9-1897-4af4-a1b3-57ceecd28004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6341b3f-ec8c-48eb-abf3-59d6ba7f7614', 'volume_size': 1, 'snapshot_id': 'c1d7422a-d219-4ffd-8e23-f2826371fd2e'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efe7317-ce53-46ea-a668-48b5f3519929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:34 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Volume volume-a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 (a6341b3f-ec8c-48eb-abf3-59d6ba7f7614): created successfully
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efe7317-ce53-46ea-a668-48b5f3519929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] Flow 'volume_create_manager' (e5e50fdf-92f9-47eb-8ad8-7a05ed972e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:48:34 user cinder-volume[73792]: INFO cinder.action_track [None req-55673467-fe25-4a8f-a2d9-5ae58d323237 tempest-VolumesSnapshotTestJSON-2015355536 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-527414010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a6341b3f-ec8c-48eb-abf3-59d6ba7f7614,launched_at=2023-04-12T06:48:34Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP gUIwXNGY d86gOTkP9iyhof',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:33Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=c1d7422a-d219-4ffd-8e23-f2826371fd2e,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:48:33Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:48:34 user cinder-volume[73792]: INFO cinder.action_track [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375020388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9cbbb1a6-c094-4a11-beef-499b756020f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Flow 'volume_create_manager' (56d460d3-565e-4324-abeb-6500be65b81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e0c2ef-a3e6-4d6b-9453-e003545833aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e0c2ef-a3e6-4d6b-9453-e003545833aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375020388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9cbbb1a6-c094-4a11-beef-499b756020f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:48:35Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef404ea-bfe9-46e4-8102-90ad7e58ba43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef404ea-bfe9-46e4-8102-90ad7e58ba43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e883a2-6666-4dfc-a8ff-a0645f229d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e883a2-6666-4dfc-a8ff-a0645f229d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cbbb1a6-c094-4a11-beef-499b756020f2', 'volume_name': 'volume-9cbbb1a6-c094-4a11-beef-499b756020f2', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e00548-990b-4d9a-ad47-80482898d4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e00548-990b-4d9a-ad47-80482898d4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50b0731-a84a-47a2-af89-64da239db8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:34 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Volume 9cbbb1a6-c094-4a11-beef-499b756020f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cbbb1a6-c094-4a11-beef-499b756020f2', 'volume_size': 1}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] creating volume v_9cbbb1a6-c094-4a11-beef-499b756020f2. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] create volume {'name': 'v_9cbbb1a6-c094-4a11-beef-499b756020f2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9cbbb1a6-c094-4a11-beef-499b756020f2', 'is_clone': False, 'name': 'v_9cbbb1a6-c094-4a11-beef-499b756020f2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50b0731-a84a-47a2-af89-64da239db8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cbbb1a6-c094-4a11-beef-499b756020f2', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afe75df-b4d4-4c79-9e8a-585175a03c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:48:35 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Volume volume-9cbbb1a6-c094-4a11-beef-499b756020f2 (9cbbb1a6-c094-4a11-beef-499b756020f2): created successfully
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afe75df-b4d4-4c79-9e8a-585175a03c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Flow 'volume_create_manager' (56d460d3-565e-4324-abeb-6500be65b81f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:48:35 user cinder-volume[73792]: INFO cinder.action_track [None req-2e538b4b-532f-4553-9a23-8e27422c9407 tempest-AttachVolumeShelveTestJSON-1986658224 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375020388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9cbbb1a6-c094-4a11-beef-499b756020f2,launched_at=2023-04-12T06:48:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth='CHAP dMCckQRL NKXBhCtkFx2Mvc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:48:35Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-a6341b3f-ec8c-48eb-abf3-59d6ba7f7614-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-a6341b3f-ec8c-48eb-abf3-59d6ba7f7614-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] remove_export for volume: a6341b3f-ec8c-48eb-abf3-59d6ba7f7614. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-527414010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a6341b3f-ec8c-48eb-abf3-59d6ba7f7614,launched_at=2023-04-12T06:48:34Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP gUIwXNGY d86gOTkP9iyhof',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:33Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=c1d7422a-d219-4ffd-8e23-f2826371fd2e,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:48:36Z,updated_at=2023-04-12T06:48:36Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 from target iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614/luns/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614/luns/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614/luns/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614/luns/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] failed to remove resource iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 because of JDSS resource v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] delete target: iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] delete target iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] failed to remove resource iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 because of JDSS resource iqn.2010-10.org.openstack:a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] deleating volume v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] get volume v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e@v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283531', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61098', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16943245054751452062', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'eee1788345dbfafe', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763825152', 'san:volume_id': 'eee1788345dbfafebf29445e49b585199f244e60', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39581', 'name': 'v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] delete snapshot v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 of volume s_c1d7422a-d219-4ffd-8e23-f2826371fd2e {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/snapshots/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/snapshots/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/snapshots/v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] snapshot v_a6341b3f-ec8c-48eb-abf3-59d6ba7f7614 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:48:36 user cinder-volume[73792]: DEBUG cinder.quota [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['b136b8fc-fe39-45e3-a398-986548e72c75', 'a925d17a-32c5-4beb-944a-c099d9e13bf7', '0139d951-2fd1-4fc4-8c9b-50004a51f75c', 'f0edc58b-8d8d-458e-ab1d-c7ada8a3fade'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:48:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:48:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:48:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763837440', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:48:37 user cinder-volume[73792]: DEBUG cinder.manager [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:48:37 user cinder-volume[73792]: INFO cinder.volume.manager [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Deleted volume successfully.
Apr 12 06:48:37 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1faf602b-388f-4f64-91b3-d4cf8a496eec tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-a6341b3f-ec8c-48eb-abf3-59d6ba7f7614-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:48:37 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-c1d7422a-d219-4ffd-8e23-f2826371fd2e-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:48:37 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-c1d7422a-d219-4ffd-8e23-f2826371fd2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:48:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] deleating snapshot s_c1d7422a-d219-4ffd-8e23-f2826371fd2e. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:48:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume s_c1d7422a-d219-4ffd-8e23-f2826371fd2e  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:48:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] get volume s_c1d7422a-d219-4ffd-8e23-f2826371fd2e info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:48:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b@s_c1d7422a-d219-4ffd-8e23-f2826371fd2e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283529', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61092', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3182063788878961370', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cdbc027c8a5d208a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763837440', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39565', 'name': 's_c1d7422a-d219-4ffd-8e23-f2826371fd2e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] delete snapshot s_c1d7422a-d219-4ffd-8e23-f2826371fd2e of volume v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:48:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/snapshots/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/snapshots/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/snapshots/s_c1d7422a-d219-4ffd-8e23-f2826371fd2e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] snapshot s_c1d7422a-d219-4ffd-8e23-f2826371fd2e deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:48:38 user cinder-volume[73792]: DEBUG cinder.quota [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['e4a89c5a-d4b7-4bd3-8b92-d59dc6fa76a6', 'd30c108a-111b-4990-9264-1a646e10fed6', '8d96846c-d74a-4cb3-9ad5-cddb4f7a1886', 'b92968ab-3a92-43d9-885d-12cc11a07249'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:48:38 user cinder-volume[73792]: INFO cinder.volume.manager [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Delete snapshot completed successfully.
Apr 12 06:48:39 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5f0498e6-5184-4b6c-a529-4cef4af884de tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-c1d7422a-d219-4ffd-8e23-f2826371fd2e-delete_snapshot" released by "delete_snapshot" :: held 1.209s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] remove_export for volume: 2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-375134821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b,launched_at=2023-04-12T06:48:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP NwWFeYsf jVgDi5lWYMRnav',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:31Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:48:40Z,updated_at=2023-04-12T06:48:40Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b from target iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/luns/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/luns/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/luns/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/luns/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] failed to remove resource iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b because of JDSS resource v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] delete target: iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] delete target iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] failed to remove resource iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b because of JDSS resource iqn.2010-10.org.openstack:2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] deleating volume v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] get volume v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283528', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61086', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6239005376302772370', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fbaf8dc53289a9bd', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763837440', 'san:volume_id': 'fbaf8dc53289a9bdda3a7e389ab3501d016f470c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39372', 'name': 'v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] delete volume:v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] volume v_2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:48:41 user cinder-volume[73792]: DEBUG cinder.quota [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['cb17c6a6-0647-4604-8a98-542f4fc4684e', '493a03e7-5b54-4c7d-a4bc-adc732a2ab78', '51fe621f-941e-4a75-b4bc-854bea9a5396', 'f37ed5ff-b357-4d25-85ac-b1efe258b3b6'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:48:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:48:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:48:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:41 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763919360', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.manager [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:48:42 user cinder-volume[73792]: INFO cinder.volume.manager [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Deleted volume successfully.
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bf8238e9-73dc-476d-9cdc-0607e5baf776 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-2c373bc2-83e7-4f29-9b64-8bddf0b5ce3b-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Acquiring lock "cinder-1a3b8849-fc77-4b4a-858e-5eb6bd4612d0-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-1a3b8849-fc77-4b4a-858e-5eb6bd4612d0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] remove_export for volume: 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1481584220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1a3b8849-fc77-4b4a-858e-5eb6bd4612d0,launched_at=2023-04-12T06:42:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af34529636fc4221921028f93b1c381a',provider_auth='CHAP zodFkufL JDsnwSP6ObUd9Z',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:42:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:48:42Z,updated_at=2023-04-12T06:48:42Z,use_quota=True,user_id='8546fd1ed08b4e88a945e73347be38c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] detach volume v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 from target iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/luns/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/luns/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/luns/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/luns/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] failed to remove resource iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 because of JDSS resource v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] delete target: iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] delete target iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] failed to remove resource iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 because of JDSS resource iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] deleating volume v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] get snapshots for volume v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] get volume v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283146', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60747', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12684353466142801595', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '55ed0e3c681b8098', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763919360', 'san:volume_id': '55ed0e3c681b8098e9cea1edde51b903aea1e397', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38569', 'name': 'v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] delete volume:v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:42 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] volume v_1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:48:43 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=60,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=9 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:48:43 user cinder-volume[73792]: DEBUG cinder.quota [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Created reservations ['dcfbb9d0-001b-4fa6-ae2d-34385cffeb75', '9fc1351a-94cb-4de7-96c9-0f43cbf4554a', 'ccdcb713-a998-421b-b64b-e49f25b5821f', 'e66d7605-a938-49a1-912a-33568de68eb1'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:48:43 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=59,cinder:DELETE=2,cinder:UPDATE=32,cinder:INSERT=7 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:48:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:48:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:48:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:48:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:48:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764025856', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:48:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:48:44 user cinder-volume[73792]: DEBUG cinder.manager [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:48:44 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Deleted volume successfully.
Apr 12 06:48:44 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0dab13ed-0c81-4a3e-b0ae-ec647dac26a9 tempest-VolumesSnapshotTestJSON-2015355536 None] Lock "cinder-1a3b8849-fc77-4b4a-858e-5eb6bd4612d0-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:49:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.coordination [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Acquiring lock "cinder-e576c659-6613-4633-aea2-bfcc2cfbb7ad-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.coordination [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Lock "cinder-e576c659-6613-4633-aea2-bfcc2cfbb7ad-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] remove_export for volume: e576c659-6613-4633-aea2-bfcc2cfbb7ad. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1314363085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e576c659-6613-4633-aea2-bfcc2cfbb7ad,launched_at=2023-04-12T06:46:18Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5098984b6bda4c2d9a71023292e7815c',provider_auth='CHAP YPfFrgoC WwPj0YOpB3SJhu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:46:18Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:49:06Z,updated_at=2023-04-12T06:49:06Z,use_quota=True,user_id='c93cca7970df482f8c3a00f15ef12fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] detach volume v_e576c659-6613-4633-aea2-bfcc2cfbb7ad from target iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad/luns/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad/luns/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad/luns/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad/luns/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] failed to remove resource iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad because of JDSS resource v_e576c659-6613-4633-aea2-bfcc2cfbb7ad DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] delete target: iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] delete target iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] failed to remove resource iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad because of JDSS resource iqn.2010-10.org.openstack:e576c659-6613-4633-aea2-bfcc2cfbb7ad DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] deleating volume v_e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] get snapshots for volume v_e576c659-6613-4633-aea2-bfcc2cfbb7ad  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:05 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] get volume v_e576c659-6613-4633-aea2-bfcc2cfbb7ad info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:49:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283395', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '60935', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7935417576170661549', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '27f4557515a4acc7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114764025856', 'san:volume_id': '27f4557515a4acc7dc3569409937844d12dcee25', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '37478', 'name': 'v_e576c659-6613-4633-aea2-bfcc2cfbb7ad', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] delete volume:v_e576c659-6613-4633-aea2-bfcc2cfbb7ad recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:49:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e576c659-6613-4633-aea2-bfcc2cfbb7ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] volume v_e576c659-6613-4633-aea2-bfcc2cfbb7ad deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:49:07 user cinder-volume[73792]: DEBUG cinder.quota [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Created reservations ['903a175f-5ae1-4563-a4dc-074fed5d43e0', '238b7a91-8c37-4133-8058-3346e206518b', 'e59cca68-f441-4c3e-b635-540a36f7d47e', '92ee9264-78b0-424c-a900-f1847b8bcbc3'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:49:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:49:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:49:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764120064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:49:07 user cinder-volume[73792]: DEBUG cinder.manager [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:49:07 user cinder-volume[73792]: INFO cinder.volume.manager [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Deleted volume successfully.
Apr 12 06:49:07 user cinder-volume[73792]: DEBUG cinder.coordination [None req-e819f055-ca69-4f77-a670-cdef4da3699f tempest-VolumesNegativeTest-289347363 None] Lock "cinder-e576c659-6613-4633-aea2-bfcc2cfbb7ad-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:49:21 user cinder-volume[73792]: INFO cinder.action_track [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1192174031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=60acd849-1228-4bc3-96bb-83c7991453b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=18,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Flow 'volume_create_manager' (49006246-f4d4-47f9-b749-798800de4f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f82e95e-0000-48e3-bb60-dbfda47c9e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f82e95e-0000-48e3-bb60-dbfda47c9e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1192174031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=60acd849-1228-4bc3-96bb-83c7991453b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:49:22Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52501465-0dbc-4353-9635-8b1404b7106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52501465-0dbc-4353-9635-8b1404b7106a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61614e81-fb64-4ba4-a22e-69da48ae419e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61614e81-fb64-4ba4-a22e-69da48ae419e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '60acd849-1228-4bc3-96bb-83c7991453b0', 'volume_name': 'volume-60acd849-1228-4bc3-96bb-83c7991453b0', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769b77eb0>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8b544e-abcb-4ebf-92b9-1cfa8605b1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8b544e-abcb-4ebf-92b9-1cfa8605b1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7b5358-53fc-4c04-ae8f-f70b40156087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:21 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Volume 60acd849-1228-4bc3-96bb-83c7991453b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-60acd849-1228-4bc3-96bb-83c7991453b0', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769b77eb0>}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Cloning 60acd849-1228-4bc3-96bb-83c7991453b0 from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 49, 21, 699383)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Found cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 49, 21, 712450)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Creating from source image-volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] cloned volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to 60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] cloning v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] create snapshot v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_60acd849-1228-4bc3-96bb-83c7991453b0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] create volume v_60acd849-1228-4bc3-96bb-83c7991453b0 from snapshot v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_60acd849-1228-4bc3-96bb-83c7991453b0', 'is_clone': True, 'full_name': 'Pool-0/v_60acd849-1228-4bc3-96bb-83c7991453b0', 'name': 'v_60acd849-1228-4bc3-96bb-83c7991453b0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] get volume v_60acd849-1228-4bc3-96bb-83c7991453b0 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_60acd849-1228-4bc3-96bb-83c7991453b0', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_60acd849-1228-4bc3-96bb-83c7991453b0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283579', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '61125', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10698016673876562652', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '788e59d6b1276801', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114764107776', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39405', 'name': 'v_60acd849-1228-4bc3-96bb-83c7991453b0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Marking volume 60acd849-1228-4bc3-96bb-83c7991453b0 as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to 60acd849-1228-4bc3-96bb-83c7991453b0. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Creating volume glance metadata for volume 60acd849-1228-4bc3-96bb-83c7991453b0 backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7b5358-53fc-4c04-ae8f-f70b40156087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60acd849-1228-4bc3-96bb-83c7991453b0', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769b77eb0>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ceee245-69c2-45c7-9b70-38f835b87c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:22 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Volume volume-60acd849-1228-4bc3-96bb-83c7991453b0 (60acd849-1228-4bc3-96bb-83c7991453b0): created successfully
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ceee245-69c2-45c7-9b70-38f835b87c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] Flow 'volume_create_manager' (49006246-f4d4-47f9-b749-798800de4f17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:49:22 user cinder-volume[73792]: INFO cinder.action_track [None req-0727dbce-be65-456d-9a10-eca5d83bb36a tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1192174031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=60acd849-1228-4bc3-96bb-83c7991453b0,launched_at=2023-04-12T06:49:22Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP Fjwazecn uT2tAVLjENWJsM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:22Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:49:22Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:23 user cinder-volume[73792]: INFO cinder.action_track [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-snapshot-988190927',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=90fb009e-81f5-45c6-bbfe-8330a5ff1ac3,metadata={},progress='0%',project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume=<?>,volume_id=60acd849-1228-4bc3-96bb-83c7991453b0,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] create snapshot 90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 for volume 60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:49:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] cloning v_60acd849-1228-4bc3-96bb-83c7991453b0 to s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:49:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] create snapshot s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:49:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] create volume s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 from snapshot s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:49:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_60acd849-1228-4bc3-96bb-83c7991453b0@s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3', 'is_clone': True, 'full_name': 'Pool-0/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3', 'name': 's_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] volume s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:49:25 user cinder-volume[73792]: INFO cinder.volume.manager [None req-2d33862f-e847-49cb-b2f2-e92cd6422f45 tempest-TestVolumeBootPattern-294210775 None] Create snapshot completed successfully
Apr 12 06:49:27 user cinder-volume[73792]: INFO cinder.action_track [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a5b554b9-110c-4f1f-9fe6-a30e2120f7af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=90fb009e-81f5-45c6-bbfe-8330a5ff1ac3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:27 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:49:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Flow 'volume_create_manager' (616c8dbd-06d5-46ca-bec4-ba83f7ea28dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:49:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1baa0d89-ce8e-4bf4-83c0-a9edc5f1d8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1baa0d89-ce8e-4bf4-83c0-a9edc5f1d8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a5b554b9-110c-4f1f-9fe6-a30e2120f7af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=90fb009e-81f5-45c6-bbfe-8330a5ff1ac3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:49:28Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1ca3c9-9b8e-4abf-854d-cd9d5cbee4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1ca3c9-9b8e-4abf-854d-cd9d5cbee4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c19b3c-625f-464f-8826-b51230641bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c19b3c-625f-464f-8826-b51230641bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'volume_name': 'volume-a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'volume_size': 1, 'snapshot_id': '90fb009e-81f5-45c6-bbfe-8330a5ff1ac3'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acce903-1be6-419a-b138-fbe6278e631e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acce903-1be6-419a-b138-fbe6278e631e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50285e36-df25-4da0-8713-427b9a0ae93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:28 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Volume a5b554b9-110c-4f1f-9fe6-a30e2120f7af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'volume_size': 1, 'snapshot_id': '90fb009e-81f5-45c6-bbfe-8330a5ff1ac3'}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] create volume a5b554b9-110c-4f1f-9fe6-a30e2120f7af from snapshot 90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] cloning s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 to v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] create snapshot v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] create volume v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af from snapshot v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3@v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'is_clone': True, 'full_name': 'Pool-0/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'name': 'v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] get volume v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3@v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283585', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '61137', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9971977171655884708', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '016200025e8a5b67', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114764034048', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39419', 'name': 'v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Marking volume a5b554b9-110c-4f1f-9fe6-a30e2120f7af as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:49:28 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Copying metadata from snapshot 90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 to a5b554b9-110c-4f1f-9fe6-a30e2120f7af. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}}
Apr 12 06:49:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50285e36-df25-4da0-8713-427b9a0ae93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'volume_size': 1, 'snapshot_id': '90fb009e-81f5-45c6-bbfe-8330a5ff1ac3'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc6acaa-ef79-463a-9c12-965b931f2763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:29 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Volume volume-a5b554b9-110c-4f1f-9fe6-a30e2120f7af (a5b554b9-110c-4f1f-9fe6-a30e2120f7af): created successfully
Apr 12 06:49:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc6acaa-ef79-463a-9c12-965b931f2763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:29 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] Flow 'volume_create_manager' (616c8dbd-06d5-46ca-bec4-ba83f7ea28dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:49:29 user cinder-volume[73792]: INFO cinder.action_track [req-83341e98-4f4d-4f2c-a902-15da86381603 req-2cc1d50f-592e-4e9c-adfc-0bdce49b6b37 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a5b554b9-110c-4f1f-9fe6-a30e2120f7af,launched_at=2023-04-12T06:49:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP NgDfYWth PWXwoEMvxajVeT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=90fb009e-81f5-45c6-bbfe-8330a5ff1ac3,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:49:28Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:30 user cinder-volume[73792]: INFO cinder.action_track [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123123454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e07c955b-abdd-446f-9137-d12aef35b2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Flow 'volume_create_manager' (43472cda-0ab9-44cb-8d3d-2ffb81ded04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff25998-779d-410d-9e4c-a4706dfc854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff25998-779d-410d-9e4c-a4706dfc854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123123454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e07c955b-abdd-446f-9137-d12aef35b2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:49:30Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c93be9f-27ae-4923-8be5-bb339c89323a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c93be9f-27ae-4923-8be5-bb339c89323a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78f3248-392b-4bd5-81ca-31f773743bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78f3248-392b-4bd5-81ca-31f773743bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e07c955b-abdd-446f-9137-d12aef35b2c5', 'volume_name': 'volume-e07c955b-abdd-446f-9137-d12aef35b2c5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a6aada-8918-4ce9-89ef-1a794d68fba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a6aada-8918-4ce9-89ef-1a794d68fba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e3629f-440b-4e96-99e6-6c01289de44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:30 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Volume e07c955b-abdd-446f-9137-d12aef35b2c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e07c955b-abdd-446f-9137-d12aef35b2c5', 'volume_size': 1}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] creating volume v_e07c955b-abdd-446f-9137-d12aef35b2c5. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] create volume {'name': 'v_e07c955b-abdd-446f-9137-d12aef35b2c5', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114764021760', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:49:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:49:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e07c955b-abdd-446f-9137-d12aef35b2c5', 'is_clone': False, 'name': 'v_e07c955b-abdd-446f-9137-d12aef35b2c5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e3629f-440b-4e96-99e6-6c01289de44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e07c955b-abdd-446f-9137-d12aef35b2c5', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814f030f-aa43-4e2c-96a0-d10d854049bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:49:31 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Volume volume-e07c955b-abdd-446f-9137-d12aef35b2c5 (e07c955b-abdd-446f-9137-d12aef35b2c5): created successfully
Apr 12 06:49:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814f030f-aa43-4e2c-96a0-d10d854049bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:49:31 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] Flow 'volume_create_manager' (43472cda-0ab9-44cb-8d3d-2ffb81ded04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:49:31 user cinder-volume[73792]: INFO cinder.action_track [None req-ca828e08-8e08-44d7-9b2f-c7a5c15fedfb tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123123454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e07c955b-abdd-446f-9137-d12aef35b2c5,launched_at=2023-04-12T06:49:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP UtjuFhmD oSn6pfkjtPO5UM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:49:30Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=53,cinder:INSERT=18,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:49:32 user cinder-volume[73792]: INFO cinder.action_track [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123123454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e07c955b-abdd-446f-9137-d12aef35b2c5,launched_at=2023-04-12T06:49:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP UtjuFhmD oSn6pfkjtPO5UM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:49:32Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:32 user cinder-volume[73792]: INFO cinder.action_track [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123123454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e07c955b-abdd-446f-9137-d12aef35b2c5,launched_at=2023-04-12T06:49:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP UtjuFhmD oSn6pfkjtPO5UM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:49:32Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] create export for volume: e07c955b-abdd-446f-9137-d12aef35b2c5. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:49:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] ensure volume e07c955b-abdd-446f-9137-d12aef35b2c5 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:49:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] check if targe iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:49:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] create target and attach volume e07c955b-abdd-446f-9137-d12aef35b2c5 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:49:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] create target iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:49:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:33 user cinder-volume[73792]: INFO cinder.action_track [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a5b554b9-110c-4f1f-9fe6-a30e2120f7af,launched_at=2023-04-12T06:49:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP NgDfYWth PWXwoEMvxajVeT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=90fb009e-81f5-45c6-bbfe-8330a5ff1ac3,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:49:33Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:33 user cinder-volume[73792]: INFO cinder.action_track [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a5b554b9-110c-4f1f-9fe6-a30e2120f7af,launched_at=2023-04-12T06:49:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP NgDfYWth PWXwoEMvxajVeT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=90fb009e-81f5-45c6-bbfe-8330a5ff1ac3,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:49:33Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] create export for volume: a5b554b9-110c-4f1f-9fe6-a30e2120f7af. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:49:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] ensure volume a5b554b9-110c-4f1f-9fe6-a30e2120f7af assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:49:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] check if targe iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:49:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] create target and attach volume a5b554b9-110c-4f1f-9fe6-a30e2120f7af to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:49:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] create target iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:49:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] atach volume v_e07c955b-abdd-446f-9137-d12aef35b2c5 to target iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:49:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6163646133646236', 'lun': 0, 'mode': 'wt', 'name': 'v_e07c955b-abdd-446f-9137-d12aef35b2c5', 'prod_id': 'Storage', 'scsi_id': 'acda3db6abd7f185'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] add credentails to target iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:49:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] atach volume v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af to target iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:49:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 201, 'error': None, 'data': {'name': 'UtjuFhmD'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] initialize_connection for e07c955b-abdd-446f-9137-d12aef35b2c5 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:49:36 user cinder-volume[73792]: INFO cinder.action_track [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtjuFhmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '8be0b98d-dfeb-4bd5-94bb-8864d4c51c4f'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123123454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e07c955b-abdd-446f-9137-d12aef35b2c5,launched_at=2023-04-12T06:49:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP UtjuFhmD oSn6pfkjtPO5UM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:49:32Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:36 user cinder-volume[73792]: INFO cinder.action_track [req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 req-56071f4a-5131-47d2-9fd4-273c9364dc2c tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123123454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e07c955b-abdd-446f-9137-d12aef35b2c5,launched_at=2023-04-12T06:49:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP UtjuFhmD oSn6pfkjtPO5UM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:49:36Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3031363230303032', 'lun': 0, 'mode': 'wt', 'name': 'v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'prod_id': 'Storage', 'scsi_id': '016200025e8a5b67'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] add credentails to target iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:49:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'name': 'NgDfYWth'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] initialize_connection for a5b554b9-110c-4f1f-9fe6-a30e2120f7af 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:49:37 user cinder-volume[73792]: INFO cinder.action_track [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgDfYWth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '9093a1bd-7453-4277-81b8-fb4e0af41d73'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a5b554b9-110c-4f1f-9fe6-a30e2120f7af,launched_at=2023-04-12T06:49:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP NgDfYWth PWXwoEMvxajVeT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=90fb009e-81f5-45c6-bbfe-8330a5ff1ac3,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:49:33Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:37 user cinder-volume[73792]: INFO cinder.action_track [req-83341e98-4f4d-4f2c-a902-15da86381603 req-9438d6c2-615c-4663-9d6f-98573a7c895c tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a5b554b9-110c-4f1f-9fe6-a30e2120f7af,launched_at=2023-04-12T06:49:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP NgDfYWth PWXwoEMvxajVeT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=90fb009e-81f5-45c6-bbfe-8330a5ff1ac3,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:49:37Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:38 user cinder-volume[73792]: INFO cinder.action_track [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-snapshot-1372216419',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=ad48becc-30fb-4220-aba1-e046ac7fa6cf,metadata={},progress='0%',project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume=<?>,volume_id=e07c955b-abdd-446f-9137-d12aef35b2c5,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:49:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] create snapshot ad48becc-30fb-4220-aba1-e046ac7fa6cf for volume e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:49:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] cloning v_e07c955b-abdd-446f-9137-d12aef35b2c5 to s_ad48becc-30fb-4220-aba1-e046ac7fa6cf {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:49:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] create snapshot s_ad48becc-30fb-4220-aba1-e046ac7fa6cf {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:49:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_ad48becc-30fb-4220-aba1-e046ac7fa6cf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] create volume s_ad48becc-30fb-4220-aba1-e046ac7fa6cf from snapshot s_ad48becc-30fb-4220-aba1-e046ac7fa6cf {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:49:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e07c955b-abdd-446f-9137-d12aef35b2c5@s_ad48becc-30fb-4220-aba1-e046ac7fa6cf', 'is_clone': True, 'full_name': 'Pool-0/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf', 'name': 's_ad48becc-30fb-4220-aba1-e046ac7fa6cf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] volume s_ad48becc-30fb-4220-aba1-e046ac7fa6cf properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:49:39 user cinder-volume[73792]: INFO cinder.volume.manager [None req-13e7e0be-f8e5-4ede-b740-69d0f72acfbf tempest-TestMinimumBasicScenario-1474504992 None] Create snapshot completed successfully
Apr 12 06:49:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=13,cinder:SELECT=66,cinder:INSERT=20,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.coordination [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Acquiring lock "cinder-ad48becc-30fb-4220-aba1-e046ac7fa6cf-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.coordination [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Lock "cinder-ad48becc-30fb-4220-aba1-e046ac7fa6cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] deleating snapshot s_ad48becc-30fb-4220-aba1-e046ac7fa6cf. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] get snapshots for volume s_ad48becc-30fb-4220-aba1-e046ac7fa6cf  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] get volume s_ad48becc-30fb-4220-aba1-e046ac7fa6cf info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e07c955b-abdd-446f-9137-d12aef35b2c5@s_ad48becc-30fb-4220-aba1-e046ac7fa6cf', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283596', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61155', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16383167189385032408', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0ece0167ea6397b7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763915264', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39592', 'name': 's_ad48becc-30fb-4220-aba1-e046ac7fa6cf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] delete snapshot s_ad48becc-30fb-4220-aba1-e046ac7fa6cf of volume v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5/snapshots/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:49:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5/snapshots/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:49:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5/snapshots/s_ad48becc-30fb-4220-aba1-e046ac7fa6cf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:49:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] snapshot s_ad48becc-30fb-4220-aba1-e046ac7fa6cf deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:49:45 user cinder-volume[73792]: DEBUG cinder.quota [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Created reservations ['98ee1c16-6e1b-46ac-9289-e586d85a96b5', '01441362-a7f8-4fb1-9efc-f821236da811', '0328a377-9be7-402f-9894-1086bba7d19d', 'bd3f4748-704d-4292-876c-9c1e0c526d2a'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:49:45 user cinder-volume[73792]: INFO cinder.volume.manager [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Delete snapshot completed successfully.
Apr 12 06:49:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-294fc512-921b-427c-ade3-3ccbdc0a01df tempest-TestMinimumBasicScenario-1474504992 None] Lock "cinder-ad48becc-30fb-4220-aba1-e046ac7fa6cf-delete_snapshot" released by "delete_snapshot" :: held 1.143s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:50:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=37,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:50:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=14,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:50:29 user cinder-volume[73792]: INFO cinder.action_track [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375020388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9cbbb1a6-c094-4a11-beef-499b756020f2,launched_at=2023-04-12T06:48:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth='CHAP dMCckQRL NKXBhCtkFx2Mvc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:50:28Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:50:29 user cinder-volume[73792]: INFO cinder.action_track [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375020388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9cbbb1a6-c094-4a11-beef-499b756020f2,launched_at=2023-04-12T06:48:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth='CHAP dMCckQRL NKXBhCtkFx2Mvc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:50:28Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:50:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] create export for volume: 9cbbb1a6-c094-4a11-beef-499b756020f2. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:50:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] ensure volume 9cbbb1a6-c094-4a11-beef-499b756020f2 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:50:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] check if targe iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:50:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:50:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:50:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:50:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] create target and attach volume 9cbbb1a6-c094-4a11-beef-499b756020f2 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:50:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] create target iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:50:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:50:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:50:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:50:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:50:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:50:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:50:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:50:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:50:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] atach volume v_9cbbb1a6-c094-4a11-beef-499b756020f2 to target iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:50:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:50:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:50:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753761280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:50:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:50:32 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:50:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3434346164366238', 'lun': 0, 'mode': 'wt', 'name': 'v_9cbbb1a6-c094-4a11-beef-499b756020f2', 'prod_id': 'Storage', 'scsi_id': '444ad6b8d55afbe5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:50:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] add credentails to target iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:50:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:50:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:50:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 201, 'error': None, 'data': {'name': 'dMCckQRL'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:50:33 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:50:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] initialize_connection for 9cbbb1a6-c094-4a11-beef-499b756020f2 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:50:33 user cinder-volume[73792]: INFO cinder.action_track [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMCckQRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '7ba3716d-63c3-4558-b567-2ebd73168dc9'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375020388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9cbbb1a6-c094-4a11-beef-499b756020f2,launched_at=2023-04-12T06:48:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth='CHAP dMCckQRL NKXBhCtkFx2Mvc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:50:28Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:50:34 user cinder-volume[73792]: INFO cinder.action_track [req-a2007adc-5082-4351-8aef-0217d9e2a293 req-2ebf8572-0c0b-4d9a-b98c-9f38480d2d1c tempest-AttachVolumeShelveTestJSON-1986658224 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375020388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9cbbb1a6-c094-4a11-beef-499b756020f2,launched_at=2023-04-12T06:48:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth='CHAP dMCckQRL NKXBhCtkFx2Mvc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:50:34Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:50:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=18,cinder:UPDATE=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:51:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:51:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:51:19 user cinder-volume[73792]: INFO cinder.action_track [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a5b554b9-110c-4f1f-9fe6-a30e2120f7af,launched_at=2023-04-12T06:49:29Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP NgDfYWth PWXwoEMvxajVeT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=90fb009e-81f5-45c6-bbfe-8330a5ff1ac3,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:49:38Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] terminate connection for a5b554b9-110c-4f1f-9fe6-a30e2120f7af  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:51:19 user cinder-volume[73792]: INFO cinder.action_track [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a5b554b9-110c-4f1f-9fe6-a30e2120f7af,launched_at=2023-04-12T06:49:29Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP NgDfYWth PWXwoEMvxajVeT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=90fb009e-81f5-45c6-bbfe-8330a5ff1ac3,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:49:38Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] Deleting attachment 9093a1bd-7453-4277-81b8-fb4e0af41d73. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] remove_export for volume: a5b554b9-110c-4f1f-9fe6-a30e2120f7af. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a5b554b9-110c-4f1f-9fe6-a30e2120f7af,launched_at=2023-04-12T06:49:29Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP NgDfYWth PWXwoEMvxajVeT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=90fb009e-81f5-45c6-bbfe-8330a5ff1ac3,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:49:38Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] detach volume v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af from target iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/luns/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/luns/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/luns/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] delete target: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] delete target iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:51:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-85be79d8-0983-4ccd-9027-fb484a3afcaa tempest-TestVolumeBootPattern-294210775 None] target iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.coordination [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Acquiring lock "cinder-a5b554b9-110c-4f1f-9fe6-a30e2120f7af-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.coordination [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-a5b554b9-110c-4f1f-9fe6-a30e2120f7af-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] remove_export for volume: a5b554b9-110c-4f1f-9fe6-a30e2120f7af. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=a5b554b9-110c-4f1f-9fe6-a30e2120f7af,launched_at=2023-04-12T06:49:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP NgDfYWth PWXwoEMvxajVeT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=90fb009e-81f5-45c6-bbfe-8330a5ff1ac3,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:51:20Z,updated_at=2023-04-12T06:51:20Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] detach volume v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af from target iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/luns/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/luns/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/luns/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af/luns/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] failed to remove resource iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af because of JDSS resource v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] delete target: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] delete target iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] failed to remove resource iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af because of JDSS resource iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] deleating volume v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] get snapshots for volume v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] get volume v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3@v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283585', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '61137', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9971977171655884708', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10129408', 'logicalused': '25899008', 'compressratio': '2.57', 'rootcontext': 'none', 'default_scsi_id': '016200025e8a5b67', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753773568', 'san:volume_id': '016200025e8a5b67e9e6b1056e46f8e66d4773a6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10129408', 'objsetid': '39419', 'name': 'v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10129408', 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] delete snapshot v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af of volume s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/snapshots/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:51:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/snapshots/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:51:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/snapshots/v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:51:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] snapshot v_a5b554b9-110c-4f1f-9fe6-a30e2120f7af deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:51:21 user cinder-volume[73792]: DEBUG cinder.quota [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Created reservations ['35906eee-7c87-484d-87b5-f705cd9836ee', '047d737a-b207-4400-b83b-97aa3964e8cb', '1c1c6574-cfce-4936-8584-2e13863e59dd', '07534ef4-3884-46d7-98db-3468d179f926'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:51:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:51:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:51:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:51:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:51:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763964416', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:51:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:51:21 user cinder-volume[73792]: DEBUG cinder.manager [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:51:21 user cinder-volume[73792]: INFO cinder.volume.manager [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Deleted volume successfully.
Apr 12 06:51:21 user cinder-volume[73792]: DEBUG cinder.coordination [req-72ebe517-bb76-4a76-b2c5-448a6c345c0b req-9e2e173a-9c84-41fd-95ef-bc311a2bc127 tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-a5b554b9-110c-4f1f-9fe6-a30e2120f7af-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:51:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:51:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:51:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:51:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:51:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:51:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114763964416', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:51:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:51:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:51:40 user cinder-volume[73792]: INFO cinder.action_track [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123123454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e07c955b-abdd-446f-9137-d12aef35b2c5,launched_at=2023-04-12T06:49:31Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP UtjuFhmD oSn6pfkjtPO5UM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:51:39Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] terminate connection for e07c955b-abdd-446f-9137-d12aef35b2c5  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:51:40 user cinder-volume[73792]: INFO cinder.action_track [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123123454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e07c955b-abdd-446f-9137-d12aef35b2c5,launched_at=2023-04-12T06:49:31Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP UtjuFhmD oSn6pfkjtPO5UM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:51:39Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] Deleting attachment 8be0b98d-dfeb-4bd5-94bb-8864d4c51c4f. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] remove_export for volume: e07c955b-abdd-446f-9137-d12aef35b2c5. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123123454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e07c955b-abdd-446f-9137-d12aef35b2c5,launched_at=2023-04-12T06:49:31Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP UtjuFhmD oSn6pfkjtPO5UM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:51:39Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] detach volume v_e07c955b-abdd-446f-9137-d12aef35b2c5 from target iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/luns/v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/luns/v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/luns/v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] delete target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] delete target iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:51:40 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 req-3e8b66f7-3b03-4344-80c6-a724e6b0efbd tempest-TestMinimumBasicScenario-1474504992 None] target iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:51:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=21,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:51:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=21,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Acquiring lock "cinder-90fb009e-81f5-45c6-bbfe-8330a5ff1ac3-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-90fb009e-81f5-45c6-bbfe-8330a5ff1ac3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] deleating snapshot s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] get snapshots for volume s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] get volume s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_60acd849-1228-4bc3-96bb-83c7991453b0@s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283581', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '61131', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7859501508817369233', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '058bfe5f600200db', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763964416', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38729', 'name': 's_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] delete snapshot s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 of volume v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0/snapshots/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0/snapshots/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0/snapshots/s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] snapshot s_90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:52:09 user cinder-volume[73792]: DEBUG cinder.quota [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Created reservations ['fc8d25a8-7741-4576-91ee-e3b09918e8b1', '402eaec4-6bc0-49d2-a28f-a2d29a4887d8', '5c724362-e13e-4e51-8732-ead244b3401b', '4d90031c-9bd2-4ed7-b2fb-e27876eb6a94'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:52:09 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Delete snapshot completed successfully.
Apr 12 06:52:09 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b7f9ce7e-1530-4cbe-9fdd-ec4da78ea4b9 tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-90fb009e-81f5-45c6-bbfe-8330a5ff1ac3-delete_snapshot" released by "delete_snapshot" :: held 1.124s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Acquiring lock "cinder-60acd849-1228-4bc3-96bb-83c7991453b0-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-60acd849-1228-4bc3-96bb-83c7991453b0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] remove_export for volume: 60acd849-1228-4bc3-96bb-83c7991453b0. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1192174031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=60acd849-1228-4bc3-96bb-83c7991453b0,launched_at=2023-04-12T06:49:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP Fjwazecn uT2tAVLjENWJsM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:22Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:52:10Z,updated_at=2023-04-12T06:52:10Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] detach volume v_60acd849-1228-4bc3-96bb-83c7991453b0 from target iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0/luns/v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0/luns/v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0/luns/v_60acd849-1228-4bc3-96bb-83c7991453b0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0/luns/v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] failed to remove resource iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 because of JDSS resource v_60acd849-1228-4bc3-96bb-83c7991453b0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] delete target: iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] delete target iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] failed to remove resource iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 because of JDSS resource iqn.2010-10.org.openstack:60acd849-1228-4bc3-96bb-83c7991453b0 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] deleating volume v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] get snapshots for volume v_60acd849-1228-4bc3-96bb-83c7991453b0  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] get volume v_60acd849-1228-4bc3-96bb-83c7991453b0 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_60acd849-1228-4bc3-96bb-83c7991453b0', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_60acd849-1228-4bc3-96bb-83c7991453b0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283579', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '61125', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10698016673876562652', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '788e59d6b1276801', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763964416', 'san:volume_id': '788e59d6b127680128ba92af9f8d33b863199f55', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39405', 'name': 'v_60acd849-1228-4bc3-96bb-83c7991453b0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] delete snapshot v_60acd849-1228-4bc3-96bb-83c7991453b0 of volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_60acd849-1228-4bc3-96bb-83c7991453b0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] snapshot v_60acd849-1228-4bc3-96bb-83c7991453b0 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG cinder.quota [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Created reservations ['7c7149d8-63e4-4b43-849d-08b40bfff535', 'ac94868c-66cb-4125-8219-01e38efea7f7', 'a1ec4036-bc3b-4c63-9864-aba4554ebd58', '1f5b6f1b-3acd-4a5a-bbf8-ca8672204efc'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764013568', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG cinder.manager [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:52:11 user cinder-volume[73792]: INFO cinder.volume.manager [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Deleted volume successfully.
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=30,cinder:INSERT=4,cinder:UPDATE=10 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:52:11 user cinder-volume[73792]: DEBUG cinder.coordination [None req-bb4d3dd0-fcb8-437c-b16d-2081060cbbbb tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-60acd849-1228-4bc3-96bb-83c7991453b0-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:52:12 user cinder-volume[73792]: INFO cinder.action_track [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1430619267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c94a19e9-963c-4e8e-a613-6fc05da1dce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:52:12 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:52:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Flow 'volume_create_manager' (1e5ae709-7cec-446c-bd92-d57d7e7086b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:52:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372510dc-c5b7-4ecb-9c72-c8e346ec1893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:52:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372510dc-c5b7-4ecb-9c72-c8e346ec1893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1430619267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c94a19e9-963c-4e8e-a613-6fc05da1dce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:52:13Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:52:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7420320-9e37-48d0-8471-b7b1d56a4dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:52:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7420320-9e37-48d0-8471-b7b1d56a4dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:52:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afce83a-ca42-45dc-8eec-e161dc497fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afce83a-ca42-45dc-8eec-e161dc497fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'volume_name': 'volume-c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f876021d0c0>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44f9738-666d-4944-824c-1f50e8c126c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44f9738-666d-4944-824c-1f50e8c126c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263833cc-0b04-4d4d-b759-dedbed1bcedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:52:13 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Volume c94a19e9-963c-4e8e-a613-6fc05da1dce3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f876021d0c0>}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Cloning c94a19e9-963c-4e8e-a613-6fc05da1dce3 from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 52, 13, 81583)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Found cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 52, 13, 95265)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Creating from source image-volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] cloned volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] cloning v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] create snapshot v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_c94a19e9-963c-4e8e-a613-6fc05da1dce3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] create volume v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 from snapshot v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'is_clone': True, 'full_name': 'Pool-0/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'name': 'v_c94a19e9-963c-4e8e-a613-6fc05da1dce3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] get volume v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283750', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '61208', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2186582892601411844', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bf50f109c3d9ad67', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763964416', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38438', 'name': 'v_c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:14 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Marking volume c94a19e9-963c-4e8e-a613-6fc05da1dce3 as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:52:14 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to c94a19e9-963c-4e8e-a613-6fc05da1dce3. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:52:14 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Creating volume glance metadata for volume c94a19e9-963c-4e8e-a613-6fc05da1dce3 backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:52:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263833cc-0b04-4d4d-b759-dedbed1bcedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f876021d0c0>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:52:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b0ad99-3069-4c67-85b9-26d68c6cf763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:52:14 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Volume volume-c94a19e9-963c-4e8e-a613-6fc05da1dce3 (c94a19e9-963c-4e8e-a613-6fc05da1dce3): created successfully
Apr 12 06:52:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b0ad99-3069-4c67-85b9-26d68c6cf763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:52:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] Flow 'volume_create_manager' (1e5ae709-7cec-446c-bd92-d57d7e7086b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:52:14 user cinder-volume[73792]: INFO cinder.action_track [None req-dc4b18c6-8a15-42f4-8b15-f69c15a2d002 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1430619267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c94a19e9-963c-4e8e-a613-6fc05da1dce3,launched_at=2023-04-12T06:52:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP HvwNblrW rt5wAjfgRpUd31',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:52:13Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:52:13Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:52:16 user cinder-volume[73792]: INFO cinder.action_track [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1430619267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c94a19e9-963c-4e8e-a613-6fc05da1dce3,launched_at=2023-04-12T06:52:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP HvwNblrW rt5wAjfgRpUd31',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:52:13Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:52:16Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:52:16 user cinder-volume[73792]: INFO cinder.action_track [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1430619267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c94a19e9-963c-4e8e-a613-6fc05da1dce3,launched_at=2023-04-12T06:52:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP HvwNblrW rt5wAjfgRpUd31',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:52:13Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:52:16Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:52:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] create export for volume: c94a19e9-963c-4e8e-a613-6fc05da1dce3. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:52:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] ensure volume c94a19e9-963c-4e8e-a613-6fc05da1dce3 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:52:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] check if targe iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:52:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] create target and attach volume c94a19e9-963c-4e8e-a613-6fc05da1dce3 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:52:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] create target iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:52:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] atach volume v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 to target iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:52:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:20 user cinder-volume[73792]: INFO cinder.action_track [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375020388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9cbbb1a6-c094-4a11-beef-499b756020f2,launched_at=2023-04-12T06:48:35Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth='CHAP dMCckQRL NKXBhCtkFx2Mvc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:52:19Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:52:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] terminate connection for 9cbbb1a6-c094-4a11-beef-499b756020f2  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:52:20 user cinder-volume[73792]: INFO cinder.action_track [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375020388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9cbbb1a6-c094-4a11-beef-499b756020f2,launched_at=2023-04-12T06:48:35Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth='CHAP dMCckQRL NKXBhCtkFx2Mvc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:52:19Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:52:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] Deleting attachment 7ba3716d-63c3-4558-b567-2ebd73168dc9. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:52:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] remove_export for volume: 9cbbb1a6-c094-4a11-beef-499b756020f2. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:52:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:52:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375020388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9cbbb1a6-c094-4a11-beef-499b756020f2,launched_at=2023-04-12T06:48:35Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth='CHAP dMCckQRL NKXBhCtkFx2Mvc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:52:19Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:52:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] detach volume v_9cbbb1a6-c094-4a11-beef-499b756020f2 from target iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:52:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/luns/v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/luns/v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6266353066313039', 'lun': 0, 'mode': 'wt', 'name': 'v_c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'prod_id': 'Storage', 'scsi_id': 'bf50f109c3d9ad67'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] add credentails to target iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:52:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/luns/v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] delete target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:52:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] delete target iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:52:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'name': 'HvwNblrW'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] initialize_connection for c94a19e9-963c-4e8e-a613-6fc05da1dce3 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:52:22 user cinder-volume[73792]: INFO cinder.action_track [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvwNblrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '25944eb2-2045-43af-9383-e763b299a0ea'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1430619267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c94a19e9-963c-4e8e-a613-6fc05da1dce3,launched_at=2023-04-12T06:52:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP HvwNblrW rt5wAjfgRpUd31',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:52:13Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:52:16Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:52:22 user cinder-volume[73792]: INFO cinder.action_track [req-29ba84ac-7f59-43ae-85ea-71799fe37d5c req-8ef07974-b47d-4bb4-b015-5c882f48f288 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1430619267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c94a19e9-963c-4e8e-a613-6fc05da1dce3,launched_at=2023-04-12T06:52:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP HvwNblrW rt5wAjfgRpUd31',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:52:13Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:52:22Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:52:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b344c34e-0733-48b3-9e37-ef77f000f7a3 req-b22363be-715e-4bd2-b193-9116138f0f70 tempest-AttachVolumeShelveTestJSON-1986658224 None] target iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.coordination [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Acquiring lock "cinder-e07c955b-abdd-446f-9137-d12aef35b2c5-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.coordination [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Lock "cinder-e07c955b-abdd-446f-9137-d12aef35b2c5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] remove_export for volume: e07c955b-abdd-446f-9137-d12aef35b2c5. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123123454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e07c955b-abdd-446f-9137-d12aef35b2c5,launched_at=2023-04-12T06:49:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP UtjuFhmD oSn6pfkjtPO5UM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:49:30Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:52:29Z,updated_at=2023-04-12T06:52:29Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] detach volume v_e07c955b-abdd-446f-9137-d12aef35b2c5 from target iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/luns/v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/luns/v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/luns/v_e07c955b-abdd-446f-9137-d12aef35b2c5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5/luns/v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] failed to remove resource iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 because of JDSS resource v_e07c955b-abdd-446f-9137-d12aef35b2c5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] delete target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] delete target iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] failed to remove resource iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 because of JDSS resource iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] deleating volume v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] get snapshots for volume v_e07c955b-abdd-446f-9137-d12aef35b2c5  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] get volume v_e07c955b-abdd-446f-9137-d12aef35b2c5 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e07c955b-abdd-446f-9137-d12aef35b2c5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283588', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61141', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4622238543646522220', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'acda3db6abd7f185', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763939840', 'san:volume_id': 'acda3db6abd7f185c6f428faec6f6d689c8aa9d2', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39815', 'name': 'v_e07c955b-abdd-446f-9137-d12aef35b2c5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] delete volume:v_e07c955b-abdd-446f-9137-d12aef35b2c5 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114764046336', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] volume v_e07c955b-abdd-446f-9137-d12aef35b2c5 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.quota [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Created reservations ['bb4e4cb9-fe09-40b3-9958-5dca761e4018', 'fe2b2a48-28ac-4162-8aa3-c02759f08732', '7d47a7f0-001e-4e1d-8e4c-23512ebe0ee1', '93931aa0-7549-4fc8-9b80-75b797262a4c'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:52:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:52:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 200, 'error': None, 'data': {'available': '114764046336', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:52:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:52:31 user cinder-volume[73792]: DEBUG cinder.manager [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:52:31 user cinder-volume[73792]: INFO cinder.volume.manager [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Deleted volume successfully.
Apr 12 06:52:31 user cinder-volume[73792]: DEBUG cinder.coordination [None req-dda7010a-1573-473d-9bb0-6b2bdc737035 tempest-TestMinimumBasicScenario-1474504992 None] Lock "cinder-e07c955b-abdd-446f-9137-d12aef35b2c5-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:52:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=48,cinder:UPDATE=13,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:52:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=42,cinder:UPDATE=17,cinder:INSERT=9,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:53:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:53:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:53:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:53:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:53:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:53:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753880064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:53:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:53:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:53:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:54:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:54:06 user cinder-volume[73792]: INFO cinder.action_track [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T06:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='snapshot for tempest-TestVolumeBootPatternsnapshot-943632025',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=d8878eba-66cc-4e86-a34a-d46c8c7499ea,metadata={},progress='0%',project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume=<?>,volume_id=c94a19e9-963c-4e8e-a613-6fc05da1dce3,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:54:06 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:54:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] create snapshot d8878eba-66cc-4e86-a34a-d46c8c7499ea for volume c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 06:54:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] cloning v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 to s_d8878eba-66cc-4e86-a34a-d46c8c7499ea {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:54:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] create snapshot s_d8878eba-66cc-4e86-a34a-d46c8c7499ea {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:54:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:54:06 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:54:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_d8878eba-66cc-4e86-a34a-d46c8c7499ea'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:54:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] create volume s_d8878eba-66cc-4e86-a34a-d46c8c7499ea from snapshot s_d8878eba-66cc-4e86-a34a-d46c8c7499ea {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:54:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:54:07 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:54:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3@s_d8878eba-66cc-4e86-a34a-d46c8c7499ea', 'is_clone': True, 'full_name': 'Pool-0/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea', 'name': 's_d8878eba-66cc-4e86-a34a-d46c8c7499ea'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:54:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:54:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:54:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:54:08 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] volume s_d8878eba-66cc-4e86-a34a-d46c8c7499ea properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 06:54:08 user cinder-volume[73792]: INFO cinder.volume.manager [req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a req-93cdd3d9-e205-41c2-bab2-e96f1ad7b27f tempest-TestVolumeBootPattern-294210775 None] Create snapshot completed successfully
Apr 12 06:54:11 user cinder-volume[73792]: INFO cinder.action_track [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:54:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9659873a-a3f8-4402-ac09-ffa6dee6c8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8878eba-66cc-4e86-a34a-d46c8c7499ea,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Flow 'volume_create_manager' (03f6066a-3147-4ec5-b562-bf15a7580e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a383f8a8-e04d-4050-8748-d8039edad964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a383f8a8-e04d-4050-8748-d8039edad964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:54:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9659873a-a3f8-4402-ac09-ffa6dee6c8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8878eba-66cc-4e86-a34a-d46c8c7499ea,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:54:12Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92312c32-8d09-4399-9fc4-7b6184f5d14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92312c32-8d09-4399-9fc4-7b6184f5d14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a5eb7c-11ec-4985-b70c-0df05c18ed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a5eb7c-11ec-4985-b70c-0df05c18ed89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'volume_name': 'volume-9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'volume_size': 1, 'snapshot_id': 'd8878eba-66cc-4e86-a34a-d46c8c7499ea'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5cb39b-de18-4c46-bd94-33892bd97121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5cb39b-de18-4c46-bd94-33892bd97121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150915b1-7e1b-4df8-b98a-02833ccc8497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:54:11 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Volume 9659873a-a3f8-4402-ac09-ffa6dee6c8ad: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'volume_size': 1, 'snapshot_id': 'd8878eba-66cc-4e86-a34a-d46c8c7499ea'}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] create volume 9659873a-a3f8-4402-ac09-ffa6dee6c8ad from snapshot d8878eba-66cc-4e86-a34a-d46c8c7499ea {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] cloning s_d8878eba-66cc-4e86-a34a-d46c8c7499ea to v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] create snapshot v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:54:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] create volume v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad from snapshot v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea@v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'is_clone': True, 'full_name': 'Pool-0/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'name': 'v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] get volume v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea@v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283869', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '61246', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7918268674606359078', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd2c6c87f9927f251', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753847296', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38653', 'name': 'v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Marking volume 9659873a-a3f8-4402-ac09-ffa6dee6c8ad as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Copying metadata from snapshot d8878eba-66cc-4e86-a34a-d46c8c7499ea to 9659873a-a3f8-4402-ac09-ffa6dee6c8ad. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150915b1-7e1b-4df8-b98a-02833ccc8497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'volume_size': 1, 'snapshot_id': 'd8878eba-66cc-4e86-a34a-d46c8c7499ea'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cade8478-d8bb-45fd-a10b-88d0e11bc226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:54:12 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Volume volume-9659873a-a3f8-4402-ac09-ffa6dee6c8ad (9659873a-a3f8-4402-ac09-ffa6dee6c8ad): created successfully
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cade8478-d8bb-45fd-a10b-88d0e11bc226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:54:12 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] Flow 'volume_create_manager' (03f6066a-3147-4ec5-b562-bf15a7580e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:54:12 user cinder-volume[73792]: INFO cinder.action_track [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-d457e070-70d5-44a3-a3e8-cdce375627f9 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:54:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9659873a-a3f8-4402-ac09-ffa6dee6c8ad,launched_at=2023-04-12T06:54:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP venidAmR xJvrVhKUYcnwep',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:54:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d8878eba-66cc-4e86-a34a-d46c8c7499ea,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:54:12Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:54:17 user cinder-volume[73792]: INFO cinder.action_track [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:54:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9659873a-a3f8-4402-ac09-ffa6dee6c8ad,launched_at=2023-04-12T06:54:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP venidAmR xJvrVhKUYcnwep',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:54:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d8878eba-66cc-4e86-a34a-d46c8c7499ea,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:54:17Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:54:17 user cinder-volume[73792]: INFO cinder.action_track [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:54:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9659873a-a3f8-4402-ac09-ffa6dee6c8ad,launched_at=2023-04-12T06:54:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP venidAmR xJvrVhKUYcnwep',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:54:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d8878eba-66cc-4e86-a34a-d46c8c7499ea,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:54:17Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:54:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] create export for volume: 9659873a-a3f8-4402-ac09-ffa6dee6c8ad. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:54:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] ensure volume 9659873a-a3f8-4402-ac09-ffa6dee6c8ad assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:54:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] check if targe iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:54:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:54:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:54:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:54:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] create target and attach volume 9659873a-a3f8-4402-ac09-ffa6dee6c8ad to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:54:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] create target iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:54:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:54:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:54:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:54:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] atach volume v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad to target iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:54:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:54:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:54:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6432633663383766', 'lun': 0, 'mode': 'wt', 'name': 'v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'prod_id': 'Storage', 'scsi_id': 'd2c6c87f9927f251'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:54:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] add credentails to target iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:54:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:54:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:54:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'name': 'venidAmR'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:54:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] initialize_connection for 9659873a-a3f8-4402-ac09-ffa6dee6c8ad 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:54:21 user cinder-volume[73792]: INFO cinder.action_track [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'venidAmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '5cb99134-2017-4ec9-9483-f22723a7bd47'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:54:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9659873a-a3f8-4402-ac09-ffa6dee6c8ad,launched_at=2023-04-12T06:54:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP venidAmR xJvrVhKUYcnwep',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:54:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d8878eba-66cc-4e86-a34a-d46c8c7499ea,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:54:17Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:54:21 user cinder-volume[73792]: INFO cinder.action_track [req-2951af4a-7168-44c5-9948-e3fb34cc31fb req-ee783139-e9a1-4bb5-92b0-6ff27734b9c2 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:54:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9659873a-a3f8-4402-ac09-ffa6dee6c8ad,launched_at=2023-04-12T06:54:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP venidAmR xJvrVhKUYcnwep',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:54:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d8878eba-66cc-4e86-a34a-d46c8c7499ea,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:54:21Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:54:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:54:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:54:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:54:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:54:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:54:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753822720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:54:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:54:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:54:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=33,cinder:UPDATE=10,cinder:INSERT=12,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:54:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=33,cinder:INSERT=12,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:55:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:55:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:55:16 user cinder-volume[73792]: INFO cinder.action_track [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712385393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98d566ec-564b-4062-9a9a-09066ee60704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Flow 'volume_create_manager' (e9cf3f5e-34d9-452f-b5b8-6cde614d020f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107754ac-7f79-4149-83fb-0a62a0dae63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107754ac-7f79-4149-83fb-0a62a0dae63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712385393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98d566ec-564b-4062-9a9a-09066ee60704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:55:17Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abdd9e60-9672-461a-8081-b21572405607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abdd9e60-9672-461a-8081-b21572405607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168533bb-7f09-4f38-9f75-9882a3ea7114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168533bb-7f09-4f38-9f75-9882a3ea7114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98d566ec-564b-4062-9a9a-09066ee60704', 'volume_name': 'volume-98d566ec-564b-4062-9a9a-09066ee60704', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9979a66-6757-428c-8f98-85e8d0132214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9979a66-6757-428c-8f98-85e8d0132214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00c789f-699d-4a42-a69f-4e24d00a8aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:55:16 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Volume 98d566ec-564b-4062-9a9a-09066ee60704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98d566ec-564b-4062-9a9a-09066ee60704', 'volume_size': 1}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] creating volume v_98d566ec-564b-4062-9a9a-09066ee60704. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] create volume {'name': 'v_98d566ec-564b-4062-9a9a-09066ee60704', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:55:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:55:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_98d566ec-564b-4062-9a9a-09066ee60704', 'is_clone': False, 'name': 'v_98d566ec-564b-4062-9a9a-09066ee60704'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:55:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00c789f-699d-4a42-a69f-4e24d00a8aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d566ec-564b-4062-9a9a-09066ee60704', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:55:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d518d194-6659-433b-9821-bab692ef4429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:55:17 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Volume volume-98d566ec-564b-4062-9a9a-09066ee60704 (98d566ec-564b-4062-9a9a-09066ee60704): created successfully
Apr 12 06:55:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d518d194-6659-433b-9821-bab692ef4429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:55:17 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] Flow 'volume_create_manager' (e9cf3f5e-34d9-452f-b5b8-6cde614d020f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:55:17 user cinder-volume[73792]: INFO cinder.action_track [None req-73a9a969-9f46-4b2e-8711-e6d2f1730e71 tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712385393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98d566ec-564b-4062-9a9a-09066ee60704,launched_at=2023-04-12T06:55:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP KRuFkeig rHyTOsni26Auq7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:17Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:55:17Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:55:18 user cinder-volume[73792]: INFO cinder.action_track [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712385393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98d566ec-564b-4062-9a9a-09066ee60704,launched_at=2023-04-12T06:55:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP KRuFkeig rHyTOsni26Auq7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:17Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:55:18Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:55:18 user cinder-volume[73792]: INFO cinder.action_track [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712385393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98d566ec-564b-4062-9a9a-09066ee60704,launched_at=2023-04-12T06:55:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP KRuFkeig rHyTOsni26Auq7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:17Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:55:18Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:55:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] create export for volume: 98d566ec-564b-4062-9a9a-09066ee60704. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:55:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] ensure volume 98d566ec-564b-4062-9a9a-09066ee60704 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:55:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] check if targe iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:55:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:55:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:55:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:55:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] create target and attach volume 98d566ec-564b-4062-9a9a-09066ee60704 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:55:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] create target iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:55:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:55:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:55:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:55:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] atach volume v_98d566ec-564b-4062-9a9a-09066ee60704 to target iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:55:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:55:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:55:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3736626535396538', 'lun': 0, 'mode': 'wt', 'name': 'v_98d566ec-564b-4062-9a9a-09066ee60704', 'prod_id': 'Storage', 'scsi_id': '76be59e85d122ebf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:55:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] add credentails to target iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:55:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:55:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:55:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 201, 'error': None, 'data': {'name': 'KRuFkeig'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:55:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] initialize_connection for 98d566ec-564b-4062-9a9a-09066ee60704 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:55:22 user cinder-volume[73792]: INFO cinder.action_track [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRuFkeig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '776d2056-7ee7-48bd-9a5b-e8eea1485e29'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712385393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98d566ec-564b-4062-9a9a-09066ee60704,launched_at=2023-04-12T06:55:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP KRuFkeig rHyTOsni26Auq7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:17Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:55:18Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:55:22 user cinder-volume[73792]: INFO cinder.action_track [req-0a688c63-f92b-4210-8416-35455a8bb8b0 req-9e480270-d360-4bc4-96ff-fbf7d50be594 tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712385393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98d566ec-564b-4062-9a9a-09066ee60704,launched_at=2023-04-12T06:55:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP KRuFkeig rHyTOsni26Auq7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:17Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:55:22Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:55:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:55:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:55:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:55:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:55:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:55:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753388544', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:55:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:55:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:55:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=7,cinder:SELECT=18 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:55:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=21,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:55:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:55:54 user cinder-volume[73792]: INFO cinder.action_track [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-290001514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6550026c-a3ce-49ae-8fa4-8a420acf0814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Flow 'volume_create_manager' (df213754-670f-4658-a81e-e50adbb21cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f7bea4-ab45-4b11-a014-d2e6a4d60594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f7bea4-ab45-4b11-a014-d2e6a4d60594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-290001514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6550026c-a3ce-49ae-8fa4-8a420acf0814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:55:55Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04387d96-6a5c-4aed-9515-79437eaa62fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04387d96-6a5c-4aed-9515-79437eaa62fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0488b09-ed2c-49d3-8059-72996ec5a3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0488b09-ed2c-49d3-8059-72996ec5a3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6550026c-a3ce-49ae-8fa4-8a420acf0814', 'volume_name': 'volume-6550026c-a3ce-49ae-8fa4-8a420acf0814', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f44e82-9662-4b0f-bbe2-6e8992c56415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f44e82-9662-4b0f-bbe2-6e8992c56415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94d0a9c-0003-4ef3-8294-8b0268fe1fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:55:54 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Volume 6550026c-a3ce-49ae-8fa4-8a420acf0814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6550026c-a3ce-49ae-8fa4-8a420acf0814', 'volume_size': 1}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] creating volume v_6550026c-a3ce-49ae-8fa4-8a420acf0814. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] create volume {'name': 'v_6550026c-a3ce-49ae-8fa4-8a420acf0814', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:55:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:55:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6550026c-a3ce-49ae-8fa4-8a420acf0814', 'is_clone': False, 'name': 'v_6550026c-a3ce-49ae-8fa4-8a420acf0814'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:55:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94d0a9c-0003-4ef3-8294-8b0268fe1fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6550026c-a3ce-49ae-8fa4-8a420acf0814', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:55:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfae007-4865-45c6-906c-434db75ded52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:55:55 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Volume volume-6550026c-a3ce-49ae-8fa4-8a420acf0814 (6550026c-a3ce-49ae-8fa4-8a420acf0814): created successfully
Apr 12 06:55:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfae007-4865-45c6-906c-434db75ded52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:55:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] Flow 'volume_create_manager' (df213754-670f-4658-a81e-e50adbb21cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:55:55 user cinder-volume[73792]: INFO cinder.action_track [None req-4beb5488-4bb4-4cae-8052-a6bbd7bb96a3 tempest-AttachVolumeShelveTestJSON-1986658224 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-290001514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6550026c-a3ce-49ae-8fa4-8a420acf0814,launched_at=2023-04-12T06:55:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth='CHAP GuqevMms DhVsUBl1oyd8mW',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:55Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:55:55Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:56:02 user cinder-volume[73792]: INFO cinder.action_track [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:54:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9659873a-a3f8-4402-ac09-ffa6dee6c8ad,launched_at=2023-04-12T06:54:13Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP venidAmR xJvrVhKUYcnwep',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:54:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d8878eba-66cc-4e86-a34a-d46c8c7499ea,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:54:21Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] terminate connection for 9659873a-a3f8-4402-ac09-ffa6dee6c8ad  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:56:02 user cinder-volume[73792]: INFO cinder.action_track [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:54:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9659873a-a3f8-4402-ac09-ffa6dee6c8ad,launched_at=2023-04-12T06:54:13Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP venidAmR xJvrVhKUYcnwep',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:54:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d8878eba-66cc-4e86-a34a-d46c8c7499ea,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:54:21Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] Deleting attachment 5cb99134-2017-4ec9-9483-f22723a7bd47. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] remove_export for volume: 9659873a-a3f8-4402-ac09-ffa6dee6c8ad. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:54:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9659873a-a3f8-4402-ac09-ffa6dee6c8ad,launched_at=2023-04-12T06:54:13Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP venidAmR xJvrVhKUYcnwep',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:54:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d8878eba-66cc-4e86-a34a-d46c8c7499ea,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:54:21Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] detach volume v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad from target iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/luns/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/luns/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/luns/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] delete target: iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] delete target iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-98456e80-0e01-4cec-9e20-5de4267422f1 tempest-TestVolumeBootPattern-294210775 None] target iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.coordination [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Acquiring lock "cinder-9659873a-a3f8-4402-ac09-ffa6dee6c8ad-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.coordination [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-9659873a-a3f8-4402-ac09-ffa6dee6c8ad-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] remove_export for volume: 9659873a-a3f8-4402-ac09-ffa6dee6c8ad. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:54:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9659873a-a3f8-4402-ac09-ffa6dee6c8ad,launched_at=2023-04-12T06:54:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP venidAmR xJvrVhKUYcnwep',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:54:12Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=d8878eba-66cc-4e86-a34a-d46c8c7499ea,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:56:03Z,updated_at=2023-04-12T06:56:03Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] detach volume v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad from target iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/luns/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/luns/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/luns/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad/luns/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] failed to remove resource iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad because of JDSS resource v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] delete target: iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] delete target iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] failed to remove resource iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad because of JDSS resource iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] deleating volume v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] get snapshots for volume v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] get volume v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:56:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea@v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283869', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '61246', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7918268674606359078', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '282624', 'logicalused': '1228800', 'compressratio': '5.26', 'rootcontext': 'none', 'default_scsi_id': 'd2c6c87f9927f251', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753277952', 'san:volume_id': 'd2c6c87f9927f251b67ae73d0bcc092a34e2810a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '282624', 'objsetid': '38653', 'name': 'v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '282624', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] delete snapshot v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad of volume s_d8878eba-66cc-4e86-a34a-d46c8c7499ea {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:56:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/snapshots/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/snapshots/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/snapshots/v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:03 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] snapshot v_9659873a-a3f8-4402-ac09-ffa6dee6c8ad deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:56:04 user cinder-volume[73792]: DEBUG cinder.quota [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Created reservations ['e2b4cd15-ca0c-4980-bb9a-b692d78a09b1', 'a4834e61-e9c7-4daf-a39c-c26589538041', 'e3a3b1a3-229f-498f-a72f-5f8f857438ff', 'aef27506-5ee6-42b8-9576-06e11999415c'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:56:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:56:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:56:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753585152', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:56:04 user cinder-volume[73792]: DEBUG cinder.manager [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:56:04 user cinder-volume[73792]: INFO cinder.volume.manager [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Deleted volume successfully.
Apr 12 06:56:04 user cinder-volume[73792]: DEBUG cinder.coordination [req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 req-f3f1ec04-d2cc-46e4-b2e2-08af6e0a6364 tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-9659873a-a3f8-4402-ac09-ffa6dee6c8ad-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:56:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=20,cinder:UPDATE=11,cinder:INSERT=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:56:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=27,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:56:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:56:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:56:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:56:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753585152', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:56:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:56:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Acquiring lock "cinder-d8878eba-66cc-4e86-a34a-d46c8c7499ea-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:56:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-d8878eba-66cc-4e86-a34a-d46c8c7499ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:56:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] deleating snapshot s_d8878eba-66cc-4e86-a34a-d46c8c7499ea. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 06:56:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] get snapshots for volume s_d8878eba-66cc-4e86-a34a-d46c8c7499ea  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:56:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] get volume s_d8878eba-66cc-4e86-a34a-d46c8c7499ea info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3@s_d8878eba-66cc-4e86-a34a-d46c8c7499ea', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283865', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '61240', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9488256291419684174', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '050c73ac3f1e37c4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753585152', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '38635', 'name': 's_d8878eba-66cc-4e86-a34a-d46c8c7499ea', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] delete snapshot s_d8878eba-66cc-4e86-a34a-d46c8c7499ea of volume v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3/snapshots/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3/snapshots/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=8 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3/snapshots/s_d8878eba-66cc-4e86-a34a-d46c8c7499ea {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] snapshot s_d8878eba-66cc-4e86-a34a-d46c8c7499ea deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG cinder.quota [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Created reservations ['c6391772-1013-4f3c-ab46-368a9e5381cd', '297cb11d-4a5b-4ceb-a32f-1d499bc6e7e5', 'b06c34e2-c836-42fc-b7cb-82716ba01e68', 'ca0bfb06-0145-4f6e-ac9d-d9810a7ece08'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:56:51 user cinder-volume[73792]: INFO cinder.volume.manager [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Delete snapshot completed successfully.
Apr 12 06:56:51 user cinder-volume[73792]: DEBUG cinder.coordination [None req-542f4bd2-c7c0-4d1b-97a6-d689e2541e5a tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-d8878eba-66cc-4e86-a34a-d46c8c7499ea-delete_snapshot" released by "delete_snapshot" :: held 1.146s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:56:55 user cinder-volume[73792]: INFO cinder.action_track [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1430619267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c94a19e9-963c-4e8e-a613-6fc05da1dce3,launched_at=2023-04-12T06:52:14Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP HvwNblrW rt5wAjfgRpUd31',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:52:13Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:52:22Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] terminate connection for c94a19e9-963c-4e8e-a613-6fc05da1dce3  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:56:55 user cinder-volume[73792]: INFO cinder.action_track [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1430619267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c94a19e9-963c-4e8e-a613-6fc05da1dce3,launched_at=2023-04-12T06:52:14Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP HvwNblrW rt5wAjfgRpUd31',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:52:13Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:52:22Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] Deleting attachment 25944eb2-2045-43af-9383-e763b299a0ea. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] remove_export for volume: c94a19e9-963c-4e8e-a613-6fc05da1dce3. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1430619267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c94a19e9-963c-4e8e-a613-6fc05da1dce3,launched_at=2023-04-12T06:52:14Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP HvwNblrW rt5wAjfgRpUd31',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:52:13Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:52:22Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] detach volume v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 from target iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/luns/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/luns/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/luns/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] delete target: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] delete target iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-8f57f570-d63c-4ddd-8c88-828d7d73dbab tempest-TestVolumeBootPattern-294210775 None] target iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.coordination [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Acquiring lock "cinder-c94a19e9-963c-4e8e-a613-6fc05da1dce3-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.coordination [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-c94a19e9-963c-4e8e-a613-6fc05da1dce3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] remove_export for volume: c94a19e9-963c-4e8e-a613-6fc05da1dce3. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1430619267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c94a19e9-963c-4e8e-a613-6fc05da1dce3,launched_at=2023-04-12T06:52:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP HvwNblrW rt5wAjfgRpUd31',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:52:13Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:56:56Z,updated_at=2023-04-12T06:56:56Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] detach volume v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 from target iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/luns/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/luns/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/luns/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3/luns/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] failed to remove resource iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 because of JDSS resource v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] delete target: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] delete target iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] failed to remove resource iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 because of JDSS resource iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] deleating volume v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] get snapshots for volume v_c94a19e9-963c-4e8e-a613-6fc05da1dce3  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] get volume v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:56:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283750', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '61208', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2186582892601411844', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10129408', 'logicalused': '25899008', 'compressratio': '2.57', 'rootcontext': 'none', 'default_scsi_id': 'bf50f109c3d9ad67', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753642496', 'san:volume_id': 'bf50f109c3d9ad678e1f096d01008fb6eab43cec', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10129408', 'objsetid': '38438', 'name': 'v_c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10129408', 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] delete snapshot v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 of volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 06:56:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:56 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] snapshot v_c94a19e9-963c-4e8e-a613-6fc05da1dce3 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 06:56:56 user cinder-volume[73792]: DEBUG cinder.quota [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Created reservations ['604eebd7-239c-46d0-9a45-4de1afdd757d', 'eb165a1a-6ba8-4273-841f-a8ab97ca9890', '68480e72-5a25-4cee-9d9d-beff6d67ba8e', 'f6de883b-c364-435c-bec3-cd02eb166887'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:56:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:56:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:56:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:56:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:56:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763845632', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:56:57 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:56:57 user cinder-volume[73792]: DEBUG cinder.manager [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:56:57 user cinder-volume[73792]: INFO cinder.volume.manager [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Deleted volume successfully.
Apr 12 06:56:57 user cinder-volume[73792]: DEBUG cinder.coordination [req-46e62d48-0e50-4290-b69e-64719efe88e4 req-99a100a5-e8da-4b6c-a7da-ed20d9c6bf4a tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-c94a19e9-963c-4e8e-a613-6fc05da1dce3-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:57:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=28,cinder:UPDATE=18,cinder:INSERT=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:57:22 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=28,cinder:INSERT=5,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:57:22 user cinder-volume[73792]: INFO cinder.action_track [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712385393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98d566ec-564b-4062-9a9a-09066ee60704,launched_at=2023-04-12T06:55:17Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP KRuFkeig rHyTOsni26Auq7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:17Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:57:22Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:57:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] terminate connection for 98d566ec-564b-4062-9a9a-09066ee60704  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:57:22 user cinder-volume[73792]: INFO cinder.action_track [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712385393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98d566ec-564b-4062-9a9a-09066ee60704,launched_at=2023-04-12T06:55:17Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP KRuFkeig rHyTOsni26Auq7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:17Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:57:22Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:57:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] Deleting attachment 776d2056-7ee7-48bd-9a5b-e8eea1485e29. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:57:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] remove_export for volume: 98d566ec-564b-4062-9a9a-09066ee60704. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:57:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:57:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712385393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98d566ec-564b-4062-9a9a-09066ee60704,launched_at=2023-04-12T06:55:17Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP KRuFkeig rHyTOsni26Auq7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:17Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-12T06:57:22Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:57:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] detach volume v_98d566ec-564b-4062-9a9a-09066ee60704 from target iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:57:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/luns/v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:57:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/luns/v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:57:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/luns/v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:57:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] delete target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:57:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] delete target iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:57:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:57:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:57:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:57:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c9a65da6-da5f-411d-a580-c022f649a5b4 req-60296e02-d5a3-49c9-9ff4-0cf4b357acd5 tempest-TestMinimumBasicScenario-1474504992 None] target iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:57:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:57:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:57:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:57:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:57:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:57:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114763845632', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:57:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:57:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:57:45 user cinder-volume[73792]: INFO cinder.action_track [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Flow 'volume_create_manager' (d7cc15bb-ebda-4dba-a857-07cbe1e8c67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5678d55-5e74-4e54-ba37-d9ede199055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5678d55-5e74-4e54-ba37-d9ede199055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:57:46Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7781c61-d190-473d-bc5d-762706112b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7781c61-d190-473d-bc5d-762706112b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d242ad-1a59-4b55-853b-8709cd88dda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d242ad-1a59-4b55-853b-8709cd88dda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'volume_name': 'volume-1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769c7c9a0>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17ea95d-e863-4221-95a7-273d066bb10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17ea95d-e863-4221-95a7-273d066bb10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ac34b4-d27c-4fa5-a28c-324c317b63d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:57:45 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Volume 1640bd09-1264-4e82-9e6e-0f1fa3cc654b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769c7c9a0>}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Cloning 1640bd09-1264-4e82-9e6e-0f1fa3cc654b from image 4f2549ed-915f-4494-87f3-9269834fa9da  at location (None, None). {{(pid=73792) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Acquiring lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" by "_prepare_image_cache_entry" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 57, 45, 744675)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Found cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.coordination [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-4f2549ed-915f-4494-87f3-9269834fa9da" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Attempting to retrieve cache entry for image = 4f2549ed-915f-4494-87f3-9269834fa9da on host user@joviandss-2#joviandss-2. {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Found image-volume cache entry: {'id': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'volume_id': 'fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3), 'last_used': datetime.datetime(2023, 4, 12, 6, 57, 45, 762734)}. {{(pid=73792) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.image.cache [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Image-volume cache entry image_update_at = 2023-04-12 06:18:03+00:00, requested image updated_at = 2023-04-12 06:18:03+00:00. {{(pid=73792) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Creating from source image-volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] cloned volume fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to 1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] cloning v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f to v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] create snapshot v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:57:45 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] create volume v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b from snapshot v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'is_clone': True, 'full_name': 'Pool-0/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'name': 'v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] get volume v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284083', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '61324', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13858606108262137367', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '419dafea0aadac2b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763821056', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39449', 'name': 'v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Marking volume 1640bd09-1264-4e82-9e6e-0f1fa3cc654b as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Copying metadata from image 4f2549ed-915f-4494-87f3-9269834fa9da to 1640bd09-1264-4e82-9e6e-0f1fa3cc654b. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Creating volume glance metadata for volume 1640bd09-1264-4e82-9e6e-0f1fa3cc654b backed by image 4f2549ed-915f-4494-87f3-9269834fa9da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73792) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ac34b4-d27c-4fa5-a28c-324c317b63d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'volume_size': 1, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd17c81157dc240a396f20e397d55ef65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'created_at': datetime.datetime(2023, 4, 12, 6, 18, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 12, 6, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f2549ed-915f-4494-87f3-9269834fa9da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8769c7c9a0>}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e29dfee-eec3-4550-a0aa-44dbd1ed3763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:57:46 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Volume volume-1640bd09-1264-4e82-9e6e-0f1fa3cc654b (1640bd09-1264-4e82-9e6e-0f1fa3cc654b): created successfully
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e29dfee-eec3-4550-a0aa-44dbd1ed3763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:57:46 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] Flow 'volume_create_manager' (d7cc15bb-ebda-4dba-a857-07cbe1e8c67d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:57:46 user cinder-volume[73792]: INFO cinder.action_track [None req-d751b588-fa9a-4495-94b8-9f245c322d34 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:57:46Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:57:47 user cinder-volume[73792]: INFO cinder.action_track [req-fc9b3a44-f334-4276-ae23-d583270491da req-a701e4f5-bf23-453a-8a94-0434f4156407 tempest-AttachVolumeShelveTestJSON-1986658224 None] ACTION:'volume_detach' MSG:'No connector for attachment 31b17da4-fecb-4e9a-ad29-917836e54df5; skipping storage backend terminate_connection call.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5024:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-290001514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6550026c-a3ce-49ae-8fa4-8a420acf0814,launched_at=2023-04-12T06:55:55Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth='CHAP GuqevMms DhVsUBl1oyd8mW',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:55Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:57:47Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:57:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-fc9b3a44-f334-4276-ae23-d583270491da req-a701e4f5-bf23-453a-8a94-0434f4156407 tempest-AttachVolumeShelveTestJSON-1986658224 None] Deleting attachment 31b17da4-fecb-4e9a-ad29-917836e54df5. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:57:49 user cinder-volume[73792]: INFO cinder.action_track [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:57:48Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:57:49 user cinder-volume[73792]: INFO cinder.action_track [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:57:48Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:57:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] create export for volume: 1640bd09-1264-4e82-9e6e-0f1fa3cc654b. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 06:57:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] ensure volume 1640bd09-1264-4e82-9e6e-0f1fa3cc654b assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 06:57:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] check if targe iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 06:57:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:57:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:57:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:57:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] create target and attach volume 1640bd09-1264-4e82-9e6e-0f1fa3cc654b to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 06:57:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] create target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 06:57:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:57:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:57:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=26,cinder:UPDATE=5,cinder:INSERT=8,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:57:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:57:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] atach volume v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b to target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 06:57:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:57:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:57:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3431396461666561', 'lun': 0, 'mode': 'wt', 'name': 'v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'prod_id': 'Storage', 'scsi_id': '419dafea0aadac2b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:57:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] add credentails to target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 06:57:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:57:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:57:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'name': 'hRcotZzs'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:57:53 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=26,cinder:UPDATE=5,cinder:INSERT=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:57:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] initialize_connection for 1640bd09-1264-4e82-9e6e-0f1fa3cc654b 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 06:57:53 user cinder-volume[73792]: INFO cinder.action_track [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRcotZzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '78754aa9-e953-494c-9f8c-ff85f76ed217'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T06:57:48Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:57:53 user cinder-volume[73792]: INFO cinder.action_track [req-d5dead29-f4a6-477d-bfe4-79188b190b4b req-c6968961-6449-4f0d-9eb9-57e40cd7155b tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T06:57:54Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Acquiring lock "cinder-98d566ec-564b-4062-9a9a-09066ee60704-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Lock "cinder-98d566ec-564b-4062-9a9a-09066ee60704-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] remove_export for volume: 98d566ec-564b-4062-9a9a-09066ee60704. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-712385393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=98d566ec-564b-4062-9a9a-09066ee60704,launched_at=2023-04-12T06:55:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aacffb9fbd4398b98db1f1945138dc',provider_auth='CHAP KRuFkeig rHyTOsni26Auq7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:17Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:58:12Z,updated_at=2023-04-12T06:58:12Z,use_quota=True,user_id='2a188723ace3460792ed32d13bfe0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] detach volume v_98d566ec-564b-4062-9a9a-09066ee60704 from target iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/luns/v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/luns/v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/luns/v_98d566ec-564b-4062-9a9a-09066ee60704'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704/luns/v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] failed to remove resource iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 because of JDSS resource v_98d566ec-564b-4062-9a9a-09066ee60704 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] delete target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] delete target iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] failed to remove resource iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 because of JDSS resource iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] deleating volume v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] get snapshots for volume v_98d566ec-564b-4062-9a9a-09066ee60704  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98d566ec-564b-4062-9a9a-09066ee60704/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98d566ec-564b-4062-9a9a-09066ee60704/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98d566ec-564b-4062-9a9a-09066ee60704/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] get volume v_98d566ec-564b-4062-9a9a-09066ee60704 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_98d566ec-564b-4062-9a9a-09066ee60704', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283934', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61266', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2061378492453380280', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '76be59e85d122ebf', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763694080', 'san:volume_id': '76be59e85d122ebfc18d0c87de0f55da1481f643', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38942', 'name': 'v_98d566ec-564b-4062-9a9a-09066ee60704', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] delete volume:v_98d566ec-564b-4062-9a9a-09066ee60704 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:58:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:58:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:58:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] volume v_98d566ec-564b-4062-9a9a-09066ee60704 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:58:13 user cinder-volume[73792]: DEBUG cinder.quota [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Created reservations ['4ade3bee-2c30-4477-94b0-1057da40eaf3', '161cd36a-9f2c-442a-98aa-767d5e16ad15', '6b87bb34-28c5-41e4-b37e-5e05558ebd0a', 'ba3b8694-17e0-4773-b3e0-71a463095638'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:58:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:58:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:58:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:58:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:58:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753957888', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:58:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:58:14 user cinder-volume[73792]: DEBUG cinder.manager [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:58:14 user cinder-volume[73792]: INFO cinder.volume.manager [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Deleted volume successfully.
Apr 12 06:58:14 user cinder-volume[73792]: DEBUG cinder.coordination [None req-5536657f-2f20-4ad3-a65a-e92c391d27c7 tempest-TestMinimumBasicScenario-1474504992 None] Lock "cinder-98d566ec-564b-4062-9a9a-09066ee60704-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:58:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:58:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:58:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:58:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:58:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753765376', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:58:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:58:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:58:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=13,cinder:SELECT=29,cinder:INSERT=2,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:58:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=22,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:59:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:59:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:59:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:59:13 user cinder-volume[73792]: INFO cinder.action_track [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-743024083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=50359676-64cd-4d8f-90b6-422147ca796d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Flow 'volume_create_manager' (ffade085-0b08-4981-8366-7067def84b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46aa25d0-bcbf-403f-8e6e-5efd70725c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46aa25d0-bcbf-403f-8e6e-5efd70725c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-743024083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=50359676-64cd-4d8f-90b6-422147ca796d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:59:13Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82aef9dd-895b-4005-a17d-fca03ad2773b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82aef9dd-895b-4005-a17d-fca03ad2773b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30759ec9-30d2-483e-babe-c07d897a7356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30759ec9-30d2-483e-babe-c07d897a7356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50359676-64cd-4d8f-90b6-422147ca796d', 'volume_name': 'volume-50359676-64cd-4d8f-90b6-422147ca796d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2070d70d-38dd-4481-b0f0-1d2a5aa740f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2070d70d-38dd-4481-b0f0-1d2a5aa740f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114c0d93-282d-4126-bca6-6965e4cbc204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:13 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Volume 50359676-64cd-4d8f-90b6-422147ca796d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50359676-64cd-4d8f-90b6-422147ca796d', 'volume_size': 1}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] creating volume v_50359676-64cd-4d8f-90b6-422147ca796d. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] create volume {'name': 'v_50359676-64cd-4d8f-90b6-422147ca796d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:13 user cinder-volume[73792]: INFO cinder.action_track [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938934780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d55fe97a-d21d-4cfb-891b-fa94e5be4993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Flow 'volume_create_manager' (001584b6-ccd0-4150-a0c2-16d05f75fb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13fe85a6-9714-42b1-ba9e-e36fd44e5662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13fe85a6-9714-42b1-ba9e-e36fd44e5662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938934780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d55fe97a-d21d-4cfb-891b-fa94e5be4993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:59:14Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac98531-6a19-4a4d-97ac-664137e58d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac98531-6a19-4a4d-97ac-664137e58d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cfa89a-0763-4eae-9758-bbb684aa6f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cfa89a-0763-4eae-9758-bbb684aa6f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd55fe97a-d21d-4cfb-891b-fa94e5be4993', 'volume_name': 'volume-d55fe97a-d21d-4cfb-891b-fa94e5be4993', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a823854-1147-444e-b468-ed038749b178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a823854-1147-444e-b468-ed038749b178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4f6446-7f30-4a61-bcda-fb24822675ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:13 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Volume d55fe97a-d21d-4cfb-891b-fa94e5be4993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d55fe97a-d21d-4cfb-891b-fa94e5be4993', 'volume_size': 1}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] creating volume v_d55fe97a-d21d-4cfb-891b-fa94e5be4993. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] create volume {'name': 'v_d55fe97a-d21d-4cfb-891b-fa94e5be4993', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_50359676-64cd-4d8f-90b6-422147ca796d', 'is_clone': False, 'name': 'v_50359676-64cd-4d8f-90b6-422147ca796d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114c0d93-282d-4126-bca6-6965e4cbc204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50359676-64cd-4d8f-90b6-422147ca796d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5bc054-940e-4b13-97f2-76eb304e017f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Volume volume-50359676-64cd-4d8f-90b6-422147ca796d (50359676-64cd-4d8f-90b6-422147ca796d): created successfully
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5bc054-940e-4b13-97f2-76eb304e017f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] Flow 'volume_create_manager' (ffade085-0b08-4981-8366-7067def84b49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:59:14 user cinder-volume[73792]: INFO cinder.action_track [None req-c9e45cfa-ab7e-41ad-95f0-d376b7a88f60 tempest-CreateVolumesFromImageTest-227471221 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-743024083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=50359676-64cd-4d8f-90b6-422147ca796d,launched_at=2023-04-12T06:59:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth='CHAP vMdXmSxN 3HUqxDwfeQTSgE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:13Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:59:13Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:59:14 user cinder-volume[73792]: INFO cinder.action_track [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1301155182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e02dc7fe-57ab-48de-9fcc-654e731bc837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Flow 'volume_create_manager' (595d9e5b-87d7-43c7-bb71-dbafcc053687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75fc593-fa5d-4905-8362-1ff600d6fd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993', 'is_clone': False, 'name': 'v_d55fe97a-d21d-4cfb-891b-fa94e5be4993'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75fc593-fa5d-4905-8362-1ff600d6fd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1301155182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e02dc7fe-57ab-48de-9fcc-654e731bc837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:59:14Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17212c52-14cf-4ed9-8a2d-93bc8a4c9128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17212c52-14cf-4ed9-8a2d-93bc8a4c9128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19803803-99fe-42e0-bb53-7d5a1facf8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19803803-99fe-42e0-bb53-7d5a1facf8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e02dc7fe-57ab-48de-9fcc-654e731bc837', 'volume_name': 'volume-e02dc7fe-57ab-48de-9fcc-654e731bc837', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4846d0a-e92b-4dfe-8428-320aa1da4feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4846d0a-e92b-4dfe-8428-320aa1da4feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2dbb863-0818-4c6b-8432-8aae803f0b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Volume e02dc7fe-57ab-48de-9fcc-654e731bc837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e02dc7fe-57ab-48de-9fcc-654e731bc837', 'volume_size': 1}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] creating volume v_e02dc7fe-57ab-48de-9fcc-654e731bc837. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] create volume {'name': 'v_e02dc7fe-57ab-48de-9fcc-654e731bc837', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:14 user cinder-volume[73792]: INFO cinder.action_track [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139277352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5b93c0c9-2792-436d-937b-9b3dadca364e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4f6446-7f30-4a61-bcda-fb24822675ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d55fe97a-d21d-4cfb-891b-fa94e5be4993', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bff3f6-86a9-4314-9fd3-d81c8270ff6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Volume volume-d55fe97a-d21d-4cfb-891b-fa94e5be4993 (d55fe97a-d21d-4cfb-891b-fa94e5be4993): created successfully
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bff3f6-86a9-4314-9fd3-d81c8270ff6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] Flow 'volume_create_manager' (001584b6-ccd0-4150-a0c2-16d05f75fb65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Flow 'volume_create_manager' (ee98b449-b696-4212-b6e5-6c78905a3a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6668419b-d973-4d22-9d9c-24cfabc0cc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: INFO cinder.action_track [None req-9fa365a6-0cba-4350-9029-7d0d9b108ffe tempest-CreateVolumesFromImageTest-227471221 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938934780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d55fe97a-d21d-4cfb-891b-fa94e5be4993,launched_at=2023-04-12T06:59:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth='CHAP tlKejVyN dMg1pV3Wl2GfB7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:59:14Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6668419b-d973-4d22-9d9c-24cfabc0cc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139277352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5b93c0c9-2792-436d-937b-9b3dadca364e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:59:14Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b4cd7d-e84f-4e6c-bf99-49bd0b5eaa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b4cd7d-e84f-4e6c-bf99-49bd0b5eaa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45050416-6c18-4614-8733-e364c5126315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45050416-6c18-4614-8733-e364c5126315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b93c0c9-2792-436d-937b-9b3dadca364e', 'volume_name': 'volume-5b93c0c9-2792-436d-937b-9b3dadca364e', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d828dac-90bc-4af6-9847-e1364b8b4019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d828dac-90bc-4af6-9847-e1364b8b4019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8749aa6-5f53-4714-9fc0-f3298daabd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Volume 5b93c0c9-2792-436d-937b-9b3dadca364e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b93c0c9-2792-436d-937b-9b3dadca364e', 'volume_size': 1}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] creating volume v_5b93c0c9-2792-436d-937b-9b3dadca364e. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] create volume {'name': 'v_5b93c0c9-2792-436d-937b-9b3dadca364e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:14 user cinder-volume[73792]: INFO cinder.action_track [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-492126874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6dc4f9a0-1972-4f7a-9200-db48b532211c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Flow 'volume_create_manager' (3202c22f-1e24-44fe-ae6a-fdb68e9a4773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d801c0b8-3e65-4fef-b441-fea02180d246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d801c0b8-3e65-4fef-b441-fea02180d246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-492126874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6dc4f9a0-1972-4f7a-9200-db48b532211c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T06:59:14Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704d5793-bab2-4cd0-88b1-1131369663a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704d5793-bab2-4cd0-88b1-1131369663a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7acecadd-dfa8-40e7-a2a9-2c0426b69e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7acecadd-dfa8-40e7-a2a9-2c0426b69e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc4f9a0-1972-4f7a-9200-db48b532211c', 'volume_name': 'volume-6dc4f9a0-1972-4f7a-9200-db48b532211c', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520b4006-19dc-4aae-baff-ab1d1927a50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520b4006-19dc-4aae-baff-ab1d1927a50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0b7a71-9dd9-44c1-8589-c93e3e6864f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Volume 6dc4f9a0-1972-4f7a-9200-db48b532211c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc4f9a0-1972-4f7a-9200-db48b532211c', 'volume_size': 1}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] creating volume v_6dc4f9a0-1972-4f7a-9200-db48b532211c. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] create volume {'name': 'v_6dc4f9a0-1972-4f7a-9200-db48b532211c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e02dc7fe-57ab-48de-9fcc-654e731bc837', 'is_clone': False, 'name': 'v_e02dc7fe-57ab-48de-9fcc-654e731bc837'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5b93c0c9-2792-436d-937b-9b3dadca364e', 'is_clone': False, 'name': 'v_5b93c0c9-2792-436d-937b-9b3dadca364e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2dbb863-0818-4c6b-8432-8aae803f0b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02dc7fe-57ab-48de-9fcc-654e731bc837', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a52a91-afe9-41fe-b118-9f8ceaa8f0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8749aa6-5f53-4714-9fc0-f3298daabd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b93c0c9-2792-436d-937b-9b3dadca364e', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d71758-433a-4f1b-a285-c852bfed8005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:14 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Volume volume-e02dc7fe-57ab-48de-9fcc-654e731bc837 (e02dc7fe-57ab-48de-9fcc-654e731bc837): created successfully
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a52a91-afe9-41fe-b118-9f8ceaa8f0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] Flow 'volume_create_manager' (595d9e5b-87d7-43c7-bb71-dbafcc053687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:59:14 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Volume volume-5b93c0c9-2792-436d-937b-9b3dadca364e (5b93c0c9-2792-436d-937b-9b3dadca364e): created successfully
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d71758-433a-4f1b-a285-c852bfed8005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] Flow 'volume_create_manager' (ee98b449-b696-4212-b6e5-6c78905a3a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:59:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6dc4f9a0-1972-4f7a-9200-db48b532211c', 'is_clone': False, 'name': 'v_6dc4f9a0-1972-4f7a-9200-db48b532211c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0b7a71-9dd9-44c1-8589-c93e3e6864f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc4f9a0-1972-4f7a-9200-db48b532211c', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb3bd6f-ccc2-49c9-ada7-f6c759164c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 06:59:15 user cinder-volume[73792]: INFO cinder.action_track [None req-167bb905-ccab-4bba-ab31-b2e6b9a02622 tempest-CreateVolumesFromImageTest-227471221 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1301155182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e02dc7fe-57ab-48de-9fcc-654e731bc837,launched_at=2023-04-12T06:59:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth='CHAP EtUJHCFh JfQryx2mAaMbLn',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:59:14Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:59:15 user cinder-volume[73792]: INFO cinder.action_track [None req-a060ebc1-9319-4fb0-887b-92088ecdc41f tempest-CreateVolumesFromImageTest-227471221 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139277352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5b93c0c9-2792-436d-937b-9b3dadca364e,launched_at=2023-04-12T06:59:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth='CHAP QaPcEwyV O2j8vlfgABr1Xk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:59:14Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:59:15 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Volume volume-6dc4f9a0-1972-4f7a-9200-db48b532211c (6dc4f9a0-1972-4f7a-9200-db48b532211c): created successfully
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb3bd6f-ccc2-49c9-ada7-f6c759164c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] Flow 'volume_create_manager' (3202c22f-1e24-44fe-ae6a-fdb68e9a4773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 06:59:15 user cinder-volume[73792]: INFO cinder.action_track [None req-c768eb36-291e-480a-a1b2-c7c9e4bfd05b tempest-CreateVolumesFromImageTest-227471221 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-492126874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6dc4f9a0-1972-4f7a-9200-db48b532211c,launched_at=2023-04-12T06:59:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth='CHAP VrCmADzX 0PyNK6nOrkzBD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T06:59:14Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.coordination [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Acquiring lock "cinder-6dc4f9a0-1972-4f7a-9200-db48b532211c-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.coordination [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Lock "cinder-6dc4f9a0-1972-4f7a-9200-db48b532211c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] remove_export for volume: 6dc4f9a0-1972-4f7a-9200-db48b532211c. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-492126874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6dc4f9a0-1972-4f7a-9200-db48b532211c,launched_at=2023-04-12T06:59:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth='CHAP VrCmADzX 0PyNK6nOrkzBD1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:59:16Z,updated_at=2023-04-12T06:59:16Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] detach volume v_6dc4f9a0-1972-4f7a-9200-db48b532211c from target iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c/luns/v_6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c/luns/v_6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c/luns/v_6dc4f9a0-1972-4f7a-9200-db48b532211c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c/luns/v_6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] failed to remove resource iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c because of JDSS resource v_6dc4f9a0-1972-4f7a-9200-db48b532211c DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] delete target: iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] delete target iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] failed to remove resource iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c because of JDSS resource iqn.2010-10.org.openstack:6dc4f9a0-1972-4f7a-9200-db48b532211c DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] deleating volume v_6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] get snapshots for volume v_6dc4f9a0-1972-4f7a-9200-db48b532211c  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6dc4f9a0-1972-4f7a-9200-db48b532211c/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6dc4f9a0-1972-4f7a-9200-db48b532211c/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6dc4f9a0-1972-4f7a-9200-db48b532211c/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] get volume v_6dc4f9a0-1972-4f7a-9200-db48b532211c info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:59:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6dc4f9a0-1972-4f7a-9200-db48b532211c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284172', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61363', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8279575346903291859', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bdd736b8741bbef8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753343488', 'san:volume_id': 'bdd736b8741bbef8cc807bade5a2f67720c22c3c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38975', 'name': 'v_6dc4f9a0-1972-4f7a-9200-db48b532211c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] delete volume:v_6dc4f9a0-1972-4f7a-9200-db48b532211c recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:59:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6dc4f9a0-1972-4f7a-9200-db48b532211c {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] volume v_6dc4f9a0-1972-4f7a-9200-db48b532211c deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.quota [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Created reservations ['0e7bf02f-0522-4d1d-9998-2bf689622fba', '54a827c8-e922-4de9-852a-537a2daaf7c6', '0984d857-d873-4f04-92b2-fd40bfe64ce6', '470180ea-546c-4e69-9740-dd7e934afaea'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753425408', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.manager [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:59:17 user cinder-volume[73792]: INFO cinder.volume.manager [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Deleted volume successfully.
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-35b1b8b9-8dc1-4709-9893-cb0243a1708d tempest-CreateVolumesFromImageTest-227471221 None] Lock "cinder-6dc4f9a0-1972-4f7a-9200-db48b532211c-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Acquiring lock "cinder-5b93c0c9-2792-436d-937b-9b3dadca364e-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:59:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Lock "cinder-5b93c0c9-2792-436d-937b-9b3dadca364e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] remove_export for volume: 5b93c0c9-2792-436d-937b-9b3dadca364e. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139277352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5b93c0c9-2792-436d-937b-9b3dadca364e,launched_at=2023-04-12T06:59:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth='CHAP QaPcEwyV O2j8vlfgABr1Xk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:59:18Z,updated_at=2023-04-12T06:59:18Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] detach volume v_5b93c0c9-2792-436d-937b-9b3dadca364e from target iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e/luns/v_5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e/luns/v_5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e/luns/v_5b93c0c9-2792-436d-937b-9b3dadca364e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e/luns/v_5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] failed to remove resource iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e because of JDSS resource v_5b93c0c9-2792-436d-937b-9b3dadca364e DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] delete target: iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] delete target iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] failed to remove resource iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e because of JDSS resource iqn.2010-10.org.openstack:5b93c0c9-2792-436d-937b-9b3dadca364e DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] deleating volume v_5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] get snapshots for volume v_5b93c0c9-2792-436d-937b-9b3dadca364e  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b93c0c9-2792-436d-937b-9b3dadca364e/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b93c0c9-2792-436d-937b-9b3dadca364e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b93c0c9-2792-436d-937b-9b3dadca364e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] get volume v_5b93c0c9-2792-436d-937b-9b3dadca364e info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5b93c0c9-2792-436d-937b-9b3dadca364e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284171', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61360', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15608089137030196603', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4ce9f88d38dcb1a9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753425408', 'san:volume_id': '4ce9f88d38dcb1a98eec0995dc284fa992fd1f1c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38967', 'name': 'v_5b93c0c9-2792-436d-937b-9b3dadca364e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] delete volume:v_5b93c0c9-2792-436d-937b-9b3dadca364e recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b93c0c9-2792-436d-937b-9b3dadca364e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] volume v_5b93c0c9-2792-436d-937b-9b3dadca364e deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:59:19 user cinder-volume[73792]: DEBUG cinder.quota [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Created reservations ['333a4ec3-8191-43bb-885a-601eb4e62b13', '1a48ae50-0dbd-4c12-b182-1e44f45e87bf', 'b4dc3714-4221-4994-b9fb-a8bcf6d793bc', 'd85d2a9e-4509-47a4-8ead-1ba10612e81d'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:59:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:59:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:59:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753507328', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:59:19 user cinder-volume[73792]: DEBUG cinder.manager [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:59:19 user cinder-volume[73792]: INFO cinder.volume.manager [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Deleted volume successfully.
Apr 12 06:59:19 user cinder-volume[73792]: DEBUG cinder.coordination [None req-34b1003e-e762-43f5-a203-6cd0bb03f5d8 tempest-CreateVolumesFromImageTest-227471221 None] Lock "cinder-5b93c0c9-2792-436d-937b-9b3dadca364e-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.coordination [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Acquiring lock "cinder-e02dc7fe-57ab-48de-9fcc-654e731bc837-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.coordination [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Lock "cinder-e02dc7fe-57ab-48de-9fcc-654e731bc837-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] remove_export for volume: e02dc7fe-57ab-48de-9fcc-654e731bc837. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1301155182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=e02dc7fe-57ab-48de-9fcc-654e731bc837,launched_at=2023-04-12T06:59:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth='CHAP EtUJHCFh JfQryx2mAaMbLn',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:59:20Z,updated_at=2023-04-12T06:59:20Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] detach volume v_e02dc7fe-57ab-48de-9fcc-654e731bc837 from target iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837/luns/v_e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837/luns/v_e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837/luns/v_e02dc7fe-57ab-48de-9fcc-654e731bc837'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837/luns/v_e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] failed to remove resource iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 because of JDSS resource v_e02dc7fe-57ab-48de-9fcc-654e731bc837 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] delete target: iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] delete target iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] failed to remove resource iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 because of JDSS resource iqn.2010-10.org.openstack:e02dc7fe-57ab-48de-9fcc-654e731bc837 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] deleating volume v_e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] get snapshots for volume v_e02dc7fe-57ab-48de-9fcc-654e731bc837  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e02dc7fe-57ab-48de-9fcc-654e731bc837/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e02dc7fe-57ab-48de-9fcc-654e731bc837/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e02dc7fe-57ab-48de-9fcc-654e731bc837/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] get volume v_e02dc7fe-57ab-48de-9fcc-654e731bc837 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e02dc7fe-57ab-48de-9fcc-654e731bc837', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284171', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61357', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3403083128566320543', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c56cc34ed840abf2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753507328', 'san:volume_id': 'c56cc34ed840abf2eb9d5dd7b62fab51dca76dc9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38959', 'name': 'v_e02dc7fe-57ab-48de-9fcc-654e731bc837', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] delete volume:v_e02dc7fe-57ab-48de-9fcc-654e731bc837 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e02dc7fe-57ab-48de-9fcc-654e731bc837 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] volume v_e02dc7fe-57ab-48de-9fcc-654e731bc837 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:59:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=60,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=6 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:59:21 user cinder-volume[73792]: DEBUG cinder.quota [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Created reservations ['3813848a-1463-4e4e-99f3-83ff000f7dc4', 'b4ce3e80-ecc4-4161-a40e-96fd84faf9d7', 'dfd6bc91-a482-45d1-8242-cb9fc2b5e1dd', 'e3525f76-d7a7-4c87-9c09-2737d067a811'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:59:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=56,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=6 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:59:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:59:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:59:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753589248', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.manager [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:59:22 user cinder-volume[73792]: INFO cinder.volume.manager [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Deleted volume successfully.
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.coordination [None req-d749ad2e-7f19-4273-87ef-c3a56a788856 tempest-CreateVolumesFromImageTest-227471221 None] Lock "cinder-e02dc7fe-57ab-48de-9fcc-654e731bc837-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Acquiring lock "cinder-d55fe97a-d21d-4cfb-891b-fa94e5be4993-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Lock "cinder-d55fe97a-d21d-4cfb-891b-fa94e5be4993-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] remove_export for volume: d55fe97a-d21d-4cfb-891b-fa94e5be4993. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938934780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d55fe97a-d21d-4cfb-891b-fa94e5be4993,launched_at=2023-04-12T06:59:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth='CHAP tlKejVyN dMg1pV3Wl2GfB7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:14Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:59:22Z,updated_at=2023-04-12T06:59:22Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] detach volume v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 from target iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993/luns/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993/luns/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993/luns/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993/luns/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] failed to remove resource iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 because of JDSS resource v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] delete target: iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] delete target iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] failed to remove resource iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 because of JDSS resource iqn.2010-10.org.openstack:d55fe97a-d21d-4cfb-891b-fa94e5be4993 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] deleating volume v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] get snapshots for volume v_d55fe97a-d21d-4cfb-891b-fa94e5be4993  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] get volume v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284171', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61352', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16788729088204123670', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b29f8cbd87cb533b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753589248', 'san:volume_id': 'b29f8cbd87cb533bdfa3999c8fcbf99085c00586', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38949', 'name': 'v_d55fe97a-d21d-4cfb-891b-fa94e5be4993', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] delete volume:v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] volume v_d55fe97a-d21d-4cfb-891b-fa94e5be4993 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:59:23 user cinder-volume[73792]: DEBUG cinder.quota [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Created reservations ['415a9c07-7a44-423e-94da-f445ea7b2e6e', '0d2462cd-64c0-4672-bdbc-edd3615993cf', '0d698b75-6bcc-4ec4-a7df-58d8e238dee1', '68c7c114-08d1-43a7-b5c1-72a6ff9e52a0'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:59:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:59:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:59:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753671168', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.manager [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:59:24 user cinder-volume[73792]: INFO cinder.volume.manager [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Deleted volume successfully.
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4b575f87-31b6-47a2-ac9e-3cfa461670f8 tempest-CreateVolumesFromImageTest-227471221 None] Lock "cinder-d55fe97a-d21d-4cfb-891b-fa94e5be4993-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Acquiring lock "cinder-50359676-64cd-4d8f-90b6-422147ca796d-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Lock "cinder-50359676-64cd-4d8f-90b6-422147ca796d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] remove_export for volume: 50359676-64cd-4d8f-90b6-422147ca796d. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-743024083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=50359676-64cd-4d8f-90b6-422147ca796d,launched_at=2023-04-12T06:59:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8209f3f6e5545cb94458b9d3357b97f',provider_auth='CHAP vMdXmSxN 3HUqxDwfeQTSgE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:59:13Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T06:59:25Z,updated_at=2023-04-12T06:59:25Z,use_quota=True,user_id='19236b17a64544879c924f9f516f8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] detach volume v_50359676-64cd-4d8f-90b6-422147ca796d from target iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d/luns/v_50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d/luns/v_50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d/luns/v_50359676-64cd-4d8f-90b6-422147ca796d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d/luns/v_50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] failed to remove resource iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d because of JDSS resource v_50359676-64cd-4d8f-90b6-422147ca796d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] delete target: iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] delete target iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] failed to remove resource iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d because of JDSS resource iqn.2010-10.org.openstack:50359676-64cd-4d8f-90b6-422147ca796d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] deleating volume v_50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] get snapshots for volume v_50359676-64cd-4d8f-90b6-422147ca796d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_50359676-64cd-4d8f-90b6-422147ca796d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_50359676-64cd-4d8f-90b6-422147ca796d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_50359676-64cd-4d8f-90b6-422147ca796d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] get volume v_50359676-64cd-4d8f-90b6-422147ca796d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 06:59:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_50359676-64cd-4d8f-90b6-422147ca796d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284171', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61349', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13660856316207331547', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ff5b1d454540e314', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753671168', 'san:volume_id': 'ff5b1d454540e314aef00467d2c3b86fb8d7c6fd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39835', 'name': 'v_50359676-64cd-4d8f-90b6-422147ca796d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] delete volume:v_50359676-64cd-4d8f-90b6-422147ca796d recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 06:59:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_50359676-64cd-4d8f-90b6-422147ca796d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] volume v_50359676-64cd-4d8f-90b6-422147ca796d deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 06:59:26 user cinder-volume[73792]: DEBUG cinder.quota [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Created reservations ['11ea17c4-a9fc-493d-af60-ffa4904037f4', '5dc6b33a-e05f-42bf-b478-826aecc5e32b', '0a3ce881-e0a6-42e7-8027-a0daa66cd457', 'd78afc36-266e-48be-8031-3f69f6105c1a'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 06:59:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:59:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:59:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753753088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:59:26 user cinder-volume[73792]: DEBUG cinder.manager [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:59:26 user cinder-volume[73792]: INFO cinder.volume.manager [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Deleted volume successfully.
Apr 12 06:59:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-184b5826-ef49-4143-aef4-e68c2e60ef91 tempest-CreateVolumesFromImageTest-227471221 None] Lock "cinder-50359676-64cd-4d8f-90b6-422147ca796d-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 06:59:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:59:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 06:59:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 06:59:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753753088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 06:59:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 06:59:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=31,cinder:UPDATE=18,cinder:DELETE=3,cinder:INSERT=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 06:59:43 user cinder-volume[73792]: INFO cinder.action_track [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:57:54Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] terminate connection for 1640bd09-1264-4e82-9e6e-0f1fa3cc654b  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 06:59:43 user cinder-volume[73792]: INFO cinder.action_track [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:57:54Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] Deleting attachment 78754aa9-e953-494c-9f8c-ff85f76ed217. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] remove_export for volume: 1640bd09-1264-4e82-9e6e-0f1fa3cc654b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T06:57:54Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] detach volume v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b from target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] delete target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] delete target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 06:59:43 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 06:59:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 06:59:44 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 req-6cd17851-140f-4077-8f71-f9af396518cb tempest-TestVolumeBootPattern-294210775 None] target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 06:59:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=33,cinder:UPDATE=21,cinder:INSERT=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:00:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:00:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Acquiring lock "cinder-6550026c-a3ce-49ae-8fa4-8a420acf0814-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Lock "cinder-6550026c-a3ce-49ae-8fa4-8a420acf0814-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] remove_export for volume: 6550026c-a3ce-49ae-8fa4-8a420acf0814. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-290001514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6550026c-a3ce-49ae-8fa4-8a420acf0814,launched_at=2023-04-12T06:55:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth='CHAP GuqevMms DhVsUBl1oyd8mW',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:55:55Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T07:00:30Z,updated_at=2023-04-12T07:00:30Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] detach volume v_6550026c-a3ce-49ae-8fa4-8a420acf0814 from target iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814/luns/v_6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814/luns/v_6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814/luns/v_6550026c-a3ce-49ae-8fa4-8a420acf0814'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814/luns/v_6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] failed to remove resource iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 because of JDSS resource v_6550026c-a3ce-49ae-8fa4-8a420acf0814 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] delete target: iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] delete target iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] failed to remove resource iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 because of JDSS resource iqn.2010-10.org.openstack:6550026c-a3ce-49ae-8fa4-8a420acf0814 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] deleating volume v_6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] get snapshots for volume v_6550026c-a3ce-49ae-8fa4-8a420acf0814  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6550026c-a3ce-49ae-8fa4-8a420acf0814/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6550026c-a3ce-49ae-8fa4-8a420acf0814/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6550026c-a3ce-49ae-8fa4-8a420acf0814/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] get volume v_6550026c-a3ce-49ae-8fa4-8a420acf0814 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6550026c-a3ce-49ae-8fa4-8a420acf0814', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283972', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61280', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9073886961366945248', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ec9304c2d01707b0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753744896', 'san:volume_id': 'ec9304c2d01707b0fda354dbfcd2edd53bf7a810', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39141', 'name': 'v_6550026c-a3ce-49ae-8fa4-8a420acf0814', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] delete volume:v_6550026c-a3ce-49ae-8fa4-8a420acf0814 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753744896', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:00:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:00:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6550026c-a3ce-49ae-8fa4-8a420acf0814 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] volume v_6550026c-a3ce-49ae-8fa4-8a420acf0814 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 07:00:31 user cinder-volume[73792]: DEBUG cinder.quota [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Created reservations ['78314fa7-57ff-4ac7-b648-e606e5faf033', '291d1f5f-44ae-493c-b0a6-d89cbde490e3', 'c89cc77f-7a0f-4510-bbb2-257173db0414', '6985f0bc-1d9a-4dbf-8899-fb85e923c096'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:00:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:00:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:00:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753826816', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:00:31 user cinder-volume[73792]: DEBUG cinder.manager [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:00:31 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Deleted volume successfully.
Apr 12 07:00:31 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7498583e-5101-4cff-8700-390a81d8f2fe tempest-AttachVolumeShelveTestJSON-1986658224 None] Lock "cinder-6550026c-a3ce-49ae-8fa4-8a420acf0814-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.coordination [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Acquiring lock "cinder-9cbbb1a6-c094-4a11-beef-499b756020f2-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.coordination [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Lock "cinder-9cbbb1a6-c094-4a11-beef-499b756020f2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] remove_export for volume: 9cbbb1a6-c094-4a11-beef-499b756020f2. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375020388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=9cbbb1a6-c094-4a11-beef-499b756020f2,launched_at=2023-04-12T06:48:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a8460ce5c24d1db20e80a1659133f7',provider_auth='CHAP dMCckQRL NKXBhCtkFx2Mvc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:48:35Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T07:00:32Z,updated_at=2023-04-12T07:00:32Z,use_quota=True,user_id='4fbb8c37e5a74a0b83011c2a21033204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] detach volume v_9cbbb1a6-c094-4a11-beef-499b756020f2 from target iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/luns/v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/luns/v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/luns/v_9cbbb1a6-c094-4a11-beef-499b756020f2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2/luns/v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] failed to remove resource iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 because of JDSS resource v_9cbbb1a6-c094-4a11-beef-499b756020f2 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] delete target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] delete target iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] failed to remove resource iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 because of JDSS resource iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] deleating volume v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] get snapshots for volume v_9cbbb1a6-c094-4a11-beef-499b756020f2  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cbbb1a6-c094-4a11-beef-499b756020f2/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cbbb1a6-c094-4a11-beef-499b756020f2/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cbbb1a6-c094-4a11-beef-499b756020f2/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] get volume v_9cbbb1a6-c094-4a11-beef-499b756020f2 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9cbbb1a6-c094-4a11-beef-499b756020f2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681283532', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61102', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4514977922560449505', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '444ad6b8d55afbe5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753826816', 'san:volume_id': '444ad6b8d55afbe53e978babf46332607c1e23a5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39380', 'name': 'v_9cbbb1a6-c094-4a11-beef-499b756020f2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] delete volume:v_9cbbb1a6-c094-4a11-beef-499b756020f2 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9cbbb1a6-c094-4a11-beef-499b756020f2 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] volume v_9cbbb1a6-c094-4a11-beef-499b756020f2 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 07:00:33 user cinder-volume[73792]: DEBUG cinder.quota [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Created reservations ['b184f6ed-19fd-487c-98d7-39a8369ff0c8', '8b852e81-b9a1-4ac7-a5d0-f4ac8ee41d25', 'c39067b6-6434-4cf7-99fe-bd1ff425abae', '58f8f7cd-6054-4d65-b9ce-67704fa93e47'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:00:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:00:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:00:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:34 user cinder-volume[73792]: INFO cinder.action_track [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T07:00:33Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:00:34 user cinder-volume[73792]: INFO cinder.action_track [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T07:00:33Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] create export for volume: 1640bd09-1264-4e82-9e6e-0f1fa3cc654b. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] ensure volume 1640bd09-1264-4e82-9e6e-0f1fa3cc654b assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] check if targe iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] create target and attach volume 1640bd09-1264-4e82-9e6e-0f1fa3cc654b to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] create target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753921024', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.manager [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:00:34 user cinder-volume[73792]: INFO cinder.volume.manager [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Deleted volume successfully.
Apr 12 07:00:34 user cinder-volume[73792]: DEBUG cinder.coordination [None req-51f12dc2-ebad-4436-a8f0-a28244426ea8 tempest-AttachVolumeShelveTestJSON-1986658224 None] Lock "cinder-9cbbb1a6-c094-4a11-beef-499b756020f2-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:00:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] atach volume v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b to target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 07:00:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3431396461666561', 'lun': 0, 'mode': 'wt', 'name': 'v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'prod_id': 'Storage', 'scsi_id': '419dafea0aadac2b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] add credentails to target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 07:00:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'name': 'hRcotZzs'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] initialize_connection for 1640bd09-1264-4e82-9e6e-0f1fa3cc654b 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 07:00:38 user cinder-volume[73792]: INFO cinder.action_track [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRcotZzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '532d24d3-68c8-4980-9e73-f39c0a06011f'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T07:00:33Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:00:38 user cinder-volume[73792]: INFO cinder.action_track [req-911f579a-b888-4075-9f63-8487597627da req-f9c077e6-0670-4436-a4ca-bfc77eb38503 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T07:00:38Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:00:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=43,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:00:47 user cinder-volume[73792]: INFO cinder.action_track [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-829953650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5da634b5-b42a-4913-a7c1-af9bcf332372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2950c90beeda47418c0e3911e50620e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='f2e37f51597f46d6b9cbff0f76116c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Flow 'volume_create_manager' (aa85d8a2-16ef-40a0-a5d4-d6661972b47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0085c1c3-3524-489a-8386-cdaf7479c4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0085c1c3-3524-489a-8386-cdaf7479c4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-829953650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5da634b5-b42a-4913-a7c1-af9bcf332372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2950c90beeda47418c0e3911e50620e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T07:00:48Z,use_quota=True,user_id='f2e37f51597f46d6b9cbff0f76116c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaac39de-63a7-42a6-961b-81896ab383cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaac39de-63a7-42a6-961b-81896ab383cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db619d8-9dba-4a41-9a70-448f3d4d3c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db619d8-9dba-4a41-9a70-448f3d4d3c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da634b5-b42a-4913-a7c1-af9bcf332372', 'volume_name': 'volume-5da634b5-b42a-4913-a7c1-af9bcf332372', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbd6414-32f5-40cd-a104-e741c8fbd233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbd6414-32f5-40cd-a104-e741c8fbd233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7df0f9-8879-4ff3-a3cf-1e3b9ac5939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:00:47 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Volume 5da634b5-b42a-4913-a7c1-af9bcf332372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da634b5-b42a-4913-a7c1-af9bcf332372', 'volume_size': 1}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] creating volume v_5da634b5-b42a-4913-a7c1-af9bcf332372. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] create volume {'name': 'v_5da634b5-b42a-4913-a7c1-af9bcf332372', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:47 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:48 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5da634b5-b42a-4913-a7c1-af9bcf332372', 'is_clone': False, 'name': 'v_5da634b5-b42a-4913-a7c1-af9bcf332372'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:48 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7df0f9-8879-4ff3-a3cf-1e3b9ac5939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da634b5-b42a-4913-a7c1-af9bcf332372', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:00:48 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621192b2-f21c-4944-8bf9-d598c0446096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:00:48 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Volume volume-5da634b5-b42a-4913-a7c1-af9bcf332372 (5da634b5-b42a-4913-a7c1-af9bcf332372): created successfully
Apr 12 07:00:48 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621192b2-f21c-4944-8bf9-d598c0446096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:00:48 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Flow 'volume_create_manager' (aa85d8a2-16ef-40a0-a5d4-d6661972b47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:00:48 user cinder-volume[73792]: INFO cinder.action_track [None req-892254b4-34d0-449c-a157-ee6e6f1b79c6 tempest-VolumeQuotasAdminTestJSON-1867070272 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-829953650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5da634b5-b42a-4913-a7c1-af9bcf332372,launched_at=2023-04-12T07:00:48Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2950c90beeda47418c0e3911e50620e8',provider_auth='CHAP vLQFpYHT Mt92e6SRzr0csK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:00:48Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T07:00:48Z,use_quota=True,user_id='f2e37f51597f46d6b9cbff0f76116c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.coordination [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Acquiring lock "cinder-5da634b5-b42a-4913-a7c1-af9bcf332372-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.coordination [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Lock "cinder-5da634b5-b42a-4913-a7c1-af9bcf332372-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] remove_export for volume: 5da634b5-b42a-4913-a7c1-af9bcf332372. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-829953650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=5da634b5-b42a-4913-a7c1-af9bcf332372,launched_at=2023-04-12T07:00:48Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2950c90beeda47418c0e3911e50620e8',provider_auth='CHAP vLQFpYHT Mt92e6SRzr0csK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:00:48Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T07:00:49Z,updated_at=2023-04-12T07:00:49Z,use_quota=True,user_id='f2e37f51597f46d6b9cbff0f76116c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] detach volume v_5da634b5-b42a-4913-a7c1-af9bcf332372 from target iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372/luns/v_5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372/luns/v_5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372/luns/v_5da634b5-b42a-4913-a7c1-af9bcf332372'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372/luns/v_5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] failed to remove resource iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 because of JDSS resource v_5da634b5-b42a-4913-a7c1-af9bcf332372 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] delete target: iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] delete target iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] failed to remove resource iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 because of JDSS resource iqn.2010-10.org.openstack:5da634b5-b42a-4913-a7c1-af9bcf332372 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] deleating volume v_5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] get snapshots for volume v_5da634b5-b42a-4913-a7c1-af9bcf332372  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5da634b5-b42a-4913-a7c1-af9bcf332372/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5da634b5-b42a-4913-a7c1-af9bcf332372/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5da634b5-b42a-4913-a7c1-af9bcf332372/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] get volume v_5da634b5-b42a-4913-a7c1-af9bcf332372 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5da634b5-b42a-4913-a7c1-af9bcf332372', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284265', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61398', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16996287826482269', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '40b4ce61ffc8aba1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753826816', 'san:volume_id': '40b4ce61ffc8aba161bc322bbea647e62e0060b4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38998', 'name': 'v_5da634b5-b42a-4913-a7c1-af9bcf332372', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] delete volume:v_5da634b5-b42a-4913-a7c1-af9bcf332372 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:49 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5da634b5-b42a-4913-a7c1-af9bcf332372 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] volume v_5da634b5-b42a-4913-a7c1-af9bcf332372 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 07:00:50 user cinder-volume[73792]: DEBUG cinder.quota [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Created reservations ['d730d73f-1aac-46dd-88b9-da655f411524', '325d6138-9bd3-46d0-94f1-d3106fdd12e6', '1f7f803e-1b74-4e1f-881a-e617384f94e3', '06361187-10f4-4151-9eb2-228c27e8943d'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:00:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:00:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:00:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753908736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:50 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:00:50 user cinder-volume[73792]: DEBUG cinder.manager [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:00:50 user cinder-volume[73792]: INFO cinder.volume.manager [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Deleted volume successfully.
Apr 12 07:00:50 user cinder-volume[73792]: DEBUG cinder.coordination [None req-852b99fa-474d-4801-9210-479b9287c868 tempest-VolumeQuotasAdminTestJSON-1867070272 None] Lock "cinder-5da634b5-b42a-4913-a7c1-af9bcf332372-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:00:51 user cinder-volume[73792]: INFO cinder.action_track [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1538430386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f97324d1-7b6c-4b8f-a85e-781c9a6acf59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2950c90beeda47418c0e3911e50620e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='f2e37f51597f46d6b9cbff0f76116c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Flow 'volume_create_manager' (16fce21e-e750-4325-adca-e3035b686ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94466f8-4c8e-4dd3-87ed-223b07133bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94466f8-4c8e-4dd3-87ed-223b07133bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1538430386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f97324d1-7b6c-4b8f-a85e-781c9a6acf59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2950c90beeda47418c0e3911e50620e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T07:00:51Z,use_quota=True,user_id='f2e37f51597f46d6b9cbff0f76116c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24706f87-619d-4d56-ad48-9b2f7b1c6a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24706f87-619d-4d56-ad48-9b2f7b1c6a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e3f7ba-efc2-4506-aaf6-d66b85d26d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e3f7ba-efc2-4506-aaf6-d66b85d26d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f97324d1-7b6c-4b8f-a85e-781c9a6acf59', 'volume_name': 'volume-f97324d1-7b6c-4b8f-a85e-781c9a6acf59', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dfbdf28-0292-43f8-bbc5-4f5aa4234e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dfbdf28-0292-43f8-bbc5-4f5aa4234e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec3a553-ec97-4905-956f-2687317c6106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:00:51 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Volume f97324d1-7b6c-4b8f-a85e-781c9a6acf59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f97324d1-7b6c-4b8f-a85e-781c9a6acf59', 'volume_size': 1}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] creating volume v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] create volume {'name': 'v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:51 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:52 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59', 'is_clone': False, 'name': 'v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:52 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=60,cinder:INSERT=4,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:00:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec3a553-ec97-4905-956f-2687317c6106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f97324d1-7b6c-4b8f-a85e-781c9a6acf59', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:00:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f6eb21-c397-4df3-85f8-092b78ea2dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:00:52 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Volume volume-f97324d1-7b6c-4b8f-a85e-781c9a6acf59 (f97324d1-7b6c-4b8f-a85e-781c9a6acf59): created successfully
Apr 12 07:00:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f6eb21-c397-4df3-85f8-092b78ea2dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:00:52 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] Flow 'volume_create_manager' (16fce21e-e750-4325-adca-e3035b686ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:00:52 user cinder-volume[73792]: INFO cinder.action_track [None req-2ebde8ce-f771-4334-a154-e37c2f7bd9ca tempest-VolumeQuotasAdminTestJSON-1867070272 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1538430386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f97324d1-7b6c-4b8f-a85e-781c9a6acf59,launched_at=2023-04-12T07:00:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2950c90beeda47418c0e3911e50620e8',provider_auth='CHAP rEztOGKp xVO5ILyDC70BmM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:00:51Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T07:00:51Z,use_quota=True,user_id='f2e37f51597f46d6b9cbff0f76116c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:00:53 user cinder-volume[73792]: INFO cinder.volume.manager [None req-55c1cfd2-9af2-4b49-9ad8-b831a4782000 tempest-VolumeQuotasAdminTestJSON-1077334255 None] Transfer volume completed successfully.
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.coordination [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Acquiring lock "cinder-f97324d1-7b6c-4b8f-a85e-781c9a6acf59-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.coordination [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Lock "cinder-f97324d1-7b6c-4b8f-a85e-781c9a6acf59-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] remove_export for volume: f97324d1-7b6c-4b8f-a85e-781c9a6acf59. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1538430386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=f97324d1-7b6c-4b8f-a85e-781c9a6acf59,launched_at=2023-04-12T07:00:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff612b580f434b04b25c74a4ef1dc177',provider_auth='CHAP rEztOGKp xVO5ILyDC70BmM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:00:51Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T07:00:53Z,updated_at=2023-04-12T07:00:53Z,use_quota=True,user_id='afebcb7982044348b3693b3712dfbc5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] detach volume v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 from target iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59/luns/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59/luns/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59/luns/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59/luns/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] failed to remove resource iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 because of JDSS resource v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] delete target: iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] delete target iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] failed to remove resource iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 because of JDSS resource iqn.2010-10.org.openstack:f97324d1-7b6c-4b8f-a85e-781c9a6acf59 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] deleating volume v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] get snapshots for volume v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] get volume v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284269', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61403', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1973090495184346350', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3d35365a57769493', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753814528', 'san:volume_id': '3d35365a57769493325913009f5673ff2d16e9dd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '38883', 'name': 'v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] delete volume:v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:53 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] volume v_f97324d1-7b6c-4b8f-a85e-781c9a6acf59 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 07:00:54 user cinder-volume[73792]: DEBUG cinder.quota [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Created reservations ['5a7a4b19-90ab-4878-b1d7-2232a754bd3f', '8e1b2686-b23c-42cb-ba14-53fc9d80c368', 'bfd64a22-a871-4cf3-827a-47c58e4cb322', '0882955f-07eb-493b-a7ca-24d870284e1a'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:00:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:00:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:00:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:00:54 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:00:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753896448', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:00:55 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:00:55 user cinder-volume[73792]: DEBUG cinder.manager [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:00:55 user cinder-volume[73792]: INFO cinder.volume.manager [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Deleted volume successfully.
Apr 12 07:00:55 user cinder-volume[73792]: DEBUG cinder.coordination [None req-2eaa219a-f3fb-4ba5-89cc-066ff968f245 tempest-VolumeQuotasAdminTestJSON-1420238698 None] Lock "cinder-f97324d1-7b6c-4b8f-a85e-781c9a6acf59-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:00:59 user cinder-volume[73792]: INFO cinder.action_track [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-150256014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d6289961-65a5-4250-9dd8-58a44bfb4c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8a218bedb94770985fd421723ab2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='5aa6f40be6f744d596b5fc6c502cacd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55003b44-77e8-4de0-9300-585dd35135d1),volume_type_id=55003b44-77e8-4de0-9300-585dd35135d1) 
Apr 12 07:00:59 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Flow 'volume_create_manager' (7efa8118-bb98-4a76-906d-adca2bbfc422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a4c3d3-ec06-4f47-9b30-cfccbf7ae130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a4c3d3-ec06-4f47-9b30-cfccbf7ae130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-150256014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d6289961-65a5-4250-9dd8-58a44bfb4c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8a218bedb94770985fd421723ab2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T07:01:00Z,use_quota=True,user_id='5aa6f40be6f744d596b5fc6c502cacd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55003b44-77e8-4de0-9300-585dd35135d1),volume_type_id=55003b44-77e8-4de0-9300-585dd35135d1)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e0b223-4c42-49a6-9d86-d311cd7d6111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e0b223-4c42-49a6-9d86-d311cd7d6111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e641d0c-ce01-4a2b-892d-3ab80b8ddeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e641d0c-ce01-4a2b-892d-3ab80b8ddeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6289961-65a5-4250-9dd8-58a44bfb4c7d', 'volume_name': 'volume-d6289961-65a5-4250-9dd8-58a44bfb4c7d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77191a27-add4-4c82-9bf3-236386c9998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77191a27-add4-4c82-9bf3-236386c9998a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ef750f-5402-4627-9c66-e4f63ea170b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:00 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Volume d6289961-65a5-4250-9dd8-58a44bfb4c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6289961-65a5-4250-9dd8-58a44bfb4c7d', 'volume_size': 1}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] creating volume v_d6289961-65a5-4250-9dd8-58a44bfb4c7d. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] create volume {'name': 'v_d6289961-65a5-4250-9dd8-58a44bfb4c7d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d', 'is_clone': False, 'name': 'v_d6289961-65a5-4250-9dd8-58a44bfb4c7d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ef750f-5402-4627-9c66-e4f63ea170b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6289961-65a5-4250-9dd8-58a44bfb4c7d', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582a9682-a871-488f-8483-28ac0f58034c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:00 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Volume volume-d6289961-65a5-4250-9dd8-58a44bfb4c7d (d6289961-65a5-4250-9dd8-58a44bfb4c7d): created successfully
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582a9682-a871-488f-8483-28ac0f58034c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:00 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Flow 'volume_create_manager' (7efa8118-bb98-4a76-906d-adca2bbfc422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:01:00 user cinder-volume[73792]: INFO cinder.action_track [None req-1825fdd2-cfc0-4291-b29b-7eb591730feb tempest-VolumeRetypeWithoutMigrationTest-820416069 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-150256014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d6289961-65a5-4250-9dd8-58a44bfb4c7d,launched_at=2023-04-12T07:01:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8a218bedb94770985fd421723ab2e9',provider_auth='CHAP YFCuljKW gA68lR1DyqStmw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T07:01:00Z,use_quota=True,user_id='5aa6f40be6f744d596b5fc6c502cacd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55003b44-77e8-4de0-9300-585dd35135d1),volume_type_id=55003b44-77e8-4de0-9300-585dd35135d1) 
Apr 12 07:01:01 user cinder-volume[73792]: INFO cinder.action_track [None req-2b5563f6-0cd7-46b2-9194-df7770c321ac tempest-VolumeRetypeWithoutMigrationTest-820416069 None] ACTION:'volume_retype' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-150256014',ec2_id=None,encryption_key_id=None,glance_metadata={},group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d6289961-65a5-4250-9dd8-58a44bfb4c7d,launched_at=2023-04-12T07:01:01Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='0b8a218bedb94770985fd421723ab2e9',provider_auth='CHAP YFCuljKW gA68lR1DyqStmw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=SnapshotList,source_volid=None,status='retyping',terminated_at=None,updated_at=2023-04-12T07:01:01Z,use_quota=True,user_id='5aa6f40be6f744d596b5fc6c502cacd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55003b44-77e8-4de0-9300-585dd35135d1),volume_type_id=55003b44-77e8-4de0-9300-585dd35135d1) 
Apr 12 07:01:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b5563f6-0cd7-46b2-9194-df7770c321ac tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:01:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2b5563f6-0cd7-46b2-9194-df7770c321ac tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:01:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b5563f6-0cd7-46b2-9194-df7770c321ac tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b5563f6-0cd7-46b2-9194-df7770c321ac tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2b5563f6-0cd7-46b2-9194-df7770c321ac tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753794048', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:01 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2b5563f6-0cd7-46b2-9194-df7770c321ac tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:01:01 user cinder-volume[73792]: DEBUG cinder.manager [None req-2b5563f6-0cd7-46b2-9194-df7770c321ac tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:01:01 user cinder-volume[73792]: INFO cinder.volume.manager [None req-2b5563f6-0cd7-46b2-9194-df7770c321ac tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Retype volume completed successfully.
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Acquiring lock "cinder-d6289961-65a5-4250-9dd8-58a44bfb4c7d-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Lock "cinder-d6289961-65a5-4250-9dd8-58a44bfb4c7d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] remove_export for volume: d6289961-65a5-4250-9dd8-58a44bfb4c7d. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-150256014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=d6289961-65a5-4250-9dd8-58a44bfb4c7d,launched_at=2023-04-12T07:01:01Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='0b8a218bedb94770985fd421723ab2e9',provider_auth='CHAP YFCuljKW gA68lR1DyqStmw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:00Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T07:01:03Z,updated_at=2023-04-12T07:01:03Z,use_quota=True,user_id='5aa6f40be6f744d596b5fc6c502cacd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7065ec0c-e8b6-45d5-a964-8b437e0323fe),volume_type_id=7065ec0c-e8b6-45d5-a964-8b437e0323fe) from target:iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] detach volume v_d6289961-65a5-4250-9dd8-58a44bfb4c7d from target iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d/luns/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d/luns/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d/luns/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d/luns/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] failed to remove resource iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d because of JDSS resource v_d6289961-65a5-4250-9dd8-58a44bfb4c7d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] delete target: iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] delete target iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] failed to remove resource iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d because of JDSS resource iqn.2010-10.org.openstack:d6289961-65a5-4250-9dd8-58a44bfb4c7d DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] deleating volume v_d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] get snapshots for volume v_d6289961-65a5-4250-9dd8-58a44bfb4c7d  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] get volume v_d6289961-65a5-4250-9dd8-58a44bfb4c7d info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284277', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61409', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7073092428042092240', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '70d0a1b8d735a1ba', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753794048', 'san:volume_id': '70d0a1b8d735a1ba4690e73e48cf1032ebe926f7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39968', 'name': 'v_d6289961-65a5-4250-9dd8-58a44bfb4c7d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] delete volume:v_d6289961-65a5-4250-9dd8-58a44bfb4c7d recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:02 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6289961-65a5-4250-9dd8-58a44bfb4c7d {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] volume v_d6289961-65a5-4250-9dd8-58a44bfb4c7d deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 07:01:04 user cinder-volume[73792]: WARNING cinder.quota [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 12 07:01:04 user cinder-volume[73792]: WARNING cinder.quota [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 12 07:01:04 user cinder-volume[73792]: DEBUG cinder.quota [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Created reservations ['3f564b8a-3eb7-4021-957e-9978de85b750', 'da286e28-a981-4ba0-a615-48a2018e2855', 'b4307ea7-c1e6-45cc-a2ad-d521d4d46eff', '1fb62b1a-332e-4a1c-a029-75f3ec0f2931'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:01:04 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=61,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:01:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:01:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:01:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753875968', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:04 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:01:04 user cinder-volume[73792]: DEBUG cinder.manager [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:01:04 user cinder-volume[73792]: INFO cinder.volume.manager [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Deleted volume successfully.
Apr 12 07:01:04 user cinder-volume[73792]: DEBUG cinder.coordination [None req-cba04884-d00b-4c50-87d1-05e1f0c6cf2a tempest-VolumeRetypeWithoutMigrationTest-820416069 None] Lock "cinder-d6289961-65a5-4250-9dd8-58a44bfb4c7d-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:01:09 user cinder-volume[73792]: INFO cinder.action_track [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1381129636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3caa2bbd-d34e-4bbf-804a-8e0ff080879e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Flow 'volume_create_manager' (ba19a782-4068-4ee5-a426-0c3e066b5c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4ac4f8-4cf2-4f08-96da-92d9a4761653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4ac4f8-4cf2-4f08-96da-92d9a4761653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1381129636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3caa2bbd-d34e-4bbf-804a-8e0ff080879e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T07:01:09Z,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8217b14a-344f-4561-ab22-ee9bb5b78157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8217b14a-344f-4561-ab22-ee9bb5b78157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf38967d-fddc-4a6b-8f5e-da3c7a5b9421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf38967d-fddc-4a6b-8f5e-da3c7a5b9421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3caa2bbd-d34e-4bbf-804a-8e0ff080879e', 'volume_name': 'volume-3caa2bbd-d34e-4bbf-804a-8e0ff080879e', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd36c74-4e30-41c0-9a8d-ac3c0c43f7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd36c74-4e30-41c0-9a8d-ac3c0c43f7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50237803-257c-4e57-a07c-92e60363d38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:09 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Volume 3caa2bbd-d34e-4bbf-804a-8e0ff080879e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3caa2bbd-d34e-4bbf-804a-8e0ff080879e', 'volume_size': 1}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] creating volume v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] create volume {'name': 'v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e', 'is_clone': False, 'name': 'v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50237803-257c-4e57-a07c-92e60363d38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3caa2bbd-d34e-4bbf-804a-8e0ff080879e', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a7a0ae-c826-4bcc-8d1f-60d37be23e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:09 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Volume volume-3caa2bbd-d34e-4bbf-804a-8e0ff080879e (3caa2bbd-d34e-4bbf-804a-8e0ff080879e): created successfully
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a7a0ae-c826-4bcc-8d1f-60d37be23e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:09 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] Flow 'volume_create_manager' (ba19a782-4068-4ee5-a426-0c3e066b5c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:01:09 user cinder-volume[73792]: INFO cinder.action_track [None req-6bc6c690-42f1-421c-9750-2806059e0129 tempest-VolumesDeleteCascade-827739932 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1381129636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3caa2bbd-d34e-4bbf-804a-8e0ff080879e,launched_at=2023-04-12T07:01:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth='CHAP TljzeNZV 2gPBOaQhpeuR3l',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T07:01:09Z,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:01:10 user cinder-volume[73792]: INFO cinder.action_track [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T07:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Snapshot-612915372',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad,metadata={},progress='0%',project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume=<?>,volume_id=3caa2bbd-d34e-4bbf-804a-8e0ff080879e,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:01:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] create snapshot 94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad for volume 3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 07:01:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] cloning v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e to s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 07:01:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] create snapshot s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 07:01:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] create volume s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad from snapshot s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 07:01:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e@s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad', 'is_clone': True, 'full_name': 'Pool-0/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad', 'name': 's_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] volume s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 07:01:11 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b441d43e-ffb5-44ad-831c-a475a1dded2f tempest-VolumesDeleteCascade-827739932 None] Create snapshot completed successfully
Apr 12 07:01:12 user cinder-volume[73792]: INFO cinder.action_track [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T07:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Snapshot-1080666320',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=178489d8-1dc8-4d61-bd23-7508c4a49bcd,metadata={},progress='0%',project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume=<?>,volume_id=3caa2bbd-d34e-4bbf-804a-8e0ff080879e,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:01:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] create snapshot 178489d8-1dc8-4d61-bd23-7508c4a49bcd for volume 3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 07:01:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] cloning v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e to s_178489d8-1dc8-4d61-bd23-7508c4a49bcd {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 07:01:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] create snapshot s_178489d8-1dc8-4d61-bd23-7508c4a49bcd {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 07:01:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_178489d8-1dc8-4d61-bd23-7508c4a49bcd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] create volume s_178489d8-1dc8-4d61-bd23-7508c4a49bcd from snapshot s_178489d8-1dc8-4d61-bd23-7508c4a49bcd {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e@s_178489d8-1dc8-4d61-bd23-7508c4a49bcd', 'is_clone': True, 'full_name': 'Pool-0/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd', 'name': 's_178489d8-1dc8-4d61-bd23-7508c4a49bcd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] volume s_178489d8-1dc8-4d61-bd23-7508c4a49bcd properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 07:01:13 user cinder-volume[73792]: INFO cinder.volume.manager [None req-aa010922-bf21-42ed-8918-01cf73767d3a tempest-VolumesDeleteCascade-827739932 None] Create snapshot completed successfully
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Acquiring lock "cinder-3caa2bbd-d34e-4bbf-804a-8e0ff080879e-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Lock "cinder-3caa2bbd-d34e-4bbf-804a-8e0ff080879e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] remove_export for volume: 3caa2bbd-d34e-4bbf-804a-8e0ff080879e. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1381129636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=3caa2bbd-d34e-4bbf-804a-8e0ff080879e,launched_at=2023-04-12T07:01:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth='CHAP TljzeNZV 2gPBOaQhpeuR3l',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:09Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T07:01:14Z,updated_at=2023-04-12T07:01:14Z,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] detach volume v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e from target iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e/luns/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e/luns/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e/luns/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e/luns/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] failed to remove resource iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e because of JDSS resource v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] delete target: iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] delete target iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] failed to remove resource iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e because of JDSS resource iqn.2010-10.org.openstack:3caa2bbd-d34e-4bbf-804a-8e0ff080879e DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Performing cascade delete. {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1013}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=32,cinder:DELETE=5,cinder:SELECT=59,cinder:INSERT=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Acquiring lock "cinder-178489d8-1dc8-4d61-bd23-7508c4a49bcd-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Lock "cinder-178489d8-1dc8-4d61-bd23-7508c4a49bcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] deleating snapshot s_178489d8-1dc8-4d61-bd23-7508c4a49bcd. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] get snapshots for volume s_178489d8-1dc8-4d61-bd23-7508c4a49bcd  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:13 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] get volume s_178489d8-1dc8-4d61-bd23-7508c4a49bcd info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:01:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e@s_178489d8-1dc8-4d61-bd23-7508c4a49bcd', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284290', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61427', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5428944146892239129', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bf5ac402e7e465b3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753732608', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39846', 'name': 's_178489d8-1dc8-4d61-bd23-7508c4a49bcd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] delete snapshot s_178489d8-1dc8-4d61-bd23-7508c4a49bcd of volume v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 07:01:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots/s_178489d8-1dc8-4d61-bd23-7508c4a49bcd {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] snapshot s_178489d8-1dc8-4d61-bd23-7508c4a49bcd deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.quota [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Created reservations ['8dd4be2d-43f0-42cb-a747-a220cd7fecaf', 'dbdd37c1-9af7-4630-b4c8-9bbeb3757fa8', '169be929-f194-4b80-a01c-a13170b08dea', '35dc8732-12d5-4b26-af9a-7882012a18f5'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:01:15 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Delete snapshot completed successfully.
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Lock "cinder-178489d8-1dc8-4d61-bd23-7508c4a49bcd-delete_snapshot" released by "delete_snapshot" :: held 1.212s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Acquiring lock "cinder-94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Lock "cinder-94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] deleating snapshot s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] get snapshots for volume s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] get volume s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e@s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284288', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61421', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12501070691212487628', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '84e41fc67fcc9c76', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753769472', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39993', 'name': 's_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] delete snapshot s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad of volume v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots/s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] snapshot s_94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.quota [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Created reservations ['59d15dc2-a021-481a-ac49-ab4672e6e5a6', '353f180f-9a0f-48a3-bbed-191eb6d0749c', 'd9b04f45-a1c7-48fa-9bab-d7bc6dda4169', '2ffba8ff-c48b-4327-870f-a84255621f5f'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:01:16 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Delete snapshot completed successfully.
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Lock "cinder-94c2c0d7-eb70-4cbd-88d5-98b3dea4bdad-delete_snapshot" released by "delete_snapshot" :: held 1.210s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Snapshots deleted, issuing volume delete {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1028}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] deleating volume v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] get snapshots for volume v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] get volume v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284286', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61415', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5165314371292481435', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e65e48da209f33b8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753781760', 'san:volume_id': 'e65e48da209f33b8f127935e92c2648acf966302', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39980', 'name': 'v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] delete volume:v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] volume v_3caa2bbd-d34e-4bbf-804a-8e0ff080879e deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 07:01:17 user cinder-volume[73792]: DEBUG cinder.quota [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Created reservations ['9ff01a9d-1f1e-41c2-a00c-09e5fbb3f401', 'c6729e62-d77b-4b14-aef3-c2c050e2d911', '770a872a-6b18-44c9-ba44-e6ac9c66f021', '2df47fd7-6a0c-4d15-85d8-60a1b6271039'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:01:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:01:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:01:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753875968', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.manager [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:01:18 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Deleted volume successfully.
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.coordination [None req-0a4f4c4e-05b8-42bf-a465-a6b6c1cba81c tempest-VolumesDeleteCascade-827739932 None] Lock "cinder-3caa2bbd-d34e-4bbf-804a-8e0ff080879e-delete_volume" released by "delete_volume" :: held 4.297s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:01:18 user cinder-volume[73792]: INFO cinder.action_track [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-419310507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c46ec177-9658-4dd5-9ed8-7c00d1197f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Flow 'volume_create_manager' (1cb9936f-a4fc-4250-8229-56cea468d582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c5c677-233e-4f76-a38b-d45e04a42816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c5c677-233e-4f76-a38b-d45e04a42816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-419310507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c46ec177-9658-4dd5-9ed8-7c00d1197f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T07:01:19Z,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69af61f-1122-4eff-8b0a-b3edfe0c41c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69af61f-1122-4eff-8b0a-b3edfe0c41c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d39f0a-ec91-47c5-977b-2ed54cf29604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d39f0a-ec91-47c5-977b-2ed54cf29604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c46ec177-9658-4dd5-9ed8-7c00d1197f59', 'volume_name': 'volume-c46ec177-9658-4dd5-9ed8-7c00d1197f59', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c74145a-ed48-4bad-8f52-b93abc665aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c74145a-ed48-4bad-8f52-b93abc665aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23173db3-ae0d-476b-984d-9887f1868ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:18 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Volume c46ec177-9658-4dd5-9ed8-7c00d1197f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c46ec177-9658-4dd5-9ed8-7c00d1197f59', 'volume_size': 1}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] creating volume v_c46ec177-9658-4dd5-9ed8-7c00d1197f59. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] create volume {'name': 'v_c46ec177-9658-4dd5-9ed8-7c00d1197f59', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:18 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59', 'is_clone': False, 'name': 'v_c46ec177-9658-4dd5-9ed8-7c00d1197f59'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23173db3-ae0d-476b-984d-9887f1868ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46ec177-9658-4dd5-9ed8-7c00d1197f59', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33111e63-2053-4f8f-a22e-1fd1cd9909bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:19 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Volume volume-c46ec177-9658-4dd5-9ed8-7c00d1197f59 (c46ec177-9658-4dd5-9ed8-7c00d1197f59): created successfully
Apr 12 07:01:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33111e63-2053-4f8f-a22e-1fd1cd9909bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:19 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] Flow 'volume_create_manager' (1cb9936f-a4fc-4250-8229-56cea468d582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:01:19 user cinder-volume[73792]: INFO cinder.action_track [None req-deca2725-8715-4886-b593-e7cc9eb91e91 tempest-VolumesDeleteCascade-827739932 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-419310507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c46ec177-9658-4dd5-9ed8-7c00d1197f59,launched_at=2023-04-12T07:01:19Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth='CHAP JwmySUeY nwZxjz9fvoQuy0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:19Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T07:01:19Z,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:01:19 user cinder-volume[73792]: INFO cinder.action_track [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T07:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Snapshot-925677705',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=0c72669e-78cb-4a11-a730-fe4b72bd6ecf,metadata={},progress='0%',project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume=<?>,volume_id=c46ec177-9658-4dd5-9ed8-7c00d1197f59,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:01:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] create snapshot 0c72669e-78cb-4a11-a730-fe4b72bd6ecf for volume c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 07:01:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] cloning v_c46ec177-9658-4dd5-9ed8-7c00d1197f59 to s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 07:01:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] create snapshot s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 07:01:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:19 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_0c72669e-78cb-4a11-a730-fe4b72bd6ecf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] create volume s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf from snapshot s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 07:01:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59@s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf', 'is_clone': True, 'full_name': 'Pool-0/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf', 'name': 's_0c72669e-78cb-4a11-a730-fe4b72bd6ecf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] volume s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 07:01:20 user cinder-volume[73792]: INFO cinder.volume.manager [None req-0580ec8f-9523-4c3b-ad82-265fe5f91efa tempest-VolumesDeleteCascade-827739932 None] Create snapshot completed successfully
Apr 12 07:01:21 user cinder-volume[73792]: INFO cinder.action_track [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-191245126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ca21d91c-b461-4282-bf77-35e56eb889a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0c72669e-78cb-4a11-a730-fe4b72bd6ecf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Flow 'volume_create_manager' (9104a168-94e0-47b7-be31-4212ec67c8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a99e38-6b25-4d8e-a14c-63d3bbe8059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a99e38-6b25-4d8e-a14c-63d3bbe8059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-191245126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ca21d91c-b461-4282-bf77-35e56eb889a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0c72669e-78cb-4a11-a730-fe4b72bd6ecf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T07:01:21Z,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8edc717-f757-4744-8ff4-3ea947b7fc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8edc717-f757-4744-8ff4-3ea947b7fc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e612d8e4-4940-449b-a54d-3800f62f55c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e612d8e4-4940-449b-a54d-3800f62f55c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca21d91c-b461-4282-bf77-35e56eb889a6', 'volume_name': 'volume-ca21d91c-b461-4282-bf77-35e56eb889a6', 'volume_size': 1, 'snapshot_id': '0c72669e-78cb-4a11-a730-fe4b72bd6ecf'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfc0dca-f7e3-41e1-9a43-57eb11921d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfc0dca-f7e3-41e1-9a43-57eb11921d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39f9739-f39a-4d3b-987c-408283ae53a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:21 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Volume ca21d91c-b461-4282-bf77-35e56eb889a6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca21d91c-b461-4282-bf77-35e56eb889a6', 'volume_size': 1, 'snapshot_id': '0c72669e-78cb-4a11-a730-fe4b72bd6ecf'}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] create volume ca21d91c-b461-4282-bf77-35e56eb889a6 from snapshot 0c72669e-78cb-4a11-a730-fe4b72bd6ecf {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] cloning s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf to v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] create snapshot v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_ca21d91c-b461-4282-bf77-35e56eb889a6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] create volume v_ca21d91c-b461-4282-bf77-35e56eb889a6 from snapshot v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf@v_ca21d91c-b461-4282-bf77-35e56eb889a6', 'is_clone': True, 'full_name': 'Pool-0/v_ca21d91c-b461-4282-bf77-35e56eb889a6', 'name': 'v_ca21d91c-b461-4282-bf77-35e56eb889a6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] get volume v_ca21d91c-b461-4282-bf77-35e56eb889a6 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:01:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf@v_ca21d91c-b461-4282-bf77-35e56eb889a6', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ca21d91c-b461-4282-bf77-35e56eb889a6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284299', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61452', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10092512383979012084', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'efc791bb000ad7fa', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753769472', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39487', 'name': 'v_ca21d91c-b461-4282-bf77-35e56eb889a6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39f9739-f39a-4d3b-987c-408283ae53a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca21d91c-b461-4282-bf77-35e56eb889a6', 'volume_size': 1, 'snapshot_id': '0c72669e-78cb-4a11-a730-fe4b72bd6ecf'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550d962e-f69b-4c82-aaa0-44920f5ecaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:01:22 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Volume volume-ca21d91c-b461-4282-bf77-35e56eb889a6 (ca21d91c-b461-4282-bf77-35e56eb889a6): created successfully
Apr 12 07:01:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550d962e-f69b-4c82-aaa0-44920f5ecaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:01:22 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] Flow 'volume_create_manager' (9104a168-94e0-47b7-be31-4212ec67c8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:01:22 user cinder-volume[73792]: INFO cinder.action_track [None req-227a6c97-c549-4b09-89a8-e6fbef46a915 tempest-VolumesDeleteCascade-827739932 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-191245126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ca21d91c-b461-4282-bf77-35e56eb889a6,launched_at=2023-04-12T07:01:22Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth='CHAP xoePBkNH QNbJU71ZpPWHSu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:21Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=0c72669e-78cb-4a11-a730-fe4b72bd6ecf,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T07:01:21Z,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Acquiring lock "cinder-c46ec177-9658-4dd5-9ed8-7c00d1197f59-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Lock "cinder-c46ec177-9658-4dd5-9ed8-7c00d1197f59-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] remove_export for volume: c46ec177-9658-4dd5-9ed8-7c00d1197f59. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-419310507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=c46ec177-9658-4dd5-9ed8-7c00d1197f59,launched_at=2023-04-12T07:01:19Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth='CHAP JwmySUeY nwZxjz9fvoQuy0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:19Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T07:01:23Z,updated_at=2023-04-12T07:01:23Z,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] detach volume v_c46ec177-9658-4dd5-9ed8-7c00d1197f59 from target iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59/luns/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59/luns/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59/luns/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59/luns/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] failed to remove resource iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 because of JDSS resource v_c46ec177-9658-4dd5-9ed8-7c00d1197f59 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] delete target: iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] delete target iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] failed to remove resource iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 because of JDSS resource iqn.2010-10.org.openstack:c46ec177-9658-4dd5-9ed8-7c00d1197f59 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Performing cascade delete. {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1013}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Acquiring lock "cinder-0c72669e-78cb-4a11-a730-fe4b72bd6ecf-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Lock "cinder-0c72669e-78cb-4a11-a730-fe4b72bd6ecf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] deleating snapshot s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] get snapshots for volume s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-12 09:24:58', 'volsize': '1073741824', 'createtxg': '61451', 'guid': '8425978949485450910', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '0', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/v_ca21d91c-b461-4282-bf77-35e56eb889a6', 'objsetid': '39481', 'name': 'v_ca21d91c-b461-4282-bf77-35e56eb889a6', 'defer_destroy': 'off', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] volume s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf updated {{(pid=73792) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}}
Apr 12 07:01:24 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=68,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:01:24 user cinder-volume[73792]: DEBUG cinder.quota [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Created reservations ['bf8e2956-d0de-4d84-a2f8-d41539c504cf', '1d1c6477-fc15-413a-b9bc-89cfa43bfd0b', '29a7fbbb-565c-4285-bdb1-f8cc14a30f8f', '6ef2d32d-8ff8-41a5-9e26-a915715165c4'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:01:24 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=56,cinder:INSERT=10,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:01:24 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Delete snapshot completed successfully.
Apr 12 07:01:24 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Lock "cinder-0c72669e-78cb-4a11-a730-fe4b72bd6ecf-delete_snapshot" released by "delete_snapshot" :: held 1.369s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:01:24 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Snapshots deleted, issuing volume delete {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1028}}
Apr 12 07:01:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] deleating volume v_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 07:01:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] get snapshots for volume v_c46ec177-9658-4dd5-9ed8-7c00d1197f59  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:01:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-12 09:24:57', 'volsize': '1073741824', 'createtxg': '61445', 'guid': '7026438814974546974', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '57344', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/t_0c72669e-78cb-4a11-a730-fe4b72bd6ecf', 'objsetid': '39465', 'name': 's_0c72669e-78cb-4a11-a730-fe4b72bd6ecf', 'defer_destroy': 'off', 'san:volume_id': '9a599326cec50054e71ea6c087e744835957d87a', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] volume v_c46ec177-9658-4dd5-9ed8-7c00d1197f59 updated {{(pid=73792) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.quota [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Created reservations ['09382116-0b61-43a3-8cea-452aa04bb32d', 'b4792ee2-9be1-48b2-be8f-0477063bd46e', '7b59e3a8-855d-4a21-9e8f-d7972d6667c2', 'd6e574a3-d8e3-4bc1-83a2-4238346b43b5'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753769472', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.manager [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:01:26 user cinder-volume[73792]: INFO cinder.volume.manager [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Deleted volume successfully.
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-b77d6f08-0fe0-4970-849c-5df9eb068d93 tempest-VolumesDeleteCascade-827739932 None] Lock "cinder-c46ec177-9658-4dd5-9ed8-7c00d1197f59-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Acquiring lock "cinder-ca21d91c-b461-4282-bf77-35e56eb889a6-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Lock "cinder-ca21d91c-b461-4282-bf77-35e56eb889a6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] remove_export for volume: ca21d91c-b461-4282-bf77-35e56eb889a6. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-191245126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=ca21d91c-b461-4282-bf77-35e56eb889a6,launched_at=2023-04-12T07:01:22Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ed8711f2140abaf7c73aa9c0c30de',provider_auth='CHAP xoePBkNH QNbJU71ZpPWHSu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:01:21Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=0c72669e-78cb-4a11-a730-fe4b72bd6ecf,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T07:01:27Z,updated_at=2023-04-12T07:01:27Z,use_quota=True,user_id='4bc6121b3e284975a59ec3e26be23c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] detach volume v_ca21d91c-b461-4282-bf77-35e56eb889a6 from target iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6/luns/v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6/luns/v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6/luns/v_ca21d91c-b461-4282-bf77-35e56eb889a6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6/luns/v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] failed to remove resource iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 because of JDSS resource v_ca21d91c-b461-4282-bf77-35e56eb889a6 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] delete target: iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] delete target iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] failed to remove resource iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 because of JDSS resource iqn.2010-10.org.openstack:ca21d91c-b461-4282-bf77-35e56eb889a6 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] deleating volume v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] get snapshots for volume v_ca21d91c-b461-4282-bf77-35e56eb889a6  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca21d91c-b461-4282-bf77-35e56eb889a6/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca21d91c-b461-4282-bf77-35e56eb889a6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca21d91c-b461-4282-bf77-35e56eb889a6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] get volume v_ca21d91c-b461-4282-bf77-35e56eb889a6 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_0c72669e-78cb-4a11-a730-fe4b72bd6ecf@v_ca21d91c-b461-4282-bf77-35e56eb889a6', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ca21d91c-b461-4282-bf77-35e56eb889a6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284299', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61452', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10092512383979012084', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'efc791bb000ad7fa', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753769472', 'san:volume_id': 'efc791bb000ad7fa5b69700f37c6a19b52ecc35c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39487', 'name': 'v_ca21d91c-b461-4282-bf77-35e56eb889a6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ca21d91c-b461-4282-bf77-35e56eb889a6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] get snapshots for volume t_0c72669e-78cb-4a11-a730-fe4b72bd6ecf  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-12 09:24:58', 'volsize': '1073741824', 'createtxg': '61451', 'guid': '8425978949485450910', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '0', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/v_ca21d91c-b461-4282-bf77-35e56eb889a6', 'objsetid': '39481', 'name': 'v_ca21d91c-b461-4282-bf77-35e56eb889a6', 'defer_destroy': 'off', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_0c72669e-78cb-4a11-a730-fe4b72bd6ecf/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] get volume t_0c72669e-78cb-4a11-a730-fe4b72bd6ecf info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_0c72669e-78cb-4a11-a730-fe4b72bd6ecf {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_0c72669e-78cb-4a11-a730-fe4b72bd6ecf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_c46ec177-9658-4dd5-9ed8-7c00d1197f59@s_0c72669e-78cb-4a11-a730-fe4b72bd6ecf', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_0c72669e-78cb-4a11-a730-fe4b72bd6ecf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284297', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61446', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '244090461303170645', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a50cf2e28dd3d863', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753769472', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39471', 'name': 't_0c72669e-78cb-4a11-a730-fe4b72bd6ecf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_0c72669e-78cb-4a11-a730-fe4b72bd6ecf {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] get snapshots for volume t_c46ec177-9658-4dd5-9ed8-7c00d1197f59  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c46ec177-9658-4dd5-9ed8-7c00d1197f59/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c46ec177-9658-4dd5-9ed8-7c00d1197f59/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-12 09:24:57', 'volsize': '1073741824', 'createtxg': '61445', 'guid': '7026438814974546974', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '57344', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/t_0c72669e-78cb-4a11-a730-fe4b72bd6ecf', 'objsetid': '39465', 'name': 's_0c72669e-78cb-4a11-a730-fe4b72bd6ecf', 'defer_destroy': 'off', 'san:volume_id': '9a599326cec50054e71ea6c087e744835957d87a', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c46ec177-9658-4dd5-9ed8-7c00d1197f59/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] get volume t_c46ec177-9658-4dd5-9ed8-7c00d1197f59 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_c46ec177-9658-4dd5-9ed8-7c00d1197f59', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284296', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61440', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9831353772788603047', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9a599326cec50054', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753744896', 'san:volume_id': '9a599326cec50054e71ea6c087e744835957d87a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39458', 'name': 't_c46ec177-9658-4dd5-9ed8-7c00d1197f59', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] delete volume:t_c46ec177-9658-4dd5-9ed8-7c00d1197f59 recursively children:{'recursively_children': True, 'recursively_dependents': True, 'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Geting {'code': 500, 'error': {'class': 'opene.storage.zfs.ZfsOeError', 'message': 'In order to delete a zvol, you must delete all of its clones first.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c46ec177-9658-4dd5-9ed8-7c00d1197f59'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_c46ec177-9658-4dd5-9ed8-7c00d1197f59 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:28 user cinder-volume[73792]: DEBUG cinder.coordination [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Lock "cinder-ca21d91c-b461-4282-bf77-35e56eb889a6-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server [None req-663c30b6-5320-444e-96f6-c067c6dd71af tempest-VolumesDeleteCascade-827739932 None] Exception during message handling: KeyError: 'errno'
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 204, in wrapper
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, volume, *args, **kwargs)
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1042, in delete_volume
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1031, in delete_volume
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     self.driver.delete_volume(volume)
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 286, in delete_volume
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     self._gc_delete(vname)
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 305, in _gc_delete
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     self._delete_back_recursively(jcom.origin_volume(vol['origin']),
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 369, in _delete_back_recursively
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     self._delete_back_recursively(
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 374, in _delete_back_recursively
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     self.ra.delete_lun(opvname,
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 360, in delete_lun
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server     if resp["error"]["errno"] == 1000:
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server KeyError: 'errno'
Apr 12 07:01:28 user cinder-volume[73792]: ERROR oslo_messaging.rpc.server 
Apr 12 07:01:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:01:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:01:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:01:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:01:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:01:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753744896', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:01:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:01:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:02:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=24,cinder:INSERT=3,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:02:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=8,cinder:SELECT=19,cinder:INSERT=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:02:25 user cinder-volume[73792]: INFO cinder.action_track [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T07:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-snapshot-472656314',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=c9fb97a0-d608-44ef-8284-cdefb3232277,metadata={},progress='0%',project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume=<?>,volume_id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:02:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] create snapshot c9fb97a0-d608-44ef-8284-cdefb3232277 for volume 1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 07:02:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] cloning v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b to s_c9fb97a0-d608-44ef-8284-cdefb3232277 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 07:02:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] create snapshot s_c9fb97a0-d608-44ef-8284-cdefb3232277 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 07:02:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:02:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:02:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c9fb97a0-d608-44ef-8284-cdefb3232277'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:02:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] create volume s_c9fb97a0-d608-44ef-8284-cdefb3232277 from snapshot s_c9fb97a0-d608-44ef-8284-cdefb3232277 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 07:02:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:02:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:02:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b@s_c9fb97a0-d608-44ef-8284-cdefb3232277', 'is_clone': True, 'full_name': 'Pool-0/s_c9fb97a0-d608-44ef-8284-cdefb3232277', 'name': 's_c9fb97a0-d608-44ef-8284-cdefb3232277'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:02:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:02:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:02:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:02:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] volume s_c9fb97a0-d608-44ef-8284-cdefb3232277 properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 07:02:26 user cinder-volume[73792]: INFO cinder.volume.manager [None req-3ac7b72b-1b2b-4a35-a080-e27b192a8233 tempest-TestVolumeBootPattern-294210775 None] Create snapshot completed successfully
Apr 12 07:02:27 user cinder-volume[73792]: INFO cinder.action_track [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-770279065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6836b4d5-ab04-46f5-bd65-97daf28c5c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c9fb97a0-d608-44ef-8284-cdefb3232277,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Flow 'volume_create_manager' (e798716f-03f7-4f73-87d9-27358663307e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a22ab8-9215-47e7-952e-38c76686cdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a22ab8-9215-47e7-952e-38c76686cdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-770279065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6836b4d5-ab04-46f5-bd65-97daf28c5c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c9fb97a0-d608-44ef-8284-cdefb3232277,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T07:02:28Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d8cc7e-51fb-450e-b016-bc2348cc4c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d8cc7e-51fb-450e-b016-bc2348cc4c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898e42df-c42e-479e-b175-276c66a26a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898e42df-c42e-479e-b175-276c66a26a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'volume_name': 'volume-6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'volume_size': 1, 'snapshot_id': 'c9fb97a0-d608-44ef-8284-cdefb3232277'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1022de-9e41-4472-b8d4-05ab82c6b406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1022de-9e41-4472-b8d4-05ab82c6b406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7405026d-0af6-4148-8817-60a03ee7724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:02:27 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Volume 6836b4d5-ab04-46f5-bd65-97daf28c5c63: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'volume_size': 1, 'snapshot_id': 'c9fb97a0-d608-44ef-8284-cdefb3232277'}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] create volume 6836b4d5-ab04-46f5-bd65-97daf28c5c63 from snapshot c9fb97a0-d608-44ef-8284-cdefb3232277 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] cloning s_c9fb97a0-d608-44ef-8284-cdefb3232277 to v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] create snapshot v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:02:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_6836b4d5-ab04-46f5-bd65-97daf28c5c63'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] create volume v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 from snapshot v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_c9fb97a0-d608-44ef-8284-cdefb3232277@v_6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'is_clone': True, 'full_name': 'Pool-0/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'name': 'v_6836b4d5-ab04-46f5-bd65-97daf28c5c63'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] get volume v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_c9fb97a0-d608-44ef-8284-cdefb3232277@v_6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284365', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '61478', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16843095837888165574', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd0ddc5a3cc439990', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753622016', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '39701', 'name': 'v_6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.volume_utils [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Marking volume 6836b4d5-ab04-46f5-bd65-97daf28c5c63 as bootable. {{(pid=73792) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Copying metadata from snapshot c9fb97a0-d608-44ef-8284-cdefb3232277 to 6836b4d5-ab04-46f5-bd65-97daf28c5c63. {{(pid=73792) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7405026d-0af6-4148-8817-60a03ee7724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'volume_size': 1, 'snapshot_id': 'c9fb97a0-d608-44ef-8284-cdefb3232277'}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c828455-d339-49ea-bc0e-7d381dcfefa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:02:28 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Volume volume-6836b4d5-ab04-46f5-bd65-97daf28c5c63 (6836b4d5-ab04-46f5-bd65-97daf28c5c63): created successfully
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c828455-d339-49ea-bc0e-7d381dcfefa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:02:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] Flow 'volume_create_manager' (e798716f-03f7-4f73-87d9-27358663307e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:02:28 user cinder-volume[73792]: INFO cinder.action_track [None req-ac8ff944-8fd3-4b46-84ee-5d492558670f tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-770279065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6836b4d5-ab04-46f5-bd65-97daf28c5c63,launched_at=2023-04-12T07:02:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP ZRiAsNwu lNvEHDsd0G9Qw1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:02:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=c9fb97a0-d608-44ef-8284-cdefb3232277,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T07:02:28Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:02:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:02:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:02:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:02:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:02:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:02:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753609728', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:02:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:02:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:02:32 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=27,cinder:UPDATE=3,cinder:DELETE=1,cinder:INSERT=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:02:32 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=19,cinder:UPDATE=8,cinder:INSERT=19,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:02:32 user cinder-volume[73792]: INFO cinder.action_track [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'called' FILE:/opt/stack/cinder/cinder/volume/manager.py:4950:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-770279065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6836b4d5-ab04-46f5-bd65-97daf28c5c63,launched_at=2023-04-12T07:02:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP ZRiAsNwu lNvEHDsd0G9Qw1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:02:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=c9fb97a0-d608-44ef-8284-cdefb3232277,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T07:02:31Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:02:32 user cinder-volume[73792]: INFO cinder.action_track [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'call create_export' FILE:/opt/stack/cinder/cinder/volume/manager.py:4876:_connection_create RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-770279065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6836b4d5-ab04-46f5-bd65-97daf28c5c63,launched_at=2023-04-12T07:02:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP ZRiAsNwu lNvEHDsd0G9Qw1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:02:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=c9fb97a0-d608-44ef-8284-cdefb3232277,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T07:02:31Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:02:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] create export for volume: 6836b4d5-ab04-46f5-bd65-97daf28c5c63. {{(pid=73792) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}}
Apr 12 07:02:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] ensure volume 6836b4d5-ab04-46f5-bd65-97daf28c5c63 assigned to a proper target {{(pid=73792) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}}
Apr 12 07:02:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] check if targe iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 exists {{(pid=73792) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}}
Apr 12 07:02:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:02:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:02:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:02:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] create target and attach volume 6836b4d5-ab04-46f5-bd65-97daf28c5c63 to it {{(pid=73792) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}}
Apr 12 07:02:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] create target iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}}
Apr 12 07:02:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:02:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:02:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:02:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] atach volume v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 to target iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}}
Apr 12 07:02:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/luns {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:02:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:02:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6430646463356133', 'lun': 0, 'mode': 'wt', 'name': 'v_6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'prod_id': 'Storage', 'scsi_id': 'd0ddc5a3cc439990'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/luns {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:02:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] add credentails to target iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}}
Apr 12 07:02:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/incoming-users {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:02:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:02:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 201, 'error': None, 'data': {'name': 'ZRiAsNwu'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/incoming-users {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:02:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] initialize_connection for 6836b4d5-ab04-46f5-bd65-97daf28c5c63 10.0.0.210. {{(pid=73792) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}}
Apr 12 07:02:36 user cinder-volume[73792]: INFO cinder.action_track [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRiAsNwu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '140c0233-24f6-4c9a-b3cc-53829243decc'}' FILE:/opt/stack/cinder/cinder/volume/manager.py:4923:_connection_create RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-770279065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6836b4d5-ab04-46f5-bd65-97daf28c5c63,launched_at=2023-04-12T07:02:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP ZRiAsNwu lNvEHDsd0G9Qw1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:02:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=c9fb97a0-d608-44ef-8284-cdefb3232277,snapshots=<?>,source_volid=None,status='reserved',terminated_at=None,updated_at=2023-04-12T07:02:31Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:02:36 user cinder-volume[73792]: INFO cinder.action_track [req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 req-375f0cfd-7704-4024-b82b-c2b2c951201d tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_attach' MSG:'attachment_update completed_successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:4996:attachment_update RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attaching',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-770279065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6836b4d5-ab04-46f5-bd65-97daf28c5c63,launched_at=2023-04-12T07:02:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP ZRiAsNwu lNvEHDsd0G9Qw1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:02:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=c9fb97a0-d608-44ef-8284-cdefb3232277,snapshots=<?>,source_volid=None,status='attaching',terminated_at=None,updated_at=2023-04-12T07:02:36Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:03:01 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=2,cinder:SELECT=10 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:03:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:03:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:03:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:03:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:03:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:03:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753134592', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:03:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:03:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:03:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:03:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:04:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=7 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:04:21 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:04:25 user cinder-volume[73792]: INFO cinder.action_track [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-770279065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6836b4d5-ab04-46f5-bd65-97daf28c5c63,launched_at=2023-04-12T07:02:29Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP ZRiAsNwu lNvEHDsd0G9Qw1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:02:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=c9fb97a0-d608-44ef-8284-cdefb3232277,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T07:02:36Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:04:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] terminate connection for 6836b4d5-ab04-46f5-bd65-97daf28c5c63  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 07:04:25 user cinder-volume[73792]: INFO cinder.action_track [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-770279065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6836b4d5-ab04-46f5-bd65-97daf28c5c63,launched_at=2023-04-12T07:02:29Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP ZRiAsNwu lNvEHDsd0G9Qw1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:02:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=c9fb97a0-d608-44ef-8284-cdefb3232277,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T07:02:36Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:04:25 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] Deleting attachment 140c0233-24f6-4c9a-b3cc-53829243decc. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 07:04:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] remove_export for volume: 6836b4d5-ab04-46f5-bd65-97daf28c5c63. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:04:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:04:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-770279065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6836b4d5-ab04-46f5-bd65-97daf28c5c63,launched_at=2023-04-12T07:02:29Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP ZRiAsNwu lNvEHDsd0G9Qw1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:02:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=c9fb97a0-d608-44ef-8284-cdefb3232277,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T07:02:36Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:04:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] detach volume v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 from target iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:04:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/luns/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:04:25 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/luns/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:04:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/luns/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:04:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] delete target: iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:04:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] delete target iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:04:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:04:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:04:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:04:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4745896a-d910-4020-80c2-6e402b30581a req-4f1525b1-468c-4f14-a6ae-7a3dee27c855 tempest-TestVolumeBootPattern-294210775 None] target iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 07:04:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:04:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:04:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:04:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:04:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:04:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753122304', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:04:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:04:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:04:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:04:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:05:11 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Acquiring lock "cinder-6836b4d5-ab04-46f5-bd65-97daf28c5c63-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-6836b4d5-ab04-46f5-bd65-97daf28c5c63-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] remove_export for volume: 6836b4d5-ab04-46f5-bd65-97daf28c5c63. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-770279065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=6836b4d5-ab04-46f5-bd65-97daf28c5c63,launched_at=2023-04-12T07:02:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP ZRiAsNwu lNvEHDsd0G9Qw1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:02:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=c9fb97a0-d608-44ef-8284-cdefb3232277,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T07:05:14Z,updated_at=2023-04-12T07:05:14Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] detach volume v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 from target iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/luns/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/luns/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/luns/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63/luns/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] failed to remove resource iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 because of JDSS resource v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] delete target: iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] delete target iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] failed to remove resource iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 because of JDSS resource iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] deleating volume v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] get snapshots for volume v_6836b4d5-ab04-46f5-bd65-97daf28c5c63  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] get volume v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_c9fb97a0-d608-44ef-8284-cdefb3232277@v_6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284365', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '61478', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16843095837888165574', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '266240', 'logicalused': '1097728', 'compressratio': '5.05', 'rootcontext': 'none', 'default_scsi_id': 'd0ddc5a3cc439990', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753122304', 'san:volume_id': 'd0ddc5a3cc439990d0900639a77c1c6e80522cf0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.68', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '266240', 'objsetid': '39701', 'name': 'v_6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '266240', 'logicalreferenced': '43855872', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] delete snapshot v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 of volume s_c9fb97a0-d608-44ef-8284-cdefb3232277 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/snapshots/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:05:14 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/snapshots/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:05:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/snapshots/v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:05:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] snapshot v_6836b4d5-ab04-46f5-bd65-97daf28c5c63 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 07:05:15 user cinder-volume[73792]: DEBUG cinder.quota [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Created reservations ['115af14a-651e-47e8-a42a-66423d4030f2', '3ce2347f-0215-41d0-964d-e188a42c36cc', '69b94eeb-52f9-4399-90ef-64b66074db0c', 'abc0d8b2-4e0a-40af-adfa-5495cadbc768'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:05:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:05:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:05:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:05:15 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'available': '114753462272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.manager [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:05:16 user cinder-volume[73792]: INFO cinder.volume.manager [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Deleted volume successfully.
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.coordination [None req-4bc411c2-761f-4529-a811-f608e30dbb0d tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-6836b4d5-ab04-46f5-bd65-97daf28c5c63-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Acquiring lock "cinder-c9fb97a0-d608-44ef-8284-cdefb3232277-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-c9fb97a0-d608-44ef-8284-cdefb3232277-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] deleating snapshot s_c9fb97a0-d608-44ef-8284-cdefb3232277. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] get snapshots for volume s_c9fb97a0-d608-44ef-8284-cdefb3232277  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] get volume s_c9fb97a0-d608-44ef-8284-cdefb3232277 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b@s_c9fb97a0-d608-44ef-8284-cdefb3232277', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c9fb97a0-d608-44ef-8284-cdefb3232277', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284363', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '61472', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13596914459922893130', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ee6f6304d53357b1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753462272', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '39869', 'name': 's_c9fb97a0-d608-44ef-8284-cdefb3232277', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c9fb97a0-d608-44ef-8284-cdefb3232277 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] delete snapshot s_c9fb97a0-d608-44ef-8284-cdefb3232277 of volume v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b/snapshots/s_c9fb97a0-d608-44ef-8284-cdefb3232277 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:05:16 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b/snapshots/s_c9fb97a0-d608-44ef-8284-cdefb3232277 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:05:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b/snapshots/s_c9fb97a0-d608-44ef-8284-cdefb3232277 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:05:17 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] snapshot s_c9fb97a0-d608-44ef-8284-cdefb3232277 deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 07:05:17 user cinder-volume[73792]: DEBUG cinder.quota [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Created reservations ['23256cea-60e6-4134-ab28-8ba90c36b52c', '54800f7e-f1cd-4200-81da-8a5e6c16635b', '4ded3a59-36d0-449e-82ac-92e32b5b1afb', '79256c2a-c288-4f72-9c9f-d5c61d126cad'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:05:17 user cinder-volume[73792]: INFO cinder.volume.manager [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Delete snapshot completed successfully.
Apr 12 07:05:17 user cinder-volume[73792]: DEBUG cinder.coordination [None req-7b9d7d0b-85d6-4d17-b95a-be824a4a414c tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-c9fb97a0-d608-44ef-8284-cdefb3232277-delete_snapshot" released by "delete_snapshot" :: held 1.264s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:05:21 user cinder-volume[73792]: INFO cinder.action_track [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_detach' MSG:'Call driver.terminate_connection' FILE:/opt/stack/cinder/cinder/volume/manager.py:5030:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T07:00:38Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] terminate connection for 1640bd09-1264-4e82-9e6e-0f1fa3cc654b  {{(pid=73792) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}}
Apr 12 07:05:21 user cinder-volume[73792]: INFO cinder.action_track [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] ACTION:'volume_detach' MSG:'Terminate volume connection completed successfully.' FILE:/opt/stack/cinder/cinder/volume/manager.py:5054:_connection_terminate RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T07:00:38Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] Deleting attachment 532d24d3-68c8-4980-9e73-f39c0a06011f. {{(pid=73792) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5080}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] remove_export for volume: 1640bd09-1264-4e82-9e6e-0f1fa3cc654b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] detach volume:Volume(_name_id=None,admin_metadata=<?>,attach_status='attached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata=<?>,migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-12T07:00:38Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=<?>,volume_type=<?>,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] detach volume v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b from target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] delete target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] delete target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:05:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d136681b-a30d-4363-8f9b-652dd37d168d req-2e17614c-307e-4b3f-bf0a-b9150c188c44 tempest-TestVolumeBootPattern-294210775 None] target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b deleted {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}}
Apr 12 07:05:30 user cinder-volume[73792]: DEBUG oslo_service.periodic_task [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73792) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:05:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:05:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:05:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:05:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:05:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Geting {'code': 200, 'error': None, 'data': {'available': '114753691648', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:05:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:05:30 user cinder-volume[73792]: DEBUG cinder.manager [None req-af39e30d-bdc9-490a-ba65-6046bfdae4ee None None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:05:31 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:UPDATE=15,cinder:SELECT=24,cinder:INSERT=5 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:05:41 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=29,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:05:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Acquiring lock "cinder-1640bd09-1264-4e82-9e6e-0f1fa3cc654b-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-1640bd09-1264-4e82-9e6e-0f1fa3cc654b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] remove_export for volume: 1640bd09-1264-4e82-9e6e-0f1fa3cc654b. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T06:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-889496479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=1640bd09-1264-4e82-9e6e-0f1fa3cc654b,launched_at=2023-04-12T06:57:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d1513e8b784c758412ddfc2692bb22',provider_auth='CHAP hRcotZzs lFsDcnZ5mfbPVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T06:57:46Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T07:06:11Z,updated_at=2023-04-12T07:06:11Z,use_quota=True,user_id='1fec39f776464d339142eeed1ba95a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] detach volume v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b from target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b/luns/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] failed to remove resource iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b because of JDSS resource v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] delete target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] delete target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] failed to remove resource iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b because of JDSS resource iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] deleating volume v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] get snapshots for volume v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:10 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] get volume v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f@v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284083', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '61324', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13858606108262137367', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10145792', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '419dafea0aadac2b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114753691648', 'san:volume_id': '419dafea0aadac2bfdf70f17601f9313fcf0f80d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10145792', 'objsetid': '39449', 'name': 'v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10145792', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] delete snapshot v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b of volume v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fc3da3e2-e1a6-48d2-9d93-efbfeb8e565f/snapshots/v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] snapshot v_1640bd09-1264-4e82-9e6e-0f1fa3cc654b deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.quota [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Created reservations ['e416c3e3-c661-4502-b2ab-8b17656eac6c', '4cc53e72-0d87-4fe6-a379-b527cf0c6cd6', '91d42d07-948c-4318-b72b-f4d9209ce89e', '67ffa26b-53f0-42af-8181-aa7c3b114db1'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:11 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763948032', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:12 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:06:12 user cinder-volume[73792]: DEBUG cinder.manager [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:06:12 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Deleted volume successfully.
Apr 12 07:06:12 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=21,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:06:12 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c0e0a62f-1a6a-4b63-b44d-51a84f638a2f tempest-TestVolumeBootPattern-294210775 None] Lock "cinder-1640bd09-1264-4e82-9e6e-0f1fa3cc654b-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:06:20 user cinder-volume[73792]: INFO cinder.action_track [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-631500073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0801af91c1431cb18e729fbd79085b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='b7cf224b5b314d02b54e24b5d9e792cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Flow 'volume_create_manager' (93b90894-0ffa-44be-8b7a-14027112b997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b171e1b7-448c-4038-a895-a28073eb0cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b171e1b7-448c-4038-a895-a28073eb0cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-631500073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0801af91c1431cb18e729fbd79085b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T07:06:21Z,use_quota=True,user_id='b7cf224b5b314d02b54e24b5d9e792cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4987529-a378-4ebf-8787-9bbf3af86676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4987529-a378-4ebf-8787-9bbf3af86676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7a7617-574a-4781-bf00-378aa975fd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7a7617-574a-4781-bf00-378aa975fd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6', 'volume_name': 'volume-846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f07bd2-1ab7-47e1-9432-fdf1f6f5c4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f07bd2-1ab7-47e1-9432-fdf1f6f5c4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10902d3-c342-439f-bef3-c1676ab328f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:06:20 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Volume 846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6', 'volume_size': 1}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] creating volume v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] create volume {'name': 'v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:20 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6', 'is_clone': False, 'name': 'v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10902d3-c342-439f-bef3-c1676ab328f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:06:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef62c9cd-58a4-4696-b340-3d397fcf446f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:06:21 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Volume volume-846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 (846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6): created successfully
Apr 12 07:06:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef62c9cd-58a4-4696-b340-3d397fcf446f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:06:21 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] Flow 'volume_create_manager' (93b90894-0ffa-44be-8b7a-14027112b997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:06:21 user cinder-volume[73792]: INFO cinder.action_track [None req-ca787ee7-ae79-4975-aa80-8817f2ea632d tempest-VolumeRevertTests-2146992826 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-631500073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6,launched_at=2023-04-12T07:06:21Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0801af91c1431cb18e729fbd79085b',provider_auth='CHAP msHgSJXw fAxbHe5irKz4ca',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:06:21Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T07:06:21Z,use_quota=True,user_id='b7cf224b5b314d02b54e24b5d9e792cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:06:21 user cinder-volume[73792]: INFO cinder.action_track [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T07:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Snapshot-602441849',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=b94a9c5d-6eae-40fa-9856-5139baa4a99a,metadata={mykey1='value1'},progress='0%',project_id='dd0801af91c1431cb18e729fbd79085b',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='b7cf224b5b314d02b54e24b5d9e792cc',volume=<?>,volume_id=846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:06:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] create snapshot b94a9c5d-6eae-40fa-9856-5139baa4a99a for volume 846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 07:06:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] cloning v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 to s_b94a9c5d-6eae-40fa-9856-5139baa4a99a {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 07:06:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] create snapshot s_b94a9c5d-6eae-40fa-9856-5139baa4a99a {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 07:06:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:21 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_b94a9c5d-6eae-40fa-9856-5139baa4a99a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] create volume s_b94a9c5d-6eae-40fa-9856-5139baa4a99a from snapshot s_b94a9c5d-6eae-40fa-9856-5139baa4a99a {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 07:06:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6@s_b94a9c5d-6eae-40fa-9856-5139baa4a99a', 'is_clone': True, 'full_name': 'Pool-0/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a', 'name': 's_b94a9c5d-6eae-40fa-9856-5139baa4a99a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:22 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] volume s_b94a9c5d-6eae-40fa-9856-5139baa4a99a properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 07:06:22 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=22,cinder:UPDATE=9,cinder:DELETE=2 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:06:22 user cinder-volume[73792]: INFO cinder.volume.manager [None req-5b27f4ca-a6fb-4050-8d3e-b207f5247b9a tempest-VolumeRevertTests-2146992826 None] Create snapshot completed successfully
Apr 12 07:06:23 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Start to perform revert to snapshot process.
Apr 12 07:06:23 user cinder-volume[73792]: INFO cinder.action_track [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T07:06:23Z,deleted=False,deleted_at=None,display_description='This is only used for backup when reverting. If the reverting process failed, you can restore you data by creating new volume with this snapshot.',display_name='[revert] volume 846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 backup snapshot',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=03b4b91b-a991-4437-812b-cfbaa69f2b0f,metadata={},progress='0%',project_id='dd0801af91c1431cb18e729fbd79085b',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=False,user_id='b7cf224b5b314d02b54e24b5d9e792cc',volume=<?>,volume_id=846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:06:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] create snapshot 03b4b91b-a991-4437-812b-cfbaa69f2b0f for volume 846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 07:06:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] cloning v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 to s_03b4b91b-a991-4437-812b-cfbaa69f2b0f {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 07:06:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] create snapshot s_03b4b91b-a991-4437-812b-cfbaa69f2b0f {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 07:06:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_03b4b91b-a991-4437-812b-cfbaa69f2b0f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] create volume s_03b4b91b-a991-4437-812b-cfbaa69f2b0f from snapshot s_03b4b91b-a991-4437-812b-cfbaa69f2b0f {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 07:06:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6@s_03b4b91b-a991-4437-812b-cfbaa69f2b0f', 'is_clone': True, 'full_name': 'Pool-0/s_03b4b91b-a991-4437-812b-cfbaa69f2b0f', 'name': 's_03b4b91b-a991-4437-812b-cfbaa69f2b0f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_03b4b91b-a991-4437-812b-cfbaa69f2b0f/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:23 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_03b4b91b-a991-4437-812b-cfbaa69f2b0f/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_03b4b91b-a991-4437-812b-cfbaa69f2b0f/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] volume s_03b4b91b-a991-4437-812b-cfbaa69f2b0f properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 07:06:24 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Create snapshot completed successfully
Apr 12 07:06:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] reverting v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 to s_b94a9c5d-6eae-40fa-9856-5139baa4a99a {{(pid=73792) revert_to_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:420}}
Apr 12 07:06:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] get volume v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:06:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284598', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61547', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1724029298048149950', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3e2420cded36fb03', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763804672', 'san:volume_id': '3e2420cded36fb0313f18a99db265bf083c194a3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39167', 'name': 'v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] rollback volume v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 to snapshot s_b94a9c5d-6eae-40fa-9856-5139baa4a99a {{(pid=73792) rollback_volume_to_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:707}}
Apr 12 07:06:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a/rollback {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:24 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a/rollback {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': None} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a/rollback {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] get volume v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284598', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61547', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1724029298048149950', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3e2420cded36fb03', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763853824', 'san:volume_id': '3e2420cded36fb0313f18a99db265bf083c194a3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39167', 'name': 'v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Acquiring lock "cinder-03b4b91b-a991-4437-812b-cfbaa69f2b0f-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Lock "cinder-03b4b91b-a991-4437-812b-cfbaa69f2b0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] deleating snapshot s_03b4b91b-a991-4437-812b-cfbaa69f2b0f. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] get snapshots for volume s_03b4b91b-a991-4437-812b-cfbaa69f2b0f  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_03b4b91b-a991-4437-812b-cfbaa69f2b0f/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_03b4b91b-a991-4437-812b-cfbaa69f2b0f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Geting {'code': 500, 'error': {'class': 'zfslib.zfsapi.resources.ZfsResourceError', 'errno': 1, 'message': 'Zfs resource: Pool-0/s_03b4b91b-a991-4437-812b-cfbaa69f2b0f not found in this collection.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_03b4b91b-a991-4437-812b-cfbaa69f2b0f/snapshots'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_03b4b91b-a991-4437-812b-cfbaa69f2b0f/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] physical volume s_03b4b91b-a991-4437-812b-cfbaa69f2b0f dne, it was already deleted. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:655}}
Apr 12 07:06:26 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Delete snapshot completed successfully.
Apr 12 07:06:26 user cinder-volume[73792]: DEBUG cinder.coordination [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Lock "cinder-03b4b91b-a991-4437-812b-cfbaa69f2b0f-delete_snapshot" released by "delete_snapshot" :: held 0.041s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:06:26 user cinder-volume[73792]: INFO cinder.volume.manager [None req-c35b843d-5582-496d-9422-4ed95dd5d97b tempest-VolumeRevertTests-2146992826 None] Volume 846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 reverted to snapshot b94a9c5d-6eae-40fa-9856-5139baa4a99a successfully.
Apr 12 07:06:27 user cinder-volume[73792]: INFO cinder.action_track [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] ACTION:'volume_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-2034569163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=69e03fea-32a5-470d-a228-eddab42324cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0801af91c1431cb18e729fbd79085b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=None,use_quota=True,user_id='b7cf224b5b314d02b54e24b5d9e792cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.flows.manager.create_volume [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73792) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Flow 'volume_create_manager' (6824d662-3b3d-4d54-9163-55223060b48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ccbd1a-708f-4c87-a804-a37343945a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ccbd1a-708f-4c87-a804-a37343945a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-2034569163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=69e03fea-32a5-470d-a228-eddab42324cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0801af91c1431cb18e729fbd79085b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-12T07:06:28Z,use_quota=True,user_id='b7cf224b5b314d02b54e24b5d9e792cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857)' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2e2111-9f3f-4f1c-80a6-13dd12b6da89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2e2111-9f3f-4f1c-80a6-13dd12b6da89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f51768-e9cc-4cff-9ea0-202eea151262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f51768-e9cc-4cff-9ea0-202eea151262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e03fea-32a5-470d-a228-eddab42324cc', 'volume_name': 'volume-69e03fea-32a5-470d-a228-eddab42324cc', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd02ebf5-ce28-4828-924b-ddeae916ac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd02ebf5-ce28-4828-924b-ddeae916ac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d0a57e-0be3-4443-85a7-9ee20245a9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:06:27 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Volume 69e03fea-32a5-470d-a228-eddab42324cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e03fea-32a5-470d-a228-eddab42324cc', 'volume_size': 1}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] creating volume v_69e03fea-32a5-470d-a228-eddab42324cc. {{(pid=73792) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] create volume {'name': 'v_69e03fea-32a5-470d-a228-eddab42324cc', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73792) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:27 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_69e03fea-32a5-470d-a228-eddab42324cc', 'is_clone': False, 'name': 'v_69e03fea-32a5-470d-a228-eddab42324cc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d0a57e-0be3-4443-85a7-9ee20245a9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e03fea-32a5-470d-a228-eddab42324cc', 'volume_size': 1}' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:06:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a079450-2da1-4f6c-afd1-2a3863108122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}}
Apr 12 07:06:28 user cinder-volume[73792]: INFO cinder.volume.flows.manager.create_volume [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Volume volume-69e03fea-32a5-470d-a228-eddab42324cc (69e03fea-32a5-470d-a228-eddab42324cc): created successfully
Apr 12 07:06:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a079450-2da1-4f6c-afd1-2a3863108122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73792) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}}
Apr 12 07:06:28 user cinder-volume[73792]: DEBUG cinder.volume.manager [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] Flow 'volume_create_manager' (6824d662-3b3d-4d54-9163-55223060b48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73792) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}}
Apr 12 07:06:28 user cinder-volume[73792]: INFO cinder.action_track [None req-7327ac3e-5ca3-488a-8e90-63e62bef82be tempest-VolumeRevertTests-2146992826 None] ACTION:'volume_create' MSG:'Created Volume successfully' FILE:/opt/stack/cinder/cinder/volume/manager.py:859:create_volume RSC:Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-2034569163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=69e03fea-32a5-470d-a228-eddab42324cc,launched_at=2023-04-12T07:06:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0801af91c1431cb18e729fbd79085b',provider_auth='CHAP RpUFcBLb jrUwa206BAxnDL',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:06:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='available',terminated_at=None,updated_at=2023-04-12T07:06:28Z,use_quota=True,user_id='b7cf224b5b314d02b54e24b5d9e792cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:06:28 user cinder-volume[73792]: INFO cinder.action_track [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] ACTION:'snapshot_create' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2023-04-12T07:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Snapshot-703971899',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=77e6d5d6-08df-49bd-92b5-47823b90a1fc,metadata={mykey1='value1'},progress='0%',project_id='dd0801af91c1431cb18e729fbd79085b',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,use_quota=True,user_id='b7cf224b5b314d02b54e24b5d9e792cc',volume=<?>,volume_id=69e03fea-32a5-470d-a228-eddab42324cc,volume_size=1,volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:06:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] create snapshot 77e6d5d6-08df-49bd-92b5-47823b90a1fc for volume 69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}}
Apr 12 07:06:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] cloning v_69e03fea-32a5-470d-a228-eddab42324cc to s_77e6d5d6-08df-49bd-92b5-47823b90a1fc {{(pid=73792) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}}
Apr 12 07:06:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] create snapshot s_77e6d5d6-08df-49bd-92b5-47823b90a1fc {{(pid=73792) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}}
Apr 12 07:06:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:28 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_77e6d5d6-08df-49bd-92b5-47823b90a1fc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] create volume s_77e6d5d6-08df-49bd-92b5-47823b90a1fc from snapshot s_77e6d5d6-08df-49bd-92b5-47823b90a1fc {{(pid=73792) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}}
Apr 12 07:06:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc/clone {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_69e03fea-32a5-470d-a228-eddab42324cc@s_77e6d5d6-08df-49bd-92b5-47823b90a1fc', 'is_clone': True, 'full_name': 'Pool-0/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc', 'name': 's_77e6d5d6-08df-49bd-92b5-47823b90a1fc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc/clone {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc/properties {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc/properties {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:29 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] volume s_77e6d5d6-08df-49bd-92b5-47823b90a1fc properties updated {{(pid=73792) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}}
Apr 12 07:06:29 user cinder-volume[73792]: INFO cinder.volume.manager [None req-f4843837-a901-491c-bca3-23023c75cd15 tempest-VolumeRevertTests-2146992826 None] Create snapshot completed successfully
Apr 12 07:06:30 user cinder-volume[73792]: INFO cinder.action_track [None req-a8630116-bbcc-4b39-bd31-69133f9aa7d4 tempest-VolumeRevertTests-2146992826 None] ACTION:'volume_extend' MSG:'called' FILE:/opt/stack/cinder/cinder/action_track.py:178:inner RSC:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-2034569163',ec2_id=None,encryption_key_id=None,glance_metadata={},group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=69e03fea-32a5-470d-a228-eddab42324cc,launched_at=2023-04-12T07:06:28Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='dd0801af91c1431cb18e729fbd79085b',provider_auth='CHAP RpUFcBLb jrUwa206BAxnDL',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:06:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='extending',terminated_at=None,updated_at=2023-04-12T07:06:28Z,use_quota=True,user_id='b7cf224b5b314d02b54e24b5d9e792cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) 
Apr 12 07:06:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8630116-bbcc-4b39-bd31-69133f9aa7d4 tempest-VolumeRevertTests-2146992826 None] Extend volume 69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}}
Apr 12 07:06:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8630116-bbcc-4b39-bd31-69133f9aa7d4 tempest-VolumeRevertTests-2146992826 None] jdss extend volume v_69e03fea-32a5-470d-a228-eddab42324cc to 2147483648 {{(pid=73792) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}}
Apr 12 07:06:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8630116-bbcc-4b39-bd31-69133f9aa7d4 tempest-VolumeRevertTests-2146992826 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8630116-bbcc-4b39-bd31-69133f9aa7d4 tempest-VolumeRevertTests-2146992826 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:30 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8630116-bbcc-4b39-bd31-69133f9aa7d4 tempest-VolumeRevertTests-2146992826 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:30 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a8630116-bbcc-4b39-bd31-69133f9aa7d4 tempest-VolumeRevertTests-2146992826 None] Extend volume completed successfully.
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.coordination [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Acquiring lock "cinder-77e6d5d6-08df-49bd-92b5-47823b90a1fc-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.coordination [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Lock "cinder-77e6d5d6-08df-49bd-92b5-47823b90a1fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] deleating snapshot s_77e6d5d6-08df-49bd-92b5-47823b90a1fc. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] get snapshots for volume s_77e6d5d6-08df-49bd-92b5-47823b90a1fc  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] get volume s_77e6d5d6-08df-49bd-92b5-47823b90a1fc info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_69e03fea-32a5-470d-a228-eddab42324cc@s_77e6d5d6-08df-49bd-92b5-47823b90a1fc', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284606', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61573', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7282535808908807332', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '119c5ab9baebe6e5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763665408', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '40224', 'name': 's_77e6d5d6-08df-49bd-92b5-47823b90a1fc', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] delete snapshot s_77e6d5d6-08df-49bd-92b5-47823b90a1fc of volume v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc/snapshots/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:31 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc/snapshots/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc/snapshots/s_77e6d5d6-08df-49bd-92b5-47823b90a1fc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:32 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] snapshot s_77e6d5d6-08df-49bd-92b5-47823b90a1fc deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 07:06:32 user cinder-volume[73792]: DEBUG cinder.quota [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Created reservations ['db77e875-f4bb-4832-bba9-7e4acc70cf68', '6a1ae12a-e4d0-48b1-9ea9-fac1de52b064', '2cc85c81-c1b5-4dbb-aad0-14b1a2e5f56e', 'ca6bd2c9-a431-4582-a0bd-1b602cf9f9c3'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:06:32 user cinder-volume[73792]: INFO cinder.volume.manager [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Delete snapshot completed successfully.
Apr 12 07:06:32 user cinder-volume[73792]: DEBUG cinder.coordination [None req-37b14360-6408-4f5a-b7c5-6471ec1f117e tempest-VolumeRevertTests-2146992826 None] Lock "cinder-77e6d5d6-08df-49bd-92b5-47823b90a1fc-delete_snapshot" released by "delete_snapshot" :: held 1.165s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Acquiring lock "cinder-69e03fea-32a5-470d-a228-eddab42324cc-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Lock "cinder-69e03fea-32a5-470d-a228-eddab42324cc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] remove_export for volume: 69e03fea-32a5-470d-a228-eddab42324cc. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-2034569163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=69e03fea-32a5-470d-a228-eddab42324cc,launched_at=2023-04-12T07:06:28Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='dd0801af91c1431cb18e729fbd79085b',provider_auth='CHAP RpUFcBLb jrUwa206BAxnDL',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:06:28Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T07:06:33Z,updated_at=2023-04-12T07:06:33Z,use_quota=True,user_id='b7cf224b5b314d02b54e24b5d9e792cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] detach volume v_69e03fea-32a5-470d-a228-eddab42324cc from target iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc/luns/v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc/luns/v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc/luns/v_69e03fea-32a5-470d-a228-eddab42324cc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc/luns/v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] failed to remove resource iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc because of JDSS resource v_69e03fea-32a5-470d-a228-eddab42324cc DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] delete target: iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] delete target iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] failed to remove resource iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc because of JDSS resource iqn.2010-10.org.openstack:69e03fea-32a5-470d-a228-eddab42324cc DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] deleating volume v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] get snapshots for volume v_69e03fea-32a5-470d-a228-eddab42324cc  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] get volume v_69e03fea-32a5-470d-a228-eddab42324cc info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_69e03fea-32a5-470d-a228-eddab42324cc', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284605', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61567', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7188273312723806539', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9f979bae0d1d32a6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763735040', 'san:volume_id': '9f979bae0d1d32a65b603b96b8f47f04dded0a89', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '40211', 'name': 'v_69e03fea-32a5-470d-a228-eddab42324cc', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] delete volume:v_69e03fea-32a5-470d-a228-eddab42324cc recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:33 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69e03fea-32a5-470d-a228-eddab42324cc {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] volume v_69e03fea-32a5-470d-a228-eddab42324cc deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 07:06:34 user cinder-volume[73792]: DEBUG cinder.quota [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Created reservations ['155dda87-a2cc-40d7-9c1a-cb2f776d842f', '120cf60f-294d-44a1-8fea-cbffc0246881', '6b9cfbe8-3adb-4884-8b36-f1cbc8a2b2ce', '34156c37-2175-499d-a425-f4ea26d6f715'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:06:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:06:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:06:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:34 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763816960', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.manager [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:06:35 user cinder-volume[73792]: INFO cinder.volume.manager [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Deleted volume successfully.
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.coordination [None req-1719c168-44f7-4545-aa41-b91411a87a4e tempest-VolumeRevertTests-2146992826 None] Lock "cinder-69e03fea-32a5-470d-a228-eddab42324cc-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Acquiring lock "cinder-b94a9c5d-6eae-40fa-9856-5139baa4a99a-delete_snapshot" by "delete_snapshot" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Lock "cinder-b94a9c5d-6eae-40fa-9856-5139baa4a99a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] deleating snapshot s_b94a9c5d-6eae-40fa-9856-5139baa4a99a. {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] get snapshots for volume s_b94a9c5d-6eae-40fa-9856-5139baa4a99a  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] get volume s_b94a9c5d-6eae-40fa-9856-5139baa4a99a info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6@s_b94a9c5d-6eae-40fa-9856-5139baa4a99a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284599', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61553', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14949145175367909749', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2143313a69b75394', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763816960', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '38746', 'name': 's_b94a9c5d-6eae-40fa-9856-5139baa4a99a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] delete snapshot s_b94a9c5d-6eae-40fa-9856-5139baa4a99a of volume v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:35 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots/s_b94a9c5d-6eae-40fa-9856-5139baa4a99a {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:36 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] snapshot s_b94a9c5d-6eae-40fa-9856-5139baa4a99a deleted {{(pid=73792) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}}
Apr 12 07:06:36 user cinder-volume[73792]: DEBUG cinder.quota [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Created reservations ['43391898-986b-4081-bcc7-316ef5f49cbf', 'a582dbbe-0086-4ae9-95ba-868f0e22acf8', '47d21917-3890-4034-8982-d3694a0fcead', 'ab71e6af-d7d0-4b65-b8f7-397bc90ed95c'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:06:36 user cinder-volume[73792]: INFO cinder.volume.manager [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Delete snapshot completed successfully.
Apr 12 07:06:36 user cinder-volume[73792]: DEBUG cinder.coordination [None req-3fcefe7d-f2cc-4114-bfd8-defce6b3bed0 tempest-VolumeRevertTests-2146992826 None] Lock "cinder-b94a9c5d-6eae-40fa-9856-5139baa4a99a-delete_snapshot" released by "delete_snapshot" :: held 1.250s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Acquiring lock "cinder-846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6-delete_volume" by "delete_volume" {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Lock "cinder-846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=54,cinder:INSERT=11,cinder:DELETE=2,cinder:UPDATE=33 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] remove_export for volume: 846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6. {{(pid=73792) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] remove export {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2023-04-12T07:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-631500073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='user@joviandss-2#joviandss-2',id=846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6,launched_at=2023-04-12T07:06:22Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0801af91c1431cb18e729fbd79085b',provider_auth='CHAP msHgSJXw fAxbHe5irKz4ca',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-12T07:06:21Z,service_uuid='6099adc0-5717-43d7-86fa-51bc65361470',shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='deleting',terminated_at=2023-04-12T07:06:38Z,updated_at=2023-04-12T07:06:38Z,use_quota=True,user_id='b7cf224b5b314d02b54e24b5d9e792cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0e0be60-6fb6-4d45-a78c-55d792af9857),volume_type_id=e0e0be60-6fb6-4d45-a78c-55d792af9857) from target:iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] detach volume v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 from target iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/luns/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/luns/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/luns/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/luns/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] failed to remove resource iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 because of JDSS resource v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] delete target: iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] delete target iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] failed to remove resource iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 because of JDSS resource iqn.2010-10.org.openstack:846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 DNE. {{(pid=73792) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] deleating volume v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] get snapshots for volume v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6  {{(pid=73792) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:37 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6/snapshots {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] get volume v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 info {{(pid=73792) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}}
Apr 12 07:06:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681284598', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '61547', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1724029298048149950', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3e2420cded36fb03', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114763816960', 'san:volume_id': '3e2420cded36fb0313f18a99db265bf083c194a3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '39167', 'name': 'v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] delete volume:v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 recursively children:{'force_umount': True} {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}}
Apr 12 07:06:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:38 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] volume v_846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6 deleted {{(pid=73792) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}}
Apr 12 07:06:39 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=63,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=3 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}
Apr 12 07:06:39 user cinder-volume[73792]: DEBUG cinder.quota [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Created reservations ['8547ad5b-c496-4ebb-b4cd-333754996313', '617c951f-b4ed-4ac6-8aaa-4f9b85cd3c93', '5953fba5-5621-4473-a1f4-ea8e197cb5cd', '8634a854-b399-46e7-9e4c-e344b9a12ed7'] {{(pid=73792) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 12 07:06:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Updating volume stats {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}}
Apr 12 07:06:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Get pool Pool-0 fsprops {{(pid=73792) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}}
Apr 12 07:06:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}}
Apr 12 07:06:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}}
Apr 12 07:06:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Geting {'code': 200, 'error': None, 'data': {'available': '114763923456', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73792) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}}
Apr 12 07:06:39 user cinder-volume[73792]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Total capacity: 119, Free 106. {{(pid=73792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}}
Apr 12 07:06:39 user cinder-volume[73792]: DEBUG cinder.manager [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Notifying Schedulers of capabilities ... {{(pid=73792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 12 07:06:39 user cinder-volume[73792]: INFO cinder.volume.manager [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Deleted volume successfully.
Apr 12 07:06:39 user cinder-volume[73792]: DEBUG cinder.coordination [None req-a1f5b0e7-4163-460b-a6cc-1d9a902fd82f tempest-VolumeRevertTests-2146992826 None] Lock "cinder-846b5cea-6c5b-4106-bfc9-f7b05b5ab5b6-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=73792) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Apr 12 07:06:51 user cinder-volume[73792]: DEBUG dbcounter [-] [73792] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=73792) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}