ISCAS OpenIR
Effective metadata cluster management for mass data storage
Ningjiang, Chen; Zhongzheng, Xiao; Wenbo, Zhang
2014
SourceInternational Journal of Database Theory and Application
ISSN20054270
Volume7Issue:3Pages:1-12
English Abstract

An effective decentralized metadata management schema is critical to a reliable and scal-able large-scale distributed storage system. With regard to the defects of huge expansion cost and high sensitivity to cluster alteration borne in both the hash-based and subtree-based metadata management schemas, a metadata server (MDS) clustering schema based on con-sistent hash structure, named DSVL, is proposed. By introducing virtual MDS into the con-sistent MDS cluster, it can effectively balance MDS cluster load. Besides, the standby mecha-nism and the lazy update policy are merged and applied to the MDS cluster to accomplish rapid MDS failover as well as zero data migration in case of cluster alteration. The results of prototype system and simulation test prove that DSVL, with the features of balanced metadata distribution, rapid failover, flexible scalability and zero data migration amount in case of node alteration, can meet the demands for flexible and effective management of large-scale data storage systems with ever increasing data amount. © 2014 SERSC.

;

An effective decentralized metadata management schema is critical to a reliable and scal-able large-scale distributed storage system. With regard to the defects of huge expansion cost and high sensitivity to cluster alteration borne in both the hash-based and subtree-based metadata management schemas, a metadata server (MDS) clustering schema based on con-sistent hash structure, named DSVL, is proposed. By introducing virtual MDS into the con-sistent MDS cluster, it can effectively balance MDS cluster load. Besides, the standby mecha-nism and the lazy update policy are merged and applied to the MDS cluster to accomplish rapid MDS failover as well as zero data migration in case of cluster alteration. The results of prototype system and simulation test prove that DSVL, with the features of balanced metadata distribution, rapid failover, flexible scalability and zero data migration amount in case of node alteration, can meet the demands for flexible and effective management of large-scale data storage systems with ever increasing data amount. © 2014 SERSC.

Indexed TypeEI
Department(1) College of Computer Science and Electronic Information, Guangxi University, Nan-ning, 530004, China; (2) Technology Center of Software Engineering, Institute of Software, Chinese Academy of Sciences, Beijing, 100190, China
Language英语
Content Type期刊论文
Version出版稿
URIhttp://ir.iscas.ac.cn/handle/311060/17017
Collection中国科学院软件研究所
Recommended Citation
GB/T 7714
Ningjiang, Chen,Zhongzheng, Xiao,Wenbo, Zhang. Effective metadata cluster management for mass data storage[J]. International Journal of Database Theory and Application,2014,7(3):1-12.
APA Ningjiang, Chen,Zhongzheng, Xiao,&Wenbo, Zhang.(2014).Effective metadata cluster management for mass data storage.International Journal of Database Theory and Application,7(3),1-12.
MLA Ningjiang, Chen,et al."Effective metadata cluster management for mass data storage".International Journal of Database Theory and Application 7.3(2014):1-12.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Ningjiang, Chen]'s Articles
[Zhongzheng, Xiao]'s Articles
[Wenbo, Zhang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Ningjiang, Chen]'s Articles
[Zhongzheng, Xiao]'s Articles
[Wenbo, Zhang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Ningjiang, Chen]'s Articles
[Zhongzheng, Xiao]'s Articles
[Wenbo, Zhang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.