Effective metadata cluster management for mass data storage

ISCAS OpenIR

	Effective metadata cluster management for mass data storage
	Ningjiang, Chen; Zhongzheng, Xiao; Wenbo, Zhang
	2014
发表期刊	International Journal of Database Theory and Application
ISSN	20054270
卷号	7 期号:3 页码:1-12
摘要	An effective decentralized metadata management schema is critical to a reliable and scal-able large-scale distributed storage system. With regard to the defects of huge expansion cost and high sensitivity to cluster alteration borne in both the hash-based and subtree-based metadata management schemas, a metadata server (MDS) clustering schema based on con-sistent hash structure, named DSVL, is proposed. By introducing virtual MDS into the con-sistent MDS cluster, it can effectively balance MDS cluster load. Besides, the standby mecha-nism and the lazy update policy are merged and applied to the MDS cluster to accomplish rapid MDS failover as well as zero data migration in case of cluster alteration. The results of prototype system and simulation test prove that DSVL, with the features of balanced metadata distribution, rapid failover, flexible scalability and zero data migration amount in case of node alteration, can meet the demands for flexible and effective management of large-scale data storage systems with ever increasing data amount. © 2014 SERSC. ; An effective decentralized metadata management schema is critical to a reliable and scal-able large-scale distributed storage system. With regard to the defects of huge expansion cost and high sensitivity to cluster alteration borne in both the hash-based and subtree-based metadata management schemas, a metadata server (MDS) clustering schema based on con-sistent hash structure, named DSVL, is proposed. By introducing virtual MDS into the con-sistent MDS cluster, it can effectively balance MDS cluster load. Besides, the standby mecha-nism and the lazy update policy are merged and applied to the MDS cluster to accomplish rapid MDS failover as well as zero data migration in case of cluster alteration. The results of prototype system and simulation test prove that DSVL, with the features of balanced metadata distribution, rapid failover, flexible scalability and zero data migration amount in case of node alteration, can meet the demands for flexible and effective management of large-scale data storage systems with ever increasing data amount. © 2014 SERSC.
收录类别	EI
部门归属	(1) College of Computer Science and Electronic Information, Guangxi University, Nan-ning, 530004, China; (2) Technology Center of Software Engineering, Institute of Software, Chinese Academy of Sciences, Beijing, 100190, China
语种	英语
内容类型	期刊论文
版本	出版稿
URI标识	http://ir.iscas.ac.cn/handle/311060/17017
专题	中国科学院软件研究所
推荐引用方式 GB/T 7714	Ningjiang, Chen,Zhongzheng, Xiao,Wenbo, Zhang. Effective metadata cluster management for mass data storage[J]. International Journal of Database Theory and Application,2014,7(3):1-12.
APA	Ningjiang, Chen,Zhongzheng, Xiao,&Wenbo, Zhang.(2014).Effective metadata cluster management for mass data storage.International Journal of Database Theory and Application,7(3),1-12.
MLA	Ningjiang, Chen,et al."Effective metadata cluster management for mass data storage".International Journal of Database Theory and Application 7.3(2014):1-12.