Effective metadata cluster management for mass data storage

ISCAS OpenIR

	Effective metadata cluster management for mass data storage
	Ningjiang, Chen; Zhongzheng, Xiao; Wenbo, Zhang
	2014
Source	International Journal of Database Theory and Application
ISSN	20054270
Volume	7 Issue:3 Pages:1-12
English Abstract	An effective decentralized metadata management schema is critical to a reliable and scal-able large-scale distributed storage system. With regard to the defects of huge expansion cost and high sensitivity to cluster alteration borne in both the hash-based and subtree-based metadata management schemas, a metadata server (MDS) clustering schema based on con-sistent hash structure, named DSVL, is proposed. By introducing virtual MDS into the con-sistent MDS cluster, it can effectively balance MDS cluster load. Besides, the standby mecha-nism and the lazy update policy are merged and applied to the MDS cluster to accomplish rapid MDS failover as well as zero data migration in case of cluster alteration. The results of prototype system and simulation test prove that DSVL, with the features of balanced metadata distribution, rapid failover, flexible scalability and zero data migration amount in case of node alteration, can meet the demands for flexible and effective management of large-scale data storage systems with ever increasing data amount. © 2014 SERSC. ; An effective decentralized metadata management schema is critical to a reliable and scal-able large-scale distributed storage system. With regard to the defects of huge expansion cost and high sensitivity to cluster alteration borne in both the hash-based and subtree-based metadata management schemas, a metadata server (MDS) clustering schema based on con-sistent hash structure, named DSVL, is proposed. By introducing virtual MDS into the con-sistent MDS cluster, it can effectively balance MDS cluster load. Besides, the standby mecha-nism and the lazy update policy are merged and applied to the MDS cluster to accomplish rapid MDS failover as well as zero data migration in case of cluster alteration. The results of prototype system and simulation test prove that DSVL, with the features of balanced metadata distribution, rapid failover, flexible scalability and zero data migration amount in case of node alteration, can meet the demands for flexible and effective management of large-scale data storage systems with ever increasing data amount. © 2014 SERSC.
Indexed Type	EI
Department	(1) College of Computer Science and Electronic Information, Guangxi University, Nan-ning, 530004, China; (2) Technology Center of Software Engineering, Institute of Software, Chinese Academy of Sciences, Beijing, 100190, China
Language	英语
Content Type	期刊论文
Version	出版稿
URI	http://ir.iscas.ac.cn/handle/311060/17017
Collection	中国科学院软件研究所
Recommended Citation GB/T 7714	Ningjiang, Chen,Zhongzheng, Xiao,Wenbo, Zhang. Effective metadata cluster management for mass data storage[J]. International Journal of Database Theory and Application,2014,7(3):1-12.
APA	Ningjiang, Chen,Zhongzheng, Xiao,&Wenbo, Zhang.(2014).Effective metadata cluster management for mass data storage.International Journal of Database Theory and Application,7(3),1-12.
MLA	Ningjiang, Chen,et al."Effective metadata cluster management for mass data storage".International Journal of Database Theory and Application 7.3(2014):1-12.

Files in This Item:
There are no files associated with this item.

If you have any objections to this item, please fill out the form below and the administrator will contact you as soon as possible.
Content:
Email：	*
Institution:
Verification Code:	Refresh

Any comments and suggestions are welcomed.
Title:	*
Content:
Email：	*
Verification Code:	Refresh

中国科学院软件研究所机构知识库