中国科学院软件研究所机构知识库
Advanced  
ISCAS OpenIR  > 软件所图书馆  > 会议论文
Title:
A distributed cache framework for metadata service of distributed file systems
Author: Sun, Yao (1) ; Liu, Jie (2) ; Ye, Dan (2) ; Zhong, Hua (2)
Conference Name: 2013 19th IEEE International Conference on Parallel and Distributed Systems, ICPADS 2013
Conference Date: December 15, 2013 - December 18, 2013
Issued Date: 2013
Conference Place: Seoul, Korea, Republic of
Publish Place: IEEE Computer Society
Indexed Type: EI
ISSN: 15219097
ISBN: 9781479920815
Department: (1) University of Chinese Academy of Sciences, Beijing, China; (2) Institute of Software, Chinese Academy of Sciences, Beijing, China
Abstract: Most recent distributed file systems have adopted architecture with an independent metadata server cluster. However, potential multiple hotspots and flash crowds access patterns often cause a metadata service that violates performance Service Level Objectives. To maximize the throughput of the metadata service, an adaptive request load balancing framework is critical. We present a distributed cache framework above the distributed metadata management schemes to manage hotspots rather than managing all metadata to achieve request load balancing. This benefits the metadata hierarchical locality and the system scalability. Compared with data, metadata has its own distinct characteristics, such as small size and large quantity. The cost of useless metadata prefetching is much less than data prefetching. In light of this, we devise a time period-based prefetching strategy and a perfecting-based adaptive replacement cache algorithm to improve the performance of the distributed caching layer to adapt constantly changing workloads. Finally, we evaluate our approach with a hadoop distributed file system cluster. © 2013 IEEE.
English Abstract: Most recent distributed file systems have adopted architecture with an independent metadata server cluster. However, potential multiple hotspots and flash crowds access patterns often cause a metadata service that violates performance Service Level Objectives. To maximize the throughput of the metadata service, an adaptive request load balancing framework is critical. We present a distributed cache framework above the distributed metadata management schemes to manage hotspots rather than managing all metadata to achieve request load balancing. This benefits the metadata hierarchical locality and the system scalability. Compared with data, metadata has its own distinct characteristics, such as small size and large quantity. The cost of useless metadata prefetching is much less than data prefetching. In light of this, we devise a time period-based prefetching strategy and a perfecting-based adaptive replacement cache algorithm to improve the performance of the distributed caching layer to adapt constantly changing workloads. Finally, we evaluate our approach with a hadoop distributed file system cluster. © 2013 IEEE.
Language: 英语
Content Type: 会议论文
URI: http://ir.iscas.ac.cn/handle/311060/16686
Appears in Collections:软件所图书馆_会议论文

Files in This Item:

There are no files associated with this item.


Recommended Citation:
Sun, Yao ,Liu, Jie ,Ye, Dan ,et al. A distributed cache framework for metadata service of distributed file systems[C]. 见:2013 19th IEEE International Conference on Parallel and Distributed Systems, ICPADS 2013. Seoul, Korea, Republic of. December 15, 2013 - December 18, 2013.
Service
Recommend this item
Sava as my favorate item
Show this item's statistics
Export Endnote File
Google Scholar
Similar articles in Google Scholar
[Sun, Yao (1)]'s Articles
[Liu, Jie (2)]'s Articles
[Ye, Dan (2)]'s Articles
CSDL cross search
Similar articles in CSDL Cross Search
[Sun, Yao (1)]‘s Articles
[Liu, Jie (2)]‘s Articles
[Ye, Dan (2)]‘s Articles
Related Copyright Policies
Null
Social Bookmarking
Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit
所有评论 (0)
暂无评论
 
评注功能仅针对注册用户开放,请您登录
您对该条目有什么异议,请填写以下表单,管理员会尽快联系您。
内 容:
Email:  *
单位:
验证码:   刷新
您在IR的使用过程中有什么好的想法或者建议可以反馈给我们。
标 题:
 *
内 容:
Email:  *
验证码:   刷新

Items in IR are protected by copyright, with all rights reserved, unless otherwise indicated.

 

 

Valid XHTML 1.0!
Copyright © 2007-2019  中国科学院软件研究所 - Feedback
Powered by CSpace