ISCAS OpenIR
FlowS:一种MapReduce数据流公平调度方法
Alternative Titleflows:a fair scheduling method for mapreduce dataflow
李奇原; 刘杰; 叶丹; 许舒人
2012
Source计算机科学
ISSN1002-137X
Volume39Issue:9Pages:157-161,174
English AbstractMapReduce Job的调度机制一直是学术研究的热点。在分析MapReduce数据流调度模型的基础上,提出一种面向MapReduce数据流的公平调度方法FlowS。该方法采用数据流池来分配资源以保证MapReduce数据流的隔离性,并且采用数据流池动态构建算法来确保资源的公平分配。实验表明,该调度方法可以有效提高Hadoop集群对MapReduce数据流的处理效率。
Indexed TypeCNKI ; WANFANG ; CSCD
AbstractMapReduce Job scheduling has been paid great attention in academic research.Based on the analysis of MapReduce dataflow scheduling model,this paper presented a fair scheduling method for MapReduce dataflow-FlowS.This method can not only provide the isolation of MapReduce dataflow through dataflow pools,but also assure the fairness of resource allocation through dynamic construction algorithm.The results of experiences show that the proposed method can improve the processing efficiency of Hadoop Clusters.
KeywordMapreduce数据流 资源管理 公平调度方法
Department中国科学院软件研究所软件工程技术中心;中国科学院研究生院;
SubjectComputer Science (Provided By Thomson Reuters)
Sponsorship国家自然科学基金项目(61170074)|国家科技重大核高基项目(2010ZX01042-001-001-05)|国家科技支撑计划(2011BAH15B05,2012BAH05F02)资助
Language中文
CSCD IDCSCD:4628165
Content Type期刊论文
URIhttp://ir.iscas.ac.cn/handle/311060/14960
Collection中国科学院软件研究所
Recommended Citation
GB/T 7714
李奇原,刘杰,叶丹,等. FlowS:一种MapReduce数据流公平调度方法[J]. 计算机科学,2012,39(9):157-161,174.
APA 李奇原,刘杰,叶丹,&许舒人.(2012).FlowS:一种MapReduce数据流公平调度方法.计算机科学,39(9),157-161,174.
MLA 李奇原,et al."FlowS:一种MapReduce数据流公平调度方法".计算机科学 39.9(2012):157-161,174.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[李奇原]'s Articles
[刘杰]'s Articles
[叶丹]'s Articles
Baidu academic
Similar articles in Baidu academic
[李奇原]'s Articles
[刘杰]'s Articles
[叶丹]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[李奇原]'s Articles
[刘杰]'s Articles
[叶丹]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.