中国科学院软件研究所机构知识库
Advanced  
ISCAS OpenIR  > 软件所图书馆  > 期刊论文
Title:
基于组件的大数据分析服务平台
Alternative Title: Module Based Big Data Analysis Platform
Author: 赵薇 ; 刘杰 ; 叶丹
Keyword: 大数据 ; 数据分析 ; 数据挖掘 ; 组件 ; 分布式 ; 服务 ; 平台 ; Big data ; Data analysis ; Data mining ; Module ; Distributed ; Service ; Platform
Source: 计算机科学
Issued Date: 2014
Volume: 41, Issue:9, Pages:75-79
Indexed Type: CSCD
Department: 中国科学院大学 北京 100190;中国科学院软件研究所 北京 100190 中国科学院软件研究所 北京 100190
Abstract: 随着数据规模的快速增长,单机的数据分析工具已经无法满足需求.针对大数据的分析问题,设计并实现了一种基于组件的大数据分析服务平台Haflow.Haflow自定义了业务流程模型和可扩展的组件接口,组件接口支持各种异构工具的集成.系统接收用户定义的业务流程,将其翻译成执行流程实例,提交到Hadoop分布式集群上执行.Haflow是一个可扩展的、分布式的、支持异构分析工具的、面向服务的大数据分析服务平台.提出该平台有两重意义:一方面平台将与数据分析业务无关的工作封装起来,支持各种异构组件,以加快分析应用的开发速度;另一方面,平台后端使用Hadoop分布式系统来实现多任务的并发,从而提高应用的平均执行速度.
English Abstract: As the expansion of data size,the data analysis tools that run only on stand-alone computers are no longer sufficient.We designed and implemented a module based big data analysis platform named Haflow to solve this problem.In Haflow,we defined an analysis business model and an extensible module interface,which supports integration of heterogeneous tools.Users submit their analysis flows,and system will interpret them,and then commit to the Hadoop.Haflow is an extensible,distributed,heterogeneous supported,service oriented big data platform.The goal of the platform is twofold.First,it provides an platform that encapsulates the dummy jobs that have nothing to do with the business itself,improving the development speed of analysis applications.Second,by submitting jobs to Hadoop which can execute jobs concurrently,the platform decreases the mean time of the analysis applications.
Language: 中文
Citation statistics:
Content Type: 期刊论文
URI: http://ir.iscas.ac.cn/handle/311060/16713
Appears in Collections:软件所图书馆_期刊论文

Files in This Item:

There are no files associated with this item.


Recommended Citation:
赵薇,刘杰,叶丹. 基于组件的大数据分析服务平台[J]. 计算机科学,2014-01-01,41(9):75-79.
Service
Recommend this item
Sava as my favorate item
Show this item's statistics
Export Endnote File
Google Scholar
Similar articles in Google Scholar
[赵薇]'s Articles
[刘杰]'s Articles
[叶丹]'s Articles
CSDL cross search
Similar articles in CSDL Cross Search
[赵薇]‘s Articles
[刘杰]‘s Articles
[叶丹]‘s Articles
Related Copyright Policies
Null
Social Bookmarking
Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit
所有评论 (0)
暂无评论
 
评注功能仅针对注册用户开放,请您登录
您对该条目有什么异议,请填写以下表单,管理员会尽快联系您。
内 容:
Email:  *
单位:
验证码:   刷新
您在IR的使用过程中有什么好的想法或者建议可以反馈给我们。
标 题:
 *
内 容:
Email:  *
验证码:   刷新

Items in IR are protected by copyright, with all rights reserved, unless otherwise indicated.

 

 

Valid XHTML 1.0!
Copyright © 2007-2019  中国科学院软件研究所 - Feedback
Powered by CSpace