optimization of data services in high performance grid workflow

ISCAS OpenIR

	optimization of data services in high performance grid workflow
	Ma Qiang; Sun Junyi; Li Houfu
	2011
发表期刊	Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition)
ISSN	1671-4512
卷号	39 期号:UPPL. 1 页码:15-18
摘要	To meet the need of bio-computing, such as high concurrency and large data processing, the data services in CNGrid workflow has to be optimized. According to the experiments, the open-source RDBMS (relational database mangement system) used in original architecture was not well adapted to high concurrent requests and large data processing, and has become the bottleneck of performance. In view of this, we analyzed the actual need of data services in grid workflow, from functionality and performance perspectives, and propose a new data service component: TreapDB, which uses mmap and append only log-data file to reduce the I/O waiting time, and meet the business needs of process data querying. Experiments show that, after the optimization of data services, the overall performance of CNGrid workflow increase greatly, and it has been applied successfully in CNGrid bio-community.; To meet the need of bio-computing, such as high concurrency and large data processing, the data services in CNGrid workflow has to be optimized. According to the experiments, the open-source RDBMS (relational database mangement system) used in original architecture was not well adapted to high concurrent requests and large data processing, and has become the bottleneck of performance. In view of this, we analyzed the actual need of data services in grid workflow, from functionality and performance perspectives, and propose a new data service component: TreapDB, which uses mmap and append only log-data file to reduce the I/O waiting time, and meet the business needs of process data querying. Experiments show that, after the optimization of data services, the overall performance of CNGrid workflow increase greatly, and it has been applied successfully in CNGrid bio-community.
收录类别	EI
关键词	Experiments Microcellular Radio Systems Optimization
部门归属	(1) Research Laboratory of Software Integration and Service Computing Institute of Computing Technology Chinese Acad. of Sci. Beijing 100190 China; (2) Graduate University of Chinese Acad. of Sci. Beijing 100190 China
语种	中文
内容类型	期刊论文
URI标识	http://ir.iscas.ac.cn/handle/311060/16167
专题	中国科学院软件研究所
推荐引用方式 GB/T 7714	Ma Qiang,Sun Junyi,Li Houfu. optimization of data services in high performance grid workflow[J]. Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition),2011,39(UPPL. 1):15-18.
APA	Ma Qiang,Sun Junyi,&Li Houfu.(2011).optimization of data services in high performance grid workflow.Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition),39(UPPL. 1),15-18.
MLA	Ma Qiang,et al."optimization of data services in high performance grid workflow".Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition) 39.UPPL. 1(2011):15-18.