Institutional Repository
| optimization of data services in high performance grid workflow | |
| Ma Qiang; Sun Junyi; Li Houfu | |
| 2011 | |
| Source | Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition)
 |
| ISSN | 1671-4512 |
| Volume | 39Issue:UPPL. 1Pages:15-18 |
| English Abstract | To meet the need of bio-computing, such as high concurrency and large data processing, the data services in CNGrid workflow has to be optimized. According to the experiments, the open-source RDBMS (relational database mangement system) used in original architecture was not well adapted to high concurrent requests and large data processing, and has become the bottleneck of performance. In view of this, we analyzed the actual need of data services in grid workflow, from functionality and performance perspectives, and propose a new data service component: TreapDB, which uses mmap and append only log-data file to reduce the I/O waiting time, and meet the business needs of process data querying. Experiments show that, after the optimization of data services, the overall performance of CNGrid workflow increase greatly, and it has been applied successfully in CNGrid bio-community.; To meet the need of bio-computing, such as high concurrency and large data processing, the data services in CNGrid workflow has to be optimized. According to the experiments, the open-source RDBMS (relational database mangement system) used in original architecture was not well adapted to high concurrent requests and large data processing, and has become the bottleneck of performance. In view of this, we analyzed the actual need of data services in grid workflow, from functionality and performance perspectives, and propose a new data service component: TreapDB, which uses mmap and append only log-data file to reduce the I/O waiting time, and meet the business needs of process data querying. Experiments show that, after the optimization of data services, the overall performance of CNGrid workflow increase greatly, and it has been applied successfully in CNGrid bio-community. |
| Indexed Type | EI |
| Keyword | Experiments Microcellular Radio Systems Optimization |
| Department | (1) Research Laboratory of Software Integration and Service Computing Institute of Computing Technology Chinese Acad. of Sci. Beijing 100190 China; (2) Graduate University of Chinese Acad. of Sci. Beijing 100190 China |
| Language | 中文 |
| Content Type | 期刊论文 |
| URI | http://ir.iscas.ac.cn/handle/311060/16167 |
| Collection | 中国科学院软件研究所 |
| Recommended Citation GB/T 7714 | Ma Qiang,Sun Junyi,Li Houfu. optimization of data services in high performance grid workflow[J]. Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition),2011,39(UPPL. 1):15-18. |
| APA | Ma Qiang,Sun Junyi,&Li Houfu.(2011).optimization of data services in high performance grid workflow.Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition),39(UPPL. 1),15-18. |
| MLA | Ma Qiang,et al."optimization of data services in high performance grid workflow".Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition) 39.UPPL. 1(2011):15-18. |
| Files in This Item: | There are no files associated with this item. | |||||
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment