a fast and high throughput sql query system for big data

ISCAS OpenIR

	a fast and high throughput sql query system for big data
	Zhu Feng; Liu Jie; Xu Lijie
	2012
会议名称	13th International Conference on Web Information Systems Engineering, WISE 2012
会议录名称	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
页码	783-788
会议日期	November 28, 2012 - November 30, 2012
会议地点	Paphos, Cyprus
收录类别	EI
ISSN	0302-9743
ISBN	9783642350627
部门归属	(1) Technology Center of Software Engineering Institute of Software Chinese Academy of Sciences Beijing 100190 China
摘要	Relational data query always plays an important role in data analysis. But how to scale out the traditional SQL query system is a challenging problem. In this paper, we introduce a fast, high throughput and scalable system to perform read-only SQL well with the advantage of NoSQL's distributed architecture. We adopt HBase as the storage layer and design a distributed query engine (DQE) collaborating with it to perform SQL queries. Our system also contains distinctive index and cache mechanisms to accelerate query processing. Finally, we evaluate our system with real-world big data crawled from Sina Weibo and it achieves good performance under nineteen representative SQL queries. © 2012 Springer-Verlag.; Relational data query always plays an important role in data analysis. But how to scale out the traditional SQL query system is a challenging problem. In this paper, we introduce a fast, high throughput and scalable system to perform read-only SQL well with the advantage of NoSQL's distributed architecture. We adopt HBase as the storage layer and design a distributed query engine (DQE) collaborating with it to perform SQL queries. Our system also contains distinctive index and cache mechanisms to accelerate query processing. Finally, we evaluate our system with real-world big data crawled from Sina Weibo and it achieves good performance under nineteen representative SQL queries. © 2012 Springer-Verlag.
关键词	Digital Storage Query Languages Query Processing Systems Engineering Throughput World Wide Web
语种	英语
内容类型	会议论文
URI标识	http://ir.iscas.ac.cn/handle/311060/15889
专题	中国科学院软件研究所
推荐引用方式 GB/T 7714	Zhu Feng,Liu Jie,Xu Lijie. a fast and high throughput sql query system for big data[C],2012:783-788.