Clustering-based acceleration for virtual machine image deduplication in the cloud environment

ISCAS OpenIR

	Clustering-based acceleration for virtual machine image deduplication in the cloud environment
	Xu, JW; Zhang, WB; Zhang, ZY; Wang, T; Huang, T
	2016
发表期刊	JOURNAL OF SYSTEMS AND SOFTWARE
ISSN	0164-1212
卷号	121 页码:144-156
摘要	More and more virtual machine (VM) images are continuously created in datacenters. Duplicated data segments may exist in such VM images, and it leads to a waste of storage resource. As a result, VM image deduplication is a common daily activity in datacenters. Our previous work Crab is such a product and it is on duty regularly in our datacenter. The size of VM images is large and the amount of VM images is huge, and it is inefficient and impractical to load massive VM image fingerprints into memory for a fast comparison to recognize duplicated segments. To address this issue, we in this paper propose a clustering-based acceleration method. It uses an improved k-means clustering to find images having high chances to contain duplicated segments. With such a candidate selection phase, only limited VM image candidate fingerprints are loaded into memory. We empirically evaluate the effectiveness, robustness, and complexity of the proposed system. Experimental results show that it significantly reduces the performance interference to hosting virtual machine with an acceptable increase in disk space usage, compared with existing deduplication methods. (C) 2016 Elsevier Inc. All rights reserved.; More and more virtual machine (VM) images are continuously created in datacenters. Duplicated data segments may exist in such VM images, and it leads to a waste of storage resource. As a result, VM image deduplication is a common daily activity in datacenters. Our previous work Crab is such a product and it is on duty regularly in our datacenter. The size of VM images is large and the amount of VM images is huge, and it is inefficient and impractical to load massive VM image fingerprints into memory for a fast comparison to recognize duplicated segments. To address this issue, we in this paper propose a clustering-based acceleration method. It uses an improved k-means clustering to find images having high chances to contain duplicated segments. With such a candidate selection phase, only limited VM image candidate fingerprints are loaded into memory. We empirically evaluate the effectiveness, robustness, and complexity of the proposed system. Experimental results show that it significantly reduces the performance interference to hosting virtual machine with an acceptable increase in disk space usage, compared with existing deduplication methods. (C) 2016 Elsevier Inc. All rights reserved.
收录类别	SCI
关键词	Cloud Computing Virtualization Vm Image Deduplication
部门归属	Chinese Acad Sci, Inst Software, Beijing 100190, Peoples R China. State Key Lab Comp Sci, Beijing 100190, Peoples R China. Univ Chinese Acad Sci, Beijing 100190, Peoples R China.
语种	英语
WOS记录号	WOS:000384864500011
引用统计	被引频次：17[WOS] [WOS记录] [WOS相关记录]
内容类型	期刊论文
URI标识	http://ir.iscas.ac.cn/handle/311060/17293
专题	中国科学院软件研究所
推荐引用方式 GB/T 7714	Xu, JW,Zhang, WB,Zhang, ZY,et al. Clustering-based acceleration for virtual machine image deduplication in the cloud environment[J]. JOURNAL OF SYSTEMS AND SOFTWARE,2016,121:144-156.
APA	Xu, JW,Zhang, WB,Zhang, ZY,Wang, T,&Huang, T.(2016).Clustering-based acceleration for virtual machine image deduplication in the cloud environment.JOURNAL OF SYSTEMS AND SOFTWARE,121,144-156.
MLA	Xu, JW,et al."Clustering-based acceleration for virtual machine image deduplication in the cloud environment".JOURNAL OF SYSTEMS AND SOFTWARE 121(2016):144-156.

条目包含的文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
1-s2.0-S016412121600（1183KB）			开放获取	使用许可	请求全文