Institutional Repository
| Clustering-based acceleration for virtual machine image deduplication in the cloud environment | |
| Xu, JW; Zhang, WB; Zhang, ZY; Wang, T; Huang, T | |
| 2016 | |
| Source | JOURNAL OF SYSTEMS AND SOFTWARE
 |
| ISSN | 0164-1212 |
| Volume | 121Pages:144-156 |
| English Abstract | More and more virtual machine (VM) images are continuously created in datacenters. Duplicated data segments may exist in such VM images, and it leads to a waste of storage resource. As a result, VM image deduplication is a common daily activity in datacenters. Our previous work Crab is such a product and it is on duty regularly in our datacenter. The size of VM images is large and the amount of VM images is huge, and it is inefficient and impractical to load massive VM image fingerprints into memory for a fast comparison to recognize duplicated segments. To address this issue, we in this paper propose a clustering-based acceleration method. It uses an improved k-means clustering to find images having high chances to contain duplicated segments. With such a candidate selection phase, only limited VM image candidate fingerprints are loaded into memory. We empirically evaluate the effectiveness, robustness, and complexity of the proposed system. Experimental results show that it significantly reduces the performance interference to hosting virtual machine with an acceptable increase in disk space usage, compared with existing deduplication methods. (C) 2016 Elsevier Inc. All rights reserved.; More and more virtual machine (VM) images are continuously created in datacenters. Duplicated data segments may exist in such VM images, and it leads to a waste of storage resource. As a result, VM image deduplication is a common daily activity in datacenters. Our previous work Crab is such a product and it is on duty regularly in our datacenter. The size of VM images is large and the amount of VM images is huge, and it is inefficient and impractical to load massive VM image fingerprints into memory for a fast comparison to recognize duplicated segments. To address this issue, we in this paper propose a clustering-based acceleration method. It uses an improved k-means clustering to find images having high chances to contain duplicated segments. With such a candidate selection phase, only limited VM image candidate fingerprints are loaded into memory. We empirically evaluate the effectiveness, robustness, and complexity of the proposed system. Experimental results show that it significantly reduces the performance interference to hosting virtual machine with an acceptable increase in disk space usage, compared with existing deduplication methods. (C) 2016 Elsevier Inc. All rights reserved. |
| Indexed Type | SCI |
| Keyword | Cloud Computing Virtualization Vm Image Deduplication |
| Department | Chinese Acad Sci, Inst Software, Beijing 100190, Peoples R China. State Key Lab Comp Sci, Beijing 100190, Peoples R China. Univ Chinese Acad Sci, Beijing 100190, Peoples R China. |
| Language | 英语 |
| WOS ID | WOS:000384864500011 |
| Citation statistics | |
| Content Type | 期刊论文 |
| URI | http://ir.iscas.ac.cn/handle/311060/17293 |
| Collection | 中国科学院软件研究所 |
| Recommended Citation GB/T 7714 | Xu, JW,Zhang, WB,Zhang, ZY,et al. Clustering-based acceleration for virtual machine image deduplication in the cloud environment[J]. JOURNAL OF SYSTEMS AND SOFTWARE,2016,121:144-156. |
| APA | Xu, JW,Zhang, WB,Zhang, ZY,Wang, T,&Huang, T.(2016).Clustering-based acceleration for virtual machine image deduplication in the cloud environment.JOURNAL OF SYSTEMS AND SOFTWARE,121,144-156. |
| MLA | Xu, JW,et al."Clustering-based acceleration for virtual machine image deduplication in the cloud environment".JOURNAL OF SYSTEMS AND SOFTWARE 121(2016):144-156. |
| Files in This Item: | ||||||
| File Name/Size | DocType | Version | Access | License | ||
| 1-s2.0-S016412121600（1183KB） | 开放获取 | License | Application Full Text | |||
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment