Using simulation to evaluate error detection strategies: A case study of cloud-based deployment processes

ISCAS OpenIR

	Using simulation to evaluate error detection strategies: A case study of cloud-based deployment processes
	Chen, J; Xu, XW; Osterweil, LJ; Zhu, LM; Brun, Y; Bass, L; Xiao, JC; Li, MS; Wang, Q
	2015
发表期刊	JOURNAL OF SYSTEMS AND SOFTWARE
ISSN	0164-1212
卷号	110 页码:205-221
摘要	The processes for deploying systems in cloud environments can be the basis for studying strategies for detecting and correcting errors committed during complex process execution. These cloud-based processes encompass diverse activities, and entail complex interactions between cloud infrastructure, application software, tools, and humans. Many of these processes, such as those for making release decisions during continuous deployment and troubleshooting in system upgrades, are highly error-prone. Unlike the typically well-tested deployed software systems, these deployment processes are usually neither well understood nor well tested. Errors that occur during such processes may require time-consuming troubleshooting, undoing and redoing steps, and problem fixing. Consequently, these processes should ideally be guided by strategies for detecting errors that consider trade-offs between efficiency and reliability. This paper presents a framework for systematically exploring such trade-offs. To evaluate the framework and illustrate our approach, we use two representative cloud deployment processes: a continuous deployment process and a rolling upgrade process. We augment an existing process modeling language to represent these processes and model errors that may occur during process execution. We use a process-aware discrete-event simulator to evaluate strategies and empirically validate simulation results by comparing them to experiences in a production environment. Our evaluation demonstrates that our approach supports the study of how error-handling strategies affect how much time is taken for task-completion and error-fixing. (c) 2015 Elsevier Inc. All rights reserved.; The processes for deploying systems in cloud environments can be the basis for studying strategies for detecting and correcting errors committed during complex process execution. These cloud-based processes encompass diverse activities, and entail complex interactions between cloud infrastructure, application software, tools, and humans. Many of these processes, such as those for making release decisions during continuous deployment and troubleshooting in system upgrades, are highly error-prone. Unlike the typically well-tested deployed software systems, these deployment processes are usually neither well understood nor well tested. Errors that occur during such processes may require time-consuming troubleshooting, undoing and redoing steps, and problem fixing. Consequently, these processes should ideally be guided by strategies for detecting errors that consider trade-offs between efficiency and reliability. This paper presents a framework for systematically exploring such trade-offs. To evaluate the framework and illustrate our approach, we use two representative cloud deployment processes: a continuous deployment process and a rolling upgrade process. We augment an existing process modeling language to represent these processes and model errors that may occur during process execution. We use a process-aware discrete-event simulator to evaluate strategies and empirically validate simulation results by comparing them to experiences in a production environment. Our evaluation demonstrates that our approach supports the study of how error-handling strategies affect how much time is taken for task-completion and error-fixing. (c) 2015 Elsevier Inc. All rights reserved.
收录类别	SCI
关键词	Process Modeling Simulation Deployment Process
部门归属	Chinese Acad Sci, Inst Software, Lab Internet Software Technol, Beijing, Peoples R China. NICTA, Eveleigh, Australia. Univ Massachusetts, Coll Informat & Comp Sci, Amherst, MA 01003 USA. Univ New S Wales, Sch Comp Sci & Engn, Sydney, NSW, Australia. Univ Chinese Acad Sci, Beijing, Peoples R China. Chinese Acad Sci, Inst Software, State Key Lab Comp Sci, Beijing, Peoples R China.
语种	英语
WOS记录号	WOS:000364244600012
引用统计
内容类型	期刊论文
URI标识	http://ir.iscas.ac.cn/handle/311060/17425
专题	中国科学院软件研究所
推荐引用方式 GB/T 7714	Chen, J,Xu, XW,Osterweil, LJ,et al. Using simulation to evaluate error detection strategies: A case study of cloud-based deployment processes[J]. JOURNAL OF SYSTEMS AND SOFTWARE,2015,110:205-221.
APA	Chen, J.,Xu, XW.,Osterweil, LJ.,Zhu, LM.,Brun, Y.,...&Wang, Q.(2015).Using simulation to evaluate error detection strategies: A case study of cloud-based deployment processes.JOURNAL OF SYSTEMS AND SOFTWARE,110,205-221.
MLA	Chen, J,et al."Using simulation to evaluate error detection strategies: A case study of cloud-based deployment processes".JOURNAL OF SYSTEMS AND SOFTWARE 110(2015):205-221.

条目包含的文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
1-s2.0-S016412121500（2986KB）			开放获取	使用许可	请求全文