Enhancing software reliability estimates using modified adaptive testing

ISCAS OpenIR

	Enhancing software reliability estimates using modified adaptive testing
	Hu, Hai (1); Jiang, Chang-Hai (1); Cai, Kai-Yuan (1); Wong, W. Eric (3); Mathur, Aditya P. (4); Hu, H.(huhai.orion@gmail.com)
	2013
页码	288-300
收录类别	SCI ; EI
出版地	Elsevier, P.O. Box 211, Amsterdam, 1000 AE, Netherlands
ISSN	9505849
部门归属	(1) Department of Automatic Control, Beijing University of Aeronautics and Astronautics, Beijing 100191, China; (2) State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing 100190, China; (3) Department of Computer Science, University of Texas at Dallas, United States; (4) Department of Computer Science, Purdue University, United States
摘要	Context: Most software reliability models are based on a binary notion of correctness, i.e. "successful" or "failed." However, in several instances, it is important to account of failure severity to obtain more descriptive and accurate estimates of the reliability of the software. Objective: In this paper, we develop a set of extended metrics based on the Nelson's software reliability model to account for information gained from a user's point of view regarding the severity of the observed failures. Model formulation based on multi-granularity failure severity is provided, and the proposed metrics are proved to be backward compatible. Method: In order to estimate the software reliability through testing, an extended adaptive testing strategy, namely Modified Adaptive Testing (MAT) is proposed. The use of test history information allows the resulting test process to be adaptive in the selection of tests under limited test budget. Simulations and experiments on real-life programs are conducted to evaluate the effectiveness of MAT. Results: Data show that the reliability estimates obtained using MAT (a) are closer to the "true" reliability than those obtained using random testing and (b) lead to lower variance than the techniques used for comparison, which means MAT can be applied to help testers and reliability engineers better understand the reliability of their programs. Conclusion: It is concluded that the proposed approach can enhance the software reliability estimation testing by guiding the test case selection process by providing more descriptive and accurate results. © 2012 Elsevier B.V. All rights reserved.; Context: Most software reliability models are based on a binary notion of correctness, i.e. "successful" or "failed." However, in several instances, it is important to account of failure severity to obtain more descriptive and accurate estimates of the reliability of the software. Objective: In this paper, we develop a set of extended metrics based on the Nelson's software reliability model to account for information gained from a user's point of view regarding the severity of the observed failures. Model formulation based on multi-granularity failure severity is provided, and the proposed metrics are proved to be backward compatible. Method: In order to estimate the software reliability through testing, an extended adaptive testing strategy, namely Modified Adaptive Testing (MAT) is proposed. The use of test history information allows the resulting test process to be adaptive in the selection of tests under limited test budget. Simulations and experiments on real-life programs are conducted to evaluate the effectiveness of MAT. Results: Data show that the reliability estimates obtained using MAT (a) are closer to the "true" reliability than those obtained using random testing and (b) lead to lower variance than the techniques used for comparison, which means MAT can be applied to help testers and reliability engineers better understand the reliability of their programs. Conclusion: It is concluded that the proposed approach can enhance the software reliability estimation testing by guiding the test case selection process by providing more descriptive and accurate results. © 2012 Elsevier B.V. All rights reserved.
关键词	Software Engineering Software Reliability Software Testing
语种	英语
内容类型	会议论文
URI标识	http://ir.iscas.ac.cn/handle/311060/16557
专题	中国科学院软件研究所
通讯作者	Hu, H.(huhai.orion@gmail.com)
推荐引用方式 GB/T 7714	Hu, Hai ,Jiang, Chang-Hai ,Cai, Kai-Yuan ,et al. Enhancing software reliability estimates using modified adaptive testing[C]. Elsevier, P.O. Box 211, Amsterdam, 1000 AE, Netherlands,2013:288-300.