Automatic GUI Test by Using SIFT Matching

ISCAS OpenIR

	Automatic GUI Test by Using SIFT Matching
	Fang, XX; Sheng, B; Li, P; Wu, D; Wu, EH
	2016
发表期刊	CHINA COMMUNICATIONS
ISSN	1673-5447
卷号	13 期号:9 页码:227-236
摘要	In software development process, the last step is usually the Graphic User Interface(GUI) test, which is part of the final user experience (UE) test. Traditionally, there exist some GUI test tools in the market, such as Abbot Java GUI Test Framework and Pounder, in which testers pre-configure in the script all desired actions and instructions for the computer, nonetheless requiring too much of invariance of GUI environment; and they require reconfiguration in case of GUI changes, therefore still to be done mostly manually and hard for non-programmer testers to. Consequently, we proposed GUI tests by image recognition to automate the last process; we managed to innovate upon current algorithms such as SIFT and Random Fern, from which we develop the new algorithm scheme retrieving most efficient feature and dispelling inefficient part of each algorithm. Computers then apply the algorithm, to search for target patterns themselves and take subsequent actions such as manual mouse, keyboard and screen I/O automatically to test the GUI without any manual instructions. Test results showed that the proposed approach can accelerate GUI test largely compared to current benchmarks.; In software development process, the last step is usually the Graphic User Interface(GUI) test, which is part of the final user experience (UE) test. Traditionally, there exist some GUI test tools in the market, such as Abbot Java GUI Test Framework and Pounder, in which testers pre-configure in the script all desired actions and instructions for the computer, nonetheless requiring too much of invariance of GUI environment; and they require reconfiguration in case of GUI changes, therefore still to be done mostly manually and hard for non-programmer testers to. Consequently, we proposed GUI tests by image recognition to automate the last process; we managed to innovate upon current algorithms such as SIFT and Random Fern, from which we develop the new algorithm scheme retrieving most efficient feature and dispelling inefficient part of each algorithm. Computers then apply the algorithm, to search for target patterns themselves and take subsequent actions such as manual mouse, keyboard and screen I/O automatically to test the GUI without any manual instructions. Test results showed that the proposed approach can accelerate GUI test largely compared to current benchmarks.
收录类别	SCI
关键词	Gui Test Image Recognition Sift Random Fern
部门归属	Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China. Chinese Acad Sci, Inst Software, State Key Lab Comp Sci, Beijing 100190, Peoples R China. Educ Univ Hong Kong, Dept Math & Informat Technol, Hong Kong, Hong Kong, Peoples R China. China Southern Power Grid, Dept Informat, Guangzhou, Guangdong, Peoples R China. Univ Macau, Fac Sci & Technol, Macau, Peoples R China.
语种	英语
WOS记录号	WOS:000383938000024
引用统计
内容类型	期刊论文
URI标识	http://ir.iscas.ac.cn/handle/311060/17308
专题	中国科学院软件研究所
推荐引用方式 GB/T 7714	Fang, XX,Sheng, B,Li, P,et al. Automatic GUI Test by Using SIFT Matching[J]. CHINA COMMUNICATIONS,2016,13(9):227-236.
APA	Fang, XX,Sheng, B,Li, P,Wu, D,&Wu, EH.(2016).Automatic GUI Test by Using SIFT Matching.CHINA COMMUNICATIONS,13(9),227-236.
MLA	Fang, XX,et al."Automatic GUI Test by Using SIFT Matching".CHINA COMMUNICATIONS 13.9(2016):227-236.