an empirical assessment of a systematic search process for systematic reviews

ISCAS OpenIR

	an empirical assessment of a systematic search process for systematic reviews
	Zhang He; Babar M.A.; Bai Xu; Li Juan; Huang Liguo
	2011
会议名称	15th Annual Conference on Evaluation and Assessment in Software Engineering, EASE 2011
会议录名称	IET Seminar Digest
页码	56-65
会议日期	April 11,
会议地点	Durham, United kingdom
收录类别	EI
ISBN	9781849195096
部门归属	(1) National ICT Australia University of New South Wales Australia; (2) IT University of Copenhagen Denmark; (3) Southern Methodist University Dallas TX United States; (4) Institute of Software Chinese Academy of Sciences China
摘要	Background: Systematic Literature Reviews (SLRs) have been gaining significant attention from Software Engineering (SE) researchers. Several researchers are also working on improving SLR methodology for SE. Objective: The study reported in this paper aims to validate the QGS-based search process for SLR, i.e. whether a more effective (sensitive) and/or productive (precise) search can be achieved by following the QGS-based process. Method: We used a dual-case study, in which each case includes two observations of SE literature search for the same SLR but using and not using the QGS-based approach. The overall sensitivity and precision were calculated for each observation that implemented different search design. Results: The use of QGS-based search process resulted in higher sensitivity and precision in this dual-case study. Conclusions: A systematic search process can help capture more relevant studies as well as save researchers' time spent on literature search activities. Our observations also support that an integrated search strategy is recommended for SLRs in SE to avoid the possible limitations of applying a single (manual or automated) search method.; Background: Systematic Literature Reviews (SLRs) have been gaining significant attention from Software Engineering (SE) researchers. Several researchers are also working on improving SLR methodology for SE. Objective: The study reported in this paper aims to validate the QGS-based search process for SLR, i.e. whether a more effective (sensitive) and/or productive (precise) search can be achieved by following the QGS-based process. Method: We used a dual-case study, in which each case includes two observations of SE literature search for the same SLR but using and not using the QGS-based approach. The overall sensitivity and precision were calculated for each observation that implemented different search design. Results: The use of QGS-based search process resulted in higher sensitivity and precision in this dual-case study. Conclusions: A systematic search process can help capture more relevant studies as well as save researchers' time spent on literature search activities. Our observations also support that an integrated search strategy is recommended for SLRs in SE to avoid the possible limitations of applying a single (manual or automated) search method.
关键词	Computer Software Selection And Evaluation Rating Research
语种	英语
内容类型	会议论文
URI标识	http://ir.iscas.ac.cn/handle/311060/16259
专题	中国科学院软件研究所
推荐引用方式 GB/T 7714	Zhang He,Babar M.A.,Bai Xu,et al. an empirical assessment of a systematic search process for systematic reviews[C],2011:56-65.