中国科学院软件研究所机构知识库
Advanced  
ISCAS OpenIR  > 软件所图书馆  > 会议论文
Title:
Analyzing and handling local bias for calibrating parametric cost estimation models
Author: Yang, Ye (1) ; He, Zhimin (1) ; Mao, Ke (1) ; Li, Qi (3) ; Nguyen, Vu (3) ; Boehm, Barry (3) ; Valerdi, Ricardo (4)
Issued Date: 2013
Corresponding Author: Yang, Y.(ye@itechs.iscas.ac.cn)
Publish Place: Elsevier, P.O. Box 211, Amsterdam, 1000 AE, Netherlands
Indexed Type: EI
ISSN: 9505849
Department: (1) Lab for Internet Software Technology, Institute of Software, Chinese Academy of Sciences, Beijing, China; (2) University of Chinese Academy of Sciences, Beijing, China; (3) Center for Systems and Software Engineering, University of Southern California, Los Angeles, United States; (4) Department of Systems and Industrial Engineering, University of Arizona, Tucson, United States
Abstract: Context Parametric cost estimation models need to be continuously calibrated and improved to assure more accurate software estimates and reflect changing software development contexts. Local calibration by tuning a subset of model parameters is a frequent practice when software organizations adopt parametric estimation models to increase model usability and accuracy. However, there is a lack of understanding about the cumulative effects of such local calibration practices on the evolution of general parametric models over time. Objective This study aims at quantitatively analyzing and effectively handling local bias associated with historical cross-company data, thus improves the usability of cross-company datasets for calibrating and maintaining parametric estimation models. Method We design and conduct three empirical studies to measure, analyze and address local bias in cross-company dataset, including: (1) defining a method for measuring the local bias associated with individual organization data subset in the overall dataset; (2) analyzing the impacts of local bias on the performance of an estimation model; (3) proposing a weighted sampling approach to handle local bias. The studies are conducted on the latest COCOMO II calibration dataset. Results Our results show that the local bias largely exists in cross company dataset, and the local bias negatively impacts the performance of parametric model. The local bias based weighted sampling technique helps reduce negative impacts of local bias on model performance. Conclusion Local bias in cross-company data does harm model calibration and adds noisy factors to model maintenance. The proposed local bias measure offers a means to quantify degree of local bias associated with a cross-company dataset, and assess its influence on parametric model performance. The local bias based weighted sampling technique can be applied to trade-off and mitigate potential risk of significant local bias, which limits the usability of cross-company data for general parametric model calibration and maintenance. © 2013 Elsevier B.V. All rights reserved.
English Abstract: Context Parametric cost estimation models need to be continuously calibrated and improved to assure more accurate software estimates and reflect changing software development contexts. Local calibration by tuning a subset of model parameters is a frequent practice when software organizations adopt parametric estimation models to increase model usability and accuracy. However, there is a lack of understanding about the cumulative effects of such local calibration practices on the evolution of general parametric models over time. Objective This study aims at quantitatively analyzing and effectively handling local bias associated with historical cross-company data, thus improves the usability of cross-company datasets for calibrating and maintaining parametric estimation models. Method We design and conduct three empirical studies to measure, analyze and address local bias in cross-company dataset, including: (1) defining a method for measuring the local bias associated with individual organization data subset in the overall dataset; (2) analyzing the impacts of local bias on the performance of an estimation model; (3) proposing a weighted sampling approach to handle local bias. The studies are conducted on the latest COCOMO II calibration dataset. Results Our results show that the local bias largely exists in cross company dataset, and the local bias negatively impacts the performance of parametric model. The local bias based weighted sampling technique helps reduce negative impacts of local bias on model performance. Conclusion Local bias in cross-company data does harm model calibration and adds noisy factors to model maintenance. The proposed local bias measure offers a means to quantify degree of local bias associated with a cross-company dataset, and assess its influence on parametric model performance. The local bias based weighted sampling technique can be applied to trade-off and mitigate potential risk of significant local bias, which limits the usability of cross-company data for general parametric model calibration and maintenance. © 2013 Elsevier B.V. All rights reserved.
Language: 英语
Citation statistics:
Content Type: 会议论文
URI: http://ir.iscas.ac.cn/handle/311060/16644
Appears in Collections:软件所图书馆_会议论文

Files in This Item:

There are no files associated with this item.


Recommended Citation:
Yang, Ye ,He, Zhimin ,Mao, Ke ,et al. Analyzing and handling local bias for calibrating parametric cost estimation models[C]. 见:.
Service
Recommend this item
Sava as my favorate item
Show this item's statistics
Export Endnote File
Google Scholar
Similar articles in Google Scholar
[Yang, Ye (1)]'s Articles
[He, Zhimin (1)]'s Articles
[Mao, Ke (1)]'s Articles
CSDL cross search
Similar articles in CSDL Cross Search
[Yang, Ye (1)]‘s Articles
[He, Zhimin (1)]‘s Articles
[Mao, Ke (1)]‘s Articles
Related Copyright Policies
Null
Social Bookmarking
Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit
所有评论 (0)
暂无评论
 
评注功能仅针对注册用户开放,请您登录
您对该条目有什么异议,请填写以下表单,管理员会尽快联系您。
内 容:
Email:  *
单位:
验证码:   刷新
您在IR的使用过程中有什么好的想法或者建议可以反馈给我们。
标 题:
 *
内 容:
Email:  *
验证码:   刷新

Items in IR are protected by copyright, with all rights reserved, unless otherwise indicated.

 

 

Valid XHTML 1.0!
Copyright © 2007-2019  中国科学院软件研究所 - Feedback
Powered by CSpace