Universiti Teknologi Malaysia Institutional Repository

Development of an imputation technique - INI for software metric database with incomplete data

Wasito, Ito and Olanrewaju, Rashidah F. (2007) Development of an imputation technique - INI for software metric database with incomplete data. In: 4th Student Conference on Research and Development SCOReD 2006. Institute of Electrical and Electronics Engineers, pp. 76-80. ISBN 978-1-4244-0526-8

[img] PDF
Restricted to Repository staff only

238kB

Official URL: http://dx.doi.org/10.1109/SCORED.2006.4339312

Abstract

Software metrics are numerical data that provides a quantitative basis for the development and validation of models, and effective measurement of the software development process. Gathering software engineering data can be expensive. Such precious and costly data cannot afford to be missing. However missing data is a common problem and software engineering database is not an exception. Though there are many algorithms to solve problem of incomplete data, unfortunately few have been developed in the field of Software Engineering. Missing data causes significant problem. With inaccurate data or missing data, it is very difficult to know how much a project will cost or worth. Missing data leads to loss of information, causes biasness in data analysis and hence results to inaccurate decision-making for project management and implementation. In this paper, an imputation technique for imputing missing data based on global-local Modified Singular Value Decomposition (MSVD) algorithm, INI was proposed. This technique was used for estimating missing data in a software engineering database (PROMISE). Its performance was evaluated and compared with two existing imputation techniques, Expectation Maximization (EM) and Mean Imputation (MI). Varying percentages of missings, (1%, 10%, 15%, and 20% 25%) were introduced in the original dataset in order to have an incomplete dataset for imputation. Simulations were carried for comparative purposes. Imputation Error (IE) was use as an evaluation criterion. Imputation Error (IE) was use as an evaluation criterion. Study results showed that, the only method that consistently outperformed other methods (EM and MI), guarantee a higher accuracy of imputed data, prompt and less bias at all level of missings is the global-local MSVD, INI. It maintained consistency at all level of missings compared to EM and MI. It was found that EM is not suitable for data with missing proportion greater than 20%. While MI lost in all count to EM and INI.

Item Type:Book Section
Uncontrolled Keywords:MSVD based imputation, data imputation, k-NN, missing data, software engineering database
Subjects:Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions:Computer Science and Information System
ID Code:9634
Deposited By: Salasiah M Said
Deposited On:14 Jan 2010 01:01
Last Modified:15 Aug 2017 01:32

Repository Staff Only: item control page