Universiti Teknologi Malaysia Institutional Repository

Data quality in big data: A review

Abdullah, Noraini and Ismail, Saiful Azmi and Yuhaniz, Siti Sophiayati and Mohd. Sam, Suriani (2015) Data quality in big data: A review. Interntional Journal Of Advances In Soft Computing And Its Applications, 7 (Specia). pp. 16-27. ISSN 2074-8523

Full text not available from this repository.


The Data Warehousing Institute (TDWI) estimates that data quality problems cost U.S. businesses more than $600 billion a year. The problem with data is that its quality quickly degenerates over time. Experts say 2 percent of records in a customer file become obsolete in one month because customers die, divorce, marry, and move. In addition, data entry errors, system migrations, and changes in source systems, among other things, generate bucket loads of errors. More complex, as organizations fragment into different divisions and units, interpretations of data elements change to meet the local business needs. However, there are several ways that the Company should concern, such as to treat data as a strategic corporate resource; develop a program for managing data quality with a commitment from the top; and hire, train, or outsource experienced data quality professionals to oversee and carry out the program. The Organizations can sustain a commitment to managing data quality over time and adjust monitoring and cleansing processes to changes in the business and underlying systems by using the Commercial data quality tools. Data is a vital resource. Companies that invest proportionally to manage this resource will stand a stronger chance of succeeding in today's competitive global economy than those that squander this critical resource by neglecting to ensure adequate levels of quality. This paper reviews the characteristics of big data quality and the managing processes that are involved in it.

Item Type:Article
Uncontrolled Keywords:big data, five v's, data quality, big value, data quality attributes, data quality methodology
Subjects:A General Works
ID Code:58206
Deposited By: Haliza Zainal
Deposited On:04 Dec 2016 12:07
Last Modified:15 Feb 2017 12:44

Repository Staff Only: item control page