IADIS International Journal on Computer Science and Information Systems

Published by IADIS (International Association for Development of the Information Society) • ISSN (Online): 1646-3692 • ISSN (Print): 1646-3692
100% Open Access
Double-Blind Peer Review
Crossref DOI Persistent IDs
Open Access Peer-Reviewed Review Papers

A Systematic Mapping Review on Data Cleaning Methods in Big Data Environments

Cláudio Keiji Iwata *
Napoleão Verardi Galegale *
Márcia Ito *
Marília Macorin de Azevedo *
Marcelo Duduchi Feitosa *
Carlos Hideo Arima *
* CEETEPS – Centro Estadual de Eduacação Tecnológica Paula Souza, Brazil (Portugal)
* CEETEPS – Centro Estadual de Eduacação Tecnológica Paula Souza, Brazil (Portugal)
* CEETEPS – Centro Estadual de Eduacação Tecnológica Paula Souza, Brazil (Portugal)
* CEETEPS – Centro Estadual de Eduacação Tecnológica Paula Souza, Brazil (Portugal)
* CEETEPS – Centro Estadual de Eduacação Tecnológica Paula Souza, Brazil (Portugal)
* CEETEPS – Centro Estadual de Eduacação Tecnológica Paula Souza, Brazil (Portugal)

Abstract

The evolution of information technology combined with artificia l intelligence, IoT (Internet of Things) and robotics has made processes integrated and intelligent. The increased use of technology and the need for evidence-based decisions have contributed to the rapid expa nsion of a large volume of data in recent years. The quality of data generated mainly by humans must be given special attention, as errors can occur more frequently, making the pre-processing phase, such as data cleaning, a determining factor for better results in data analysis. The aim of this article is therefore to analyze data cleaning methods applied in Big Data environments by conducting a systematic review. The review method was based on the Kitchenham protocol, and the search databases were Scopus, Web of Science and CAPES. After searching and selecting the articles according to the protocol, 69 articles were analyz ed, revealing the use of a wide variety of techniques, such as machine learning, data mining, natural lang uage processing and others. The review also emphasized the various publication formats and the wide dissemination and discussion of research on data cleaning in Big Data in the academic community. Finally, t his study provides the state of the art of data cleansing techniques that have been used in a Big Data con text, offering insights and directions for future research.

Keywords

Data Cleaning Big Data Data Quality Mapping Review
Full-Text PDF Available

Read Complete Peer-Reviewed Manuscript

Includes full econometric models, data tables, policy recommendations, declarations, and citations.

Declarations & Ethics

Funding: This research received academic dissemination support through ESCAP / JournalsHub publishing programs.
Conflicts of Interest: The authors declare no competing financial or institutional interests.
Peer Review: Double-blind peer reviewed by international subject specialists.
License: Creative Commons Attribution 4.0 International (CC BY 4.0).
How to Cite This Article
APA / MLA / BibTeX
Iwata, et al. (2024). A Systematic Mapping Review on Data Cleaning Methods in Big Data Environments. IADIS International Journal on Computer Science and Information Systems, 19(2). https://doi.org/10.33965/ijcsis_2024_v19i2_03
Iwata, et al. "A Systematic Mapping Review on Data Cleaning Methods in Big Data Environments." IADIS International Journal on Computer Science and Information Systems, vol. 19, no. 2, 2024. https://doi.org/10.33965/ijcsis_2024_v19i2_03
Iwata, et al. "A Systematic Mapping Review on Data Cleaning Methods in Big Data Environments." IADIS International Journal on Computer Science and Information Systems 19, no. 2 (2024). https://doi.org/10.33965/ijcsis_2024_v19i2_03