Universiti Teknologi Malaysia Institutional Repository

Automatic diagnosis of COVID-19 patients from unstructured data based on a novel weighting scheme

Mahdi, Amir Yasseen and Siti Sophiayati Yuhaniz, Siti Sophiayati Yuhaniz (2023) Automatic diagnosis of COVID-19 patients from unstructured data based on a novel weighting scheme. Computers, Materials and Continua, 74 (1). pp. 1375-1392. ISSN 1546-2218

[img] PDF
1MB

Official URL: http://dx.doi.org/10.32604/cmc.2023.032671

Abstract

The extraction of features from unstructured clinical data of Covid-19 patients is critical for guiding clinical decision-making and diagnosing this viral disease. Furthermore, an early and accurate diagnosis of COVID-19 can reduce the burden on healthcare systems. In this paper, an improved Term Weighting technique combined with Parts-Of-Speech (POS) Tagging is proposed to reduce dimensions for automatic and effective classification of clinical text related to Covid-19 disease. Term Frequency-Inverse Document Frequency (TF-IDF) is the most often used term weighting scheme (TWS). However, TF-IDF has several developments to improve its drawbacks, in particular, it is not efficient enough to classify text by assigning effective weights to the terms in unstructured data. In this research, we proposed a modification term weighting scheme: RTF-C-IEF and compare the proposed model with four extraction methods: TF, TF-IDF, TF-IHF, and TF-IEF. The experiment was conducted on two new datasets for COVID-19 patients. The first dataset was collected from government hospitals in Iraq with 3053 clinical records, and the second dataset with 1446 clinical reports, was collected from several different websites. Based on the experimental results using several popular classifiers applied to the datasets of Covid-19, we observe that the proposed scheme RTF-C-IEF achieves is a consistent performer with the best scores in most of the experiments. Further, the modified RTF-C-IEF proposed in the study outperformed the original scheme and other employed term weighting methods in most experiments. Thus, the proper selection of term weighting scheme among the different methods improves the performance of the classifier and helps to find the informative term.

Item Type:Article
Uncontrolled Keywords:clinical text, Covid-19, machine learning, natural language processing, TWS
Subjects:T Technology > T Technology (General)
Divisions:Razak School of Engineering and Advanced Technology
ID Code:106326
Deposited By: Widya Wahid
Deposited On:29 Jun 2024 06:00
Last Modified:29 Jun 2024 06:00

Repository Staff Only: item control page