Root cause analysis of COVID-19 cases by enhanced text mining process

Title

Root cause analysis of COVID-19 cases by enhanced text mining process

Creator

Kokatnoor S.A.; Krishnan B.

Description

The main focus of this research is to find the reasons behind the fresh cases of COVID-19 from the publics perception for data specific to India. The analysis is done using machine learning approaches and validating the inferences with medical professionals. The data processing and analysis is accomplished in three steps. First, the dimensionality of the vector space model (VSM) is reduced with improvised feature engineering (FE) process by using a weighted term frequency-inverse document frequency (TF-IDF) and forward scan trigrams (FST) followed by removal of weak features using feature hashing technique. In the second step, an enhanced K-means clustering algorithm is used for grouping, based on the public posts from Twitter. In the last step, latent dirichlet allocation (LDA) is applied for discovering the trigram topics relevant to the reasons behind the increase of fresh COVID-19 cases. The enhanced K-means clustering improved Dunn index value by 18.11% when compared with the traditional K-means method. By incorporating improvised two-step FE process, LDA model improved by 14% in terms of coherence score and by 19% and 15% when compared with latent semantic analysis (LSA) and hierarchical dirichlet process (HDP) respectively thereby resulting in 14 root causes for spike in the disease. 2022 Institute of Advanced Engineering and Science. All rights reserved.

Source

International Journal of Electrical and Computer Engineering, Vol-12, No. 2, pp. 1807-1817.

Date

2022-01-01

Publisher

Institute of Advanced Engineering and Science

Subject

Dunn index; Feature engineering; Feature hashing; Hierarchical dirichlet process; K-means; Latent dirichlet allocation; Latent semantic analysis

Coverage

Kokatnoor S.A., Department of Computer Science and Engineering, CHRIST (Deemed to be University), Bengaluru, India; Krishnan B., Department of Computer Science and Engineering, CHRIST (Deemed to be University), Bengaluru, India

Rights

All Open Access; Gold Open Access

Relation

ISSN: 20888708

Format

Online

Language

English

Type

Article

Identifier

https://doi.org/10.11591/ijece.v12i2.pp1807-1817

https://www.scopus.com/inward/record.uri?eid=2-s2.0-85122797667&doi=10.11591%2fijece.v12i2.pp1807-1817&partnerID=40&md5=4e66a598625e7ab8ac376449fdc8c251