GraCoD: a disruptive graph-aware drift detection algorithm with a GCN-based time-varying module for concept drift detection in short text streams
subject: Concept drift detection; DRL; GADD; GraCoD; Hopfield layer
description: Detection of concept drift in time-varying short text streams has numerous challenges since the data are volatile. According to research, 30% to 40% of the traditional drift detection methods are not able to detect change of the concept in the text stream and, therefore, produce high false positives and slow response time. To address the above issues, the proposed Graph based Concept Drift Detection (GraCoD) method suggests a novel concept drift detection (CoD) framework. GraCoD uses ConvBERT with Hopfield layers and temporal convolution to capture linguistic context and temporal dependencies. The model constructs a graph representation of text data using a text GCN with Time Varying Spatio Temporal-Graph Attention Module (TVST-GAT) and uses the Graph Aware Drift Detection Algorithm (GADD) to classify the change in the graph metrics such as node centrality and edge density. The approach is more helpful and effective than the traditional approaches of detecting the occurrence of drift. To react to the detected drifts proactively, Deep Reinforcement Learning (DRL) is merged with Deep Q-Learning to automatically adapt parameters and behaviors based on the outcomes of detected drifts. The severity and classification modules detect the severity and classify the detected drifts for further investigation. The proposed model demonstrates exceptional performance in CoD across five diverse datasets: Twitter datasets 1 and 2, Enron, News 20, and Amazon Reviews. It achieves high accuracy (98.7%-99.5%) and F1-scores (96%-98%), with low false positive (0.020.04) and false negative (0.010.03) rates. The model effectively identifies 2329 drifts, with drift indicators ranging from 81.3% to 86.6%, showcasing its robustness in handling dynamic data streams across various domains. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2025.
creator: Patil, Megha Ashok; Kumar, Sunil; Kumar, Sandeep
source: International Journal on Digital Libraries;Volume;26;Issue;4;Article No.;25;
publisher: Springer Science and Business Media Deutschland GmbH
date: 01-01-2025
rights: Restricted Access; Hardcopy may be available in the library
relation: ISSN: 14325012;
format: online
language: English
type: Article
coverage: Patil M.A., Amity School of Engineering & Technology, Amity University Rajasthan, Jaipur, India; Kumar S., Amity School of Engineering & Technology, Amity University Rajasthan, Jaipur, India; Kumar S., Department of AI ML and Data Science, CHRIST University, Karnataka, Bangalore, India