Categorizing Mental Stress: A Consistency-Focused Benchmarking of ML and DL Models for Multi-Label, Multi-Class Classification via Taxonomy-Driven NLP Techniques
- Title
- Categorizing Mental Stress: A Consistency-Focused Benchmarking of ML and DL Models for Multi-Label, Multi-Class Classification via Taxonomy-Driven NLP Techniques
- Creator
- John, Juswin Sajan; Prathap, Boppuru Rudra; Gupta, Gyanesh; Melanaturu, Jaivanth
- Description
- Mental stress, a critical concern worldwide, necessitates precise and nuanced characterization. This study introduces a novel approach to effectively characterize mental stress through a multi-label, multi-class classification framework through natural language processing techniques. Building on existing literature, discussions with psychologists and other mental health practitioners, we developed a taxonomy of 27 distinctive markers spread across 4 label categories; aiming to create a preliminary screening tool leveraging textual data. The core objective is to identify the most suitable model for this complex task, encompassing comprehensive evaluation of various machine learning and deep learning algorithms. we experimented with support vector machines (SVM), random forest (RF) and long short-term memory (LSTM) algorithms incorporating various feature combinations involving Term Frequency-Inverse Document Frequency (TF-IDF) and Latent Dirichlet Allocation (LDA). The best performer of this comparative study was further evaluated against an LLM. The potential of large language models (LLMs), including their language understanding and prediction capabilities, is another key focus. We explore how these models could augment and advance mental health research, offering new perspectives and insights into the characterization of mental stress. Our findings show that the top model, an LSTM with TF-IDF and LDA (class weights assigned) outperformed the PaLM model with a coefficient of variation as low as 0.87% across all labels. Despite the PaLM model's superior average performance, it exhibited higher variability among different labels. 2025 The Author(s)
- Source
- Natural Language Processing Journal;Volume;11;Issue;;Article No.;100162;
- Date
- 01-01-2025
- Publisher
- Elsevier Ltd
- Subject
- Deep learning; LLM; Machine learning; Mental health research; Mental stress; Natural language processing
- Coverage
- John J.S., Department of Computer Science and Engineering, CHRIST UNIVERSITY, Bengaluru, India; Prathap B.R., Department of Computer Science and Engineering, M. S. Ramaiah University of Applied Sciences, Bengaluru, India; Gupta G., Department of Computer Science and Engineering, CHRIST UNIVERSITY, Bengaluru, India; Melanaturu J., Department of Computer Science and Engineering, CHRIST UNIVERSITY, Bengaluru, India
- Rights
- All Open Access; Gold Open Access; Green Open Access
- Relation
- ISSN: 29497191;
- Format
- online
- Language
- English
- Type
- Article
Collection
Citation
John, Juswin Sajan; Prathap, Boppuru Rudra; Gupta, Gyanesh; Melanaturu, Jaivanth, “Categorizing Mental Stress: A Consistency-Focused Benchmarking of ML and DL Models for Multi-Label, Multi-Class Classification via Taxonomy-Driven NLP Techniques,” CHRIST (Deemed To Be University) Institutional Repository, accessed June 19, 2026, https://archives.christuniversity.in/items/show/22418.
