Bimodal Classification for Emotional Intelligence Using Peripheral Signals

Title

Bimodal Classification for Emotional Intelligence Using Peripheral Signals

Creator

Preema, P.Y.; Chandra, J.; Angel, C. Steffi

Description

Innovation in the field of humancomputer interaction involves analyzing users real-time emotions, which stands to be an essential and challenging task as they can be easily controlled or faked. Methodologies for analyzing emotions in existing studies include facial, audio, and physiological signals. The primary objective is to develop a model for emotion classification that can accurately identify and interpret human emotions through skin temperature, respiration, and plethysmograph. The aim was to analyze ensemble models that accurately discern and interpret emotional states. The emotional states were classified based on the frequency domain signal components extracted using Fast Fourier Transform (FFT), such as amplitude and frequency. Ensemble-based machine learning algorithms such as XGBoost and LGBM achieved the highest accuracy in classifying various emotional states. The study involves unimodal and bimodal analysis of the signals. The comparative classification rate of bimodal results is the highest for calm, with 85.5%, by combining a plethysmograph and temperature. Whereas the bimodal results with respiration and skin temperature maintain the accuracy level for all four emotions. The results also convey the significance of plethysmograph and temperature for a high classification rate of happiness and emotion, whereas respiration has improved the classification rate of anger and sadness. The potential applications include enhancing user experiences and contributing valuable insights into mental health care, humancomputer interaction, and recommendation systems. The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

Source

Lecture Notes in Networks and Systems;Volume;1239 LNNS;pp.185-198

Date

01-01-2025

Publisher

Springer Science and Business Media Deutschland GmbH

Subject

DEAP dataset; Emotion recognition; Frequency domain analysis; Peripheral signals; Signal processing

Coverage

Preema P.Y., Department of Computer Science, Christ Deemed to Be University, Karnataka, Bangalore, India; Chandra J., Department of Computer Science, Christ Deemed to Be University, Karnataka, Bangalore, India; Angel C.S., Department of Computer Science, Christ Deemed to Be University, Karnataka, Bangalore, India

Rights

Restricted Access; Hardcopy may be available in the library

Relation

ISSN: 23673370; ISBN: 978-981961187-4;

Format

online

Language

English

Type

Conference paper

Identifier

https://doi.org/10.1007/978-981-96-1188-1_14

https://www.scopus.com/pages/publications/105008495585?origin=resultslist