Multimodal Emotion Recognition Using Deep Learning Techniques
- Title
- Multimodal Emotion Recognition Using Deep Learning Techniques
- Creator
- Jerald James S.; Jacob L.
- Description
- Humans have the ability to perceive and depict a wide range of emotions. There are various models that can recognize seven primary emotions from facial expressions (joyful, gloomy, annoyed, dreadful, wonder, antipathy, and impartial). This can be accomplished by observing various activities such as facial muscle movements, speech, hand gestures, and so forth. Automatic emotion recognition is a significant issue that has been a hotly debated research topic in recent years. At the moment, several research people have taken a component in inheriting or extra multimodal for higher understanding. This paper indicates a method for emotion recognition that makes use of 3 modalities: facial images, audio indicators, and text detection from FER and CK+, RAVDESS, and Twitter tweets datasets, respectively. The CNN model achieved 66.67 percent on the FER-2013 dataset of labeled headshots while on the CK+ dataset, 98.4 percent accuracy was obtained. Finally, diverse fusion strategies had been approached, and each of those fusion techniques gave distinctive results. This project is a step towards the sense of interaction between human emotional aspects and the growing technology that is the future of development in today's world. 2022 IEEE.
- Source
- Proceedings - 2022 4th International Conference on Advances in Computing, Communication Control and Networking, ICAC3N 2022, pp. 903-908.
- Date
- 2022-01-01
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Subject
- Deep Learning; Emotion Recognition; Emotions; Facial Expressions; Recognition
- Coverage
- Jerald James S., Christ University, Department of Data Science, Lavasa, Pune, India; Jacob L., Christ University, Department of Data Science, Lavasa, Pune, India
- Rights
- Restricted Access
- Relation
- ISBN: 978-166547436-8
- Format
- Online
- Language
- English
- Type
- Conference paper
Collection
Citation
Jerald James S.; Jacob L., “Multimodal Emotion Recognition Using Deep Learning Techniques,” CHRIST (Deemed To Be University) Institutional Repository, accessed February 24, 2025, https://archives.christuniversity.in/items/show/20129.