Dublin Core The Dublin Core metadata element set is common to all Omeka records, including items, files, and collections. For more information see, http://dublincore.org/documents/dces/. Title A name given to the resource Conference Papers Conference Paper Faculty Publications- Conference Papers Dublin Core The Dublin Core metadata element set is common to all Omeka records, including items, files, and collections. For more information see, http://dublincore.org/documents/dces/. Title A name given to the resource Synergizing Senses: Advancing Multimodal Emotion Recognition in Human-Computer Interaction with MFF-CNN Subject The topic of the resource Deep Learning and Emotion Classification; Facial Expressions; Human-Computer Interaction; MFF-CNN (Multimodal Fusion and Convolutional Neural Network); Multimodal Emotion Recognition; Speech Signals Description An account of the resource Optimizing the authenticity and efficacy of interactions between humans and computers is largely dependent on emotion detection. The MFF-CNN framework is used in this work to present a unique method for multidimensional emotion identification. The MFF-CNN model is a combination of approaches that combines convolutional neural networks and multimodal fusion. It is intended to efficiently collect and integrate data from several modalities, including spoken words and human facial expressions. The first step in the suggested system's implementation is gathering a multimodal dataset with emotional labels added to it. The MFF-CNN receives input features in the form of retrieved facial landmarks and voice signal spectroscopy reconstructions. Convolutional layers are used by the model to understand hierarchies spatial and temporal structures, which improves its capacity to recognize complex emotional signals. Our experimental assessment shows that the MFF-CNN outperforms conventional unimodal emotion recognition algorithms. Improved preciseness, reliability, and adaptability across a range of emotional states are the outcomes of fusing the linguistic and face senses. Additionally, visualization methods improve the interpretability of the model and offer insights into the learnt representations. By providing a practical and understandable method for multimodal emotion identification, this study advances the field of human-computer interaction. The MFF-CNN architecture opens the door to more organic and psychologically understanding human-computer interactions by showcasing its possibilities for practical applications. The Author(s), under exclusive license to Springer Nature Switzerland AG 2024. Creator An entity primarily responsible for making the resource Upreti K.; Vats P.; Malik K.; Verma R.; Divakaran P.; Gangwar D. Source A related resource from which the described resource is derived Lecture Notes in Networks and Systems, Vol-1047 LNNS, pp. 279-288. Publisher An entity responsible for making the resource available Springer Science and Business Media Deutschland GmbH Date A point or period of time associated with an event in the lifecycle of the resource 2024-01-01 Identifier An unambiguous reference to the resource within a given context <a href="https://doi.org/10.1007/978-3-031-64836-6_28" target="_blank" rel="noreferrer noopener">https://doi.org/10.1007/978-3-031-64836-6_28</a> <br /><br /><a href="https://www.scopus.com/inward/record.uri?eid=2-s2.0-85200662389&amp;doi=10.1007%2F978-3-031-64836-6_28&amp;partnerID=40&amp;md5=ce682860a3f40cba52fb9676af9a17a0" target="_blank" rel="noreferrer noopener">https://www.scopus.com/inward/record.uri?eid=2-s2.0-85200662389&amp;doi=10.1007%2f978-3-031-64836-6_28&amp;partnerID=40&amp;md5=ce682860a3f40cba52fb9676af9a17a0</a> Rights Information about rights held in and over the resource Restricted Access Relation A related resource ISSN: 23673370; ISBN: 978-303164835-9 Format The file format, physical medium, or dimensions of the resource Online Language A language of the resource English Type The nature or genre of the resource Conference paper Coverage The spatial or temporal topic of the resource, the spatial applicability of the resource, or the jurisdiction under which the resource is relevant Upreti K., Department of Computer Science, CHRIST (Deemed to Be University), Delhi NCR, Ghaziabad, India; Vats P., Department of Computer Science and Engineering, SCSE, Manipal University Jaipur, Rajasthan, Jaipur, India; Malik K., School of Law, CHRIST (Deemed to Be University), Delhi NCR, Ghaziabad, India; Verma R., School of Business and Management, CHRIST (Deemed to Be University), Delhi NCR, Ghaziabad, India; Divakaran P., School of Business and Management, Himalayan University, Arunachal Pradesh, Itanagar, India; Gangwar D., Department of Management, Babu Banarasi Das Institute of Technology and Management, Lucknow, India