Dublin Core The Dublin Core metadata element set is common to all Omeka records, including items, files, and collections. For more information see, http://dublincore.org/documents/dces/. Title A name given to the resource Articles Article Faculty Publications -Articles Dublin Core The Dublin Core metadata element set is common to all Omeka records, including items, files, and collections. For more information see, http://dublincore.org/documents/dces/. Title A name given to the resource Multimodal emotional analysis through hierarchical video summarization and face tracking Subject The topic of the resource Deep neural networks; Emotional intelligence; Entropy; Face detection; Hierarchical summarization; Video summarization; Viola Jones Description An account of the resource The era of video data has fascinated users into creating, processing, and manipulating videos for various applications. Voluminous video data requires higher computation power and processing time. In this work, a model is developed that can precisely acquire keyframes through hierarchical summarization and use the keyframes to detect faces and assess the emotional intent of the user. The key-frames are used to detect faces using recursive Viola-Jones algorithm and an emotional analysis for the faces extracted is conducted using an underlying architecture developed based on Deep Neural Networks (DNN). This work has significantly contributed in improving the accuracy of face detection and emotional analysis in non-redundant frames. The number of frames selected after summarization was less than 30% using the local minima extraction. The recursive routine introduced for face detection reduced false positives in all the video frames to lesser than 2%. The accuracy of emotional prediction on the faces acquired through the summarized frames, on Indian faces achieved a 90%. The computational requirement scaled down to 40% due to the hierarchical summarization that removed redundant frames and recursive face detection removed false localization of faces. The proposed model intends to emphasize the importance of keyframe detection and use them for facial emotional recognition. 2021, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature. Creator An entity primarily responsible for making the resource Thiruthuvanathan M.M.; Krishnan B. Source A related resource from which the described resource is derived Multimedia Tools and Applications, Vol-81, No. 25, pp. 35535-35554. Publisher An entity responsible for making the resource available Springer Date A point or period of time associated with an event in the lifecycle of the resource 2022-01-01 Identifier An unambiguous reference to the resource within a given context <a href="https://doi.org/10.1007/s11042-021-11010-y" target="_blank" rel="noreferrer noopener">https://doi.org/10.1007/s11042-021-11010-y</a> <br /><br /><a href="https://www.scopus.com/inward/record.uri?eid=2-s2.0-85106472136&amp;doi=10.1007%2Fs11042-021-11010-y&amp;partnerID=40&amp;md5=88b39e18f88ebd344befd233d85493e9" target="_blank" rel="noreferrer noopener">https://www.scopus.com/inward/record.uri?eid=2-s2.0-85106472136&amp;doi=10.1007%2fs11042-021-11010-y&amp;partnerID=40&amp;md5=88b39e18f88ebd344befd233d85493e9</a> Rights Information about rights held in and over the resource Restricted Access Relation A related resource ISSN: 13807501; CODEN: MTAPF Format The file format, physical medium, or dimensions of the resource Online Language A language of the resource English Type The nature or genre of the resource Article Coverage The spatial or temporal topic of the resource, the spatial applicability of the resource, or the jurisdiction under which the resource is relevant Thiruthuvanathan M.M., Department of Computer Science and Engineering, School of Engineering and Technology, CHRIST (Deemed to be University), Bangalore, India; Krishnan B., Department of Computer Science and Engineering, School of Engineering and Technology, CHRIST (Deemed to be University), Bangalore, India