Unobtrusive Engagement Detection through Semantic Pose Estimation and Lightweight ResNet for an Online Class Environment
- Title
- Unobtrusive Engagement Detection through Semantic Pose Estimation and Lightweight ResNet for an Online Class Environment
- Creator
- Thiruthuvanathan M.M.; Krishnan B.; Rangaswamy M.
- Description
- Analysing student engagement in a class through unobtrusive methods enhances the learning and teaching experience. During these pandemic times, where the classes are conducted online, it is imperative to efficiently estimate the engagement levels of individual students. Helping teachers to annotate and understand the significant learning rate of the students is critical and vital. To facilitate the analysis of estimating the engagement levels among students, this paper proposes a dual channel model to precisely detect the attention level of individual students in a classroom. Considering the possible inaccuracy of emotion recognition, a dual channel is configured with a Lightweight ResNet model for macro-level attention estimation and a 3d pose estimation using Euler angles for Pitch, yaw and roll that is trained, validated and tested on the Daisee database. The Emotional detection extracts the context of Engaged, frustrated, confused and disgust as higher levels of classroom attention cognition while the facial pose coordinates provide the real-time movement of the faces in the video to provide a series of engaged and disengaged coordinates. The Lightweight ResNet Model achieves a 95.5% accuracy and the Pose estimation test is able to distinguish the test videos at 92% as Engaged and Bored on the Daisee Dataset. The Overall Accuracies using the Dual channel was curated to 87%. 2023 Scrivener Publishing LLC.
- Source
- Data Engineering and Data Science: Concepts and Applications, pp. 225-253.
- Date
- 2023-01-01
- Publisher
- wiley
- Subject
- convolutional neural network; emotion detection; facial pose estimation; facial recognition; residual networks; Student engagement detection
- Coverage
- Thiruthuvanathan M.M., Department of CSE, School of Engineering and Technology, CHRIST (Deemed to be University), Karnataka, Bengaluru, India; Krishnan B., Department of Psychology, School of Social Sciences, CHRIST (Deemed to be University), Karnataka, Bangalore, India; Rangaswamy M., Department of Psychology, School of Social Sciences, CHRIST (Deemed to be University), Karnataka, Bangalore, India
- Rights
- All Open Access; Bronze Open Access
- Relation
- ISBN: 978-111984199-9; 978-111984187-6
- Format
- Online
- Language
- English
- Type
- Book chapter
Collection
Citation
Thiruthuvanathan M.M.; Krishnan B.; Rangaswamy M., “Unobtrusive Engagement Detection through Semantic Pose Estimation and Lightweight ResNet for an Online Class Environment,” CHRIST (Deemed To Be University) Institutional Repository, accessed February 23, 2025, https://archives.christuniversity.in/items/show/18424.