Enhancing Sign Language Recognition Through LSTM Model
subject: Education for hearing impaired; GRU; Image/video recognition; LSTM; Machine Learning; Sign Language
description: Sign language recognition is a remarkable task in this project completed through two state-of-the-art methods, Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU). This way, the system is able to quickly process each frame of the webcam with real-time information regarding face, body and posture in order to extract critical values. this research seeks to provide the necessary resources and opportunities for deaf people to be able to communicate effectively, obtain an education and enjoy their lives as much as other human beings This makes it a very important tool for education where the system can convert sign motions into text on-the-fly. The data was collected through a live camera, and key points from face, body, and pose were detected for training the model. Kindergarten used the four categories of vegetables, fruits, colors and animals. There were 40 video sequences of 40 frames with a sign in each. the model tries to fit too much to noisy points of data. However comprehensive the training, after 19 epochs the validation accuracy is an impressive 93%. The oscillations in the truth values of models are indicative of some uncertainty in learning where the accuracy is still to be settled. The graph in general shows that the LSTM based sign language movement classifier has a good capacity to learn and identify sign language movements with high precision. 2025 IEEE.
creator: Helen Josephine, V.L.; Rajagopal, Manikandan; Kavitha, S.; Rajendran, Stuthi
source: 4th International Conference on Sentiment Analysis and Deep Learning, ICSADL 2025 - Proceedings;pp.986-989
publisher: Institute of Electrical and Electronics Engineers Inc.
date: 01-01-2025
rights: Restricted Access; Hardcopy may be available in the library
relation: ISBN: 979-833152392-3;
language: English
type: Conference paper
coverage: Helen Josephine V.L., School of Business and Management, Christ University, Karnataka, Bangalore, India; Rajagopal M., School of Business and Management, Christ University, Karnataka, Bangalore, India; Kavitha S., Dayanand Sagar University, Bengaluru, India; Rajendran S., School of Business and Management, Christ University, Karnataka, Bangalore, India