Enhancing Sign Language Recognition Through LSTM Model

Title

Enhancing Sign Language Recognition Through LSTM Model

Creator

Helen Josephine, V.L.; Rajagopal, Manikandan; Kavitha, S.; Rajendran, Stuthi

Description

Sign language recognition is a remarkable task in this project completed through two state-of-the-art methods, Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU). This way, the system is able to quickly process each frame of the webcam with real-time information regarding face, body and posture in order to extract critical values. this research seeks to provide the necessary resources and opportunities for deaf people to be able to communicate effectively, obtain an education and enjoy their lives as much as other human beings This makes it a very important tool for education where the system can convert sign motions into text on-the-fly. The data was collected through a live camera, and key points from face, body, and pose were detected for training the model. Kindergarten used the four categories of vegetables, fruits, colors and animals. There were 40 video sequences of 40 frames with a sign in each. the model tries to fit too much to noisy points of data. However comprehensive the training, after 19 epochs the validation accuracy is an impressive 93%. The oscillations in the truth values of models are indicative of some uncertainty in learning where the accuracy is still to be settled. The graph in general shows that the LSTM based sign language movement classifier has a good capacity to learn and identify sign language movements with high precision. 2025 IEEE.

Source

4th International Conference on Sentiment Analysis and Deep Learning, ICSADL 2025 - Proceedings;pp.986-989

Date

01-01-2025

Publisher

Institute of Electrical and Electronics Engineers Inc.

Subject

Education for hearing impaired; GRU; Image/video recognition; LSTM; Machine Learning; Sign Language

Coverage

Helen Josephine V.L., School of Business and Management, Christ University, Karnataka, Bangalore, India; Rajagopal M., School of Business and Management, Christ University, Karnataka, Bangalore, India; Kavitha S., Dayanand Sagar University, Bengaluru, India; Rajendran S., School of Business and Management, Christ University, Karnataka, Bangalore, India

Rights

Restricted Access; Hardcopy may be available in the library

Relation

ISBN: 979-833152392-3;

Format

online

Language

English

Type

Conference paper

Identifier

https://doi.org/10.1109/ICSADL65848.2025.10933396

https://www.scopus.com/pages/publications/105002463659?origin=resultslist