Performance Evaluation of Transfer Learning VGG16 in Handwritten Text Using Word Beam Search and Language Model

Title

Performance Evaluation of Transfer Learning VGG16 in Handwritten Text Using Word Beam Search and Language Model

Creator

Kavitha, K.P.; Kirubanand, V.B.

Description

This study evaluates the performance of transfer learning using the VGG16 model for handwritten text recognition, integrating Word Beam Search decoding and language modeling techniques. The VGG16 model, pre-trained on large-scale datasets, serves as a feature extractor for handwritten text images, capturing intricate patterns and structures inherent in handwriting. To convert these visual features into textual information, the system employs a Recurrent Neural Network (RNN) trained with the Connectionist Temporal Classification (CTC) loss function, producing a matrix of character probabilities for each time-step. The Word Beam Search algorithm is utilized for decoding these probabilities into coherent text, effectively constructing recognized text by referencing a predefined dictionary and addressing challenges such as arbitrary character strings and varying handwriting styles. The integration of language models incorporates context which further sharpens the output and improves precision and trustworthiness of recognition systems. Experimental results demonstrate that this combined approach significantly improves recognition performance, highlighting the efficacy of transfer learning and advanced decoding strategies in handwritten text recognition. This involves analyzing its effectiveness across various datasets. Transfer learning leverages pre-trained models, like VGG16, to address challenges such as limited labeled data and extensive training times. 2025, Innovative Information Science and Technology Research Group. All rights reserved.

Source

Journal of Internet Services and Information Security;Volume;15;Issue;2;pp.536-551

Date

01-01-2025

Publisher

Innovative Information Science and Technology Research Group

Subject

CNN; CTC; FSM; HTR; LM; NN; RNN; VGG

Coverage

Kavitha K.P., Department of Computer Science, CHRIST (Deemed to be University), Bengaluru, India; Kirubanand V.B., Department of Computer Science, CHRIST (Deemed to be University), Bengaluru, India

Rights

All Open Access; Gold Open Access

Relation

ISSN: 21822069;

Format

online

Language

English

Type

Article

Identifier

https://doi.org/10.58346/JISIS.2025.I2.037

https://www.scopus.com/pages/publications/105012537403?origin=resultslist