A Comparative Analysis of L1, L2, and L1L2 Regularization Techniques in Neural Networks for Image Classification
- Title
- A Comparative Analysis of L1, L2, and L1L2 Regularization Techniques in Neural Networks for Image Classification
- Creator
- Deepa, S.; Siddalingappa, Rashmi; Kalpana, P.; Loveline, Zeema.J.; Vinay, M.; Jayapriya; Suganthi, J.J.; Priya Stella Mary, I.
- Description
- The research examines how L1, L2, and L1L2 weight regularization methods affect neural network performance, generalization, and sparsity using the CIFAR 10 dataset. A Convolutional Neural Network (CNN) trained with the same environment for each regularization method to evaluate test accuracy, weight sparsity, and computational speed. The study shows that L1 regularization produces sparse weights, which makes models more interpretable, and L2 regularization helps prevent overfitting while improving model generalization. The combination of L1L2 regularization enables individual image classification methods to reach test accuracy. The results indicate that the weight regularization plays a vital role in creating neural networks that are both stable and efficient. They are interpretable, and L2 regularization improves generalization and reduces overfitting. The combined L1L2 regularization achieves the balance between sparsity and performance, leading to higher test accuracy compared to individual techniques for image classification. The research results demonstrate that weight regularization stands as an essential factor for Creating Neural Networks that are robust, efficient, and interpretable, thus helping to enhance Deep Learning model performance. 2025 Seventh Sense Research Group.
- Source
- International Journal of Engineering Trends and Technology;Volume;73;Issue;10;pp.107-116
- Date
- 01-01-2025
- Publisher
- Seventh Sense Research Group
- Subject
- Convolutional Neural Networks (CNN); Deep Learning; Generalization; L1 Regularization; L1L2 Regularization; L2 Regularization; Overfitting; Weight Regularization
- Coverage
- Deepa S., Department of Computer Science, Christ University, Bengaluru, India; Siddalingappa R., York St Jhon University, London, United Kingdom; Kalpana P., Department of Computer Science, Christ University, Bengaluru, India; Loveline Z.J., Department of Computer Science, Christ University, Bengaluru, India; Vinay M., Department of Computer Science, Christ University, Bengaluru, India; Jayapriya, Department of Computer Science, Christ University, Bengaluru, India; Suganthi J.J., Department of Computer Science, Christ University, Bengaluru, India; Priya Stella Mary I., Department of Computer Science, Christ University, Bengaluru, India
- Rights
- Restricted Access; Hardcopy may be available in the library
- Relation
- ISSN: 23490918;
- Format
- online
- Language
- English
- Type
- Article
Collection
Citation
Deepa, S.; Siddalingappa, Rashmi; Kalpana, P.; Loveline, Zeema.J.; Vinay, M.; Jayapriya; Suganthi, J.J.; Priya Stella Mary, I., “A Comparative Analysis of L1, L2, and L1L2 Regularization Techniques in Neural Networks for Image Classification,” CHRIST (Deemed To Be University) Institutional Repository, accessed June 19, 2026, https://archives.christuniversity.in/items/show/23256.