Benchmarking Ensemble Methods: Stacking, Hard Voting, and Soft Voting

Title

Benchmarking Ensemble Methods: Stacking, Hard Voting, and Soft Voting

Creator

George, Jossy; Yadav, Jai; Nair, Akhil M.

Description

This study evaluates three ensemble techniquesbasic stacking, hard voting, and soft votingfor predicting diabetes onset using the Pima Indians Diabetes dataset. While traditional methods often focus on single models, this research emphasizes the benefits of combining models like Cat Boost, random forest, logistic regression, linear discriminant analysis, and gradient boosting classifier (LightGBM) within ensemble frameworks. The models were rigorously assessed using metrics for evaluation such as AUC-ROC curves, confusion matrices, F1 scores, etc. The advanced calibrated model achieved the highest performance, with an accuracy of 90.10%, precision of 90.32%, recall of 81.16%, and an F1 score of 85.50%. The soft voting model also delivered strong results, with an accuracy of 89.06%, precision of 87.50%, recall of 81.16%, and F1 score of 84.21%. In comparison, the hard voting model recorded an accuracy of 88.02%, precision of 85.94%, recall of 79.71%, and F1 score of 82.71%. These results highlight the potential of advanced ensemble methods to enhance predictive accuracy. Future work could involve integrating these models with real-time monitoring systems for improved healthcare diagnostics and applying them to diverse datasets and medical conditions. The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

Source

Lecture Notes in Networks and Systems;Volume;1371 LNNS;pp.315-328

Date

01-01-2025

Publisher

Springer Science and Business Media Deutschland GmbH

Subject

AUC-ROC curve; Confusion matrix; F1 score; Homogenous stacking; Plant disease prediction

Coverage

George J., CHRIST (Deemed to be University), Bangalore, India; Yadav J., CHRIST (Deemed to be University), Bangalore, India; Nair A.M., CHRIST (Deemed to be University), Bangalore, India

Rights

Restricted Access; Hardcopy may be available in the library

Relation

ISSN: 23673370; ISBN: 978-981965722-3;

Format

online

Language

English

Type

Conference paper

Identifier

https://doi.org/10.1007/978-981-96-5723-0_23

https://www.scopus.com/pages/publications/105018920550?origin=resultslist