Benchmarking Ensemble Methods: Stacking, Hard Voting, and Soft Voting
subject: AUC-ROC curve; Confusion matrix; F1 score; Homogenous stacking; Plant disease prediction
description: This study evaluates three ensemble techniquesbasic stacking, hard voting, and soft votingfor predicting diabetes onset using the Pima Indians Diabetes dataset. While traditional methods often focus on single models, this research emphasizes the benefits of combining models like Cat Boost, random forest, logistic regression, linear discriminant analysis, and gradient boosting classifier (LightGBM) within ensemble frameworks. The models were rigorously assessed using metrics for evaluation such as AUC-ROC curves, confusion matrices, F1 scores, etc. The advanced calibrated model achieved the highest performance, with an accuracy of 90.10%, precision of 90.32%, recall of 81.16%, and an F1 score of 85.50%. The soft voting model also delivered strong results, with an accuracy of 89.06%, precision of 87.50%, recall of 81.16%, and F1 score of 84.21%. In comparison, the hard voting model recorded an accuracy of 88.02%, precision of 85.94%, recall of 79.71%, and F1 score of 82.71%. These results highlight the potential of advanced ensemble methods to enhance predictive accuracy. Future work could involve integrating these models with real-time monitoring systems for improved healthcare diagnostics and applying them to diverse datasets and medical conditions. The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.
creator: George, Jossy; Yadav, Jai; Nair, Akhil M.
source: Lecture Notes in Networks and Systems;Volume;1371 LNNS;pp.315-328
publisher: Springer Science and Business Media Deutschland GmbH
date: 01-01-2025
rights: Restricted Access; Hardcopy may be available in the library
relation: ISSN: 23673370; ISBN: 978-981965722-3;
language: English
type: Conference paper
coverage: George J., CHRIST (Deemed to be University), Bangalore, India; Yadav J., CHRIST (Deemed to be University), Bangalore, India; Nair A.M., CHRIST (Deemed to be University), Bangalore, India