Comparative Analysis of Classification Models Using Various Feature Sets

Title

Comparative Analysis of Classification Models Using Various Feature Sets

Creator

Nagaraj, Akash; J., Jayapriya; S., Deepa; M., Vinay

Description

Feature selection is a fundamental step in Machine Learning (ML) that involves choosing some input data that would enhance the model performance. The model is able to run faster using lesser computational resources while giving reasonable results. Hence, feature selection as important as selection of a good model. In this chapter the aim is to analyze how the performance of different multiclass classification algorithms is affected on different features. The algorithms used are K-Nearest Neighbor (KNN), Support Vector Machines (SVM), Linear Discriminant Analysis (LDA), and Convolutional Neural Network (CNN) on the CIFAR-10 dataset. To obtain the new dataset with modified features, we use dimension reduction methods on the original dataset. The new dataset is at least 500x smaller, and we have noticed that in the best case scenarios reducing dimensions reduces the accuracy score only marginally. The SVM is the most consistent among the experimented models. The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

Source

Lecture Notes in Electrical Engineering;Volume;1269;pp.141-154

Date

01-01-2025

Publisher

Springer Science and Business Media Deutschland GmbH

Subject

CNN; KNN; LDA; NMDS; PCA; SVM; tSNE

Coverage

Nagaraj A., CHRIST (Deemed to be University), Bangalore, India; J. J., CHRIST (Deemed to be University), Bangalore, India; S. D., CHRIST (Deemed to be University), Bangalore, India; M. V., CHRIST (Deemed to be University), Bangalore, India

Rights

Restricted Access; Hardcopy may be available in the library

Relation

ISSN: 18761100; ISBN: 978-981979514-7;

Format

online

Language

English

Type

Conference paper

Identifier

https://doi.org/10.1007/978-981-97-9515-4_11

https://www.scopus.com/pages/publications/105003894987?origin=resultslist