Discovering patterns using feature selection techniques and correlation
- Title
- Discovering patterns using feature selection techniques and correlation
- Creator
- Goswami M.; Purkayastha B.S.
- Description
- Term Frequency and inverse document frequency is reported to have a significant contribution for various text categorization, document clustering and many other text mining related tasks. A collection of the applications and the enhancements of the Term Frequency and Inverse Document Frequency based document representation technique is examined in this work. The document representation algorithm is essential in the field of text - script mining. In this algorithm, unstructured data is converted into a vector space model where each related document is considered as a point in the vector space. Related documents come in proximity to the other related documents while the documents that are very far away from being coherent remain different from each other. In this paper, four feature selection techniques are implemented to discover the patterns from a repository of unstructured data by using correlation similarity measure. Analysis and comparison with other existing technique is also included. The validation of the patterns formed is performed by using silhouette values. Experiments are conducted to compare performance. Results indicate that TDMp1 performance is poor compared to others. Springer Nature Switzerland AG 2020.
- Source
- Lecture Notes on Data Engineering and Communications Technologies, Vol-46, pp. 824-831.
- Date
- 2020-01-01
- Publisher
- Springer Science and Business Media Deutschland GmbH
- Subject
- Applications; Augmented frequency; Correlation similarity; Feature selection; TF-IDF
- Coverage
- Goswami M., CHRIST (Deemed to be University), Bangalore, 560074, India, Assam University, Silchar, Assam, India; Purkayastha B.S., Assam University, Silchar, Assam, India
- Rights
- Restricted Access
- Relation
- ISSN: 23674512
- Format
- Online
- Language
- English
- Type
- Book chapter
Collection
Citation
Goswami M.; Purkayastha B.S., “Discovering patterns using feature selection techniques and correlation,” CHRIST (Deemed To Be University) Institutional Repository, accessed April 24, 2025, https://archives.christuniversity.in/items/show/18856.