Reducing approximation error with rapid convergence rate for non-negative matrix factorization (NMF)

Title

Reducing approximation error with rapid convergence rate for non-negative matrix factorization (NMF)

Creator

Biswas J.; Kayal P.; Samanta D.

Description

Non-Negative Matrix Factorization (NMF) is utilized in many important applications. This paper presents development of an efficient low rank approximate NMF algorithm for feature extraction related to text mining and spectral data analysis. NMF can be used for clustering. NMF factorizes a positive matrix A to two positive matrices W and H matrices where A = WH. The proposal uses k-means clustering algorithm to determine the centroid of each cluster and assigns the centroid coordinates of each cluster as one column for W matrix. The initial choice of W matrix is positive. The H matrix is determined with gradient descent algorithm based on thin QR optimization. The performance comparison of the proposed NMF algorithm is illustrated with results. The accurate choice of initial positive W matrix reduces approximation error and the use of thin QR algorithm in combination with gradient descent approach provides rapid convergence rate for NMF. The proposed algorithm is implemented with the randomly generated matrix in MATLAB environment. The number of significant singular values of the generated matrix is selected as the number of clusters. The error and convergence rate comparison of the proposed algorithm with the current algorithms are demonstrated in this research. The accurate measurement of execution time for individual program is not possible in MATLAB. The average time execution over 200 iterations is therefore calculated with an increasing iteration count of the proposed algorithm and the comparative results are presented. 2021 by authors, all rights reserved.

Source

Mathematics and Statistics, Vol-9, No. 3, pp. 285-289.

Date

2021-01-01

Publisher

Horizon Research Publishing

Subject

Clustering; Document Retrieval; Non-Negative Matrix Factorization (NMF); Singular Value Decomposition (SVD)

Coverage

Biswas J., Department of Computer Science, Christ University, Bangalore, India; Kayal P., Don Bosco School, Park Circus, Kolkata, India; Samanta D., Department of Computer Science, Christ University, Bangalore, India

Rights

All Open Access; Gold Open Access

Relation

ISSN: 23322071

Format

Online

Language

English

Type

Article

Identifier

https://doi.org/10.13189/ms.2021.090309

https://www.scopus.com/inward/record.uri?eid=2-s2.0-85105660636&doi=10.13189%2fms.2021.090309&partnerID=40&md5=c9a363a5ab129aff482b82d71e75c847