DRBM-ClustNet: A Deep Restricted Boltzmann-Kohonen Architecture for Data Clustering

J. Senthilnath*, G. Nagaraj, C. Sumanth Simha, Sushant Kulkarni, Meenakumari Thapa, M. Indiramma, Jon Atli Benediktsson

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

A Bayesian deep restricted Boltzmann-Kohonen architecture for data clustering termed deep restricted Boltzmann machine (DRBM)-ClustNet is proposed. This core-clustering engine consists of a DRBM for processing unlabeled data by creating new features that are uncorrelated and have large variance with each other. Next, the number of clusters is predicted using the Bayesian information criterion (BIC), followed by a Kohonen network (KN)-based clustering layer. The processing of unlabeled data is done in three stages for efficient clustering of the nonlinearly separable datasets. In the first stage, DRBM performs nonlinear feature extraction by capturing the highly complex data representation by projecting the feature vectors of d dimensions into n dimensions. Most clustering algorithms require the number of clusters to be decided a priori; hence, here, to automate the number of clusters in the second stage, we use BIC. In the third stage, the number of clusters derived from BIC forms the input for the KN, which performs clustering of the feature-extracted data obtained from the DRBM. This method overcomes the general disadvantages of clustering algorithms, such as the prior specification of the number of clusters, convergence to local optima, and poor clustering accuracy on nonlinear datasets. In this research, we use two synthetic datasets, 15 benchmark datasets from the UCI Machine Learning repository, and four image datasets to analyze the DRBM-ClustNet. The proposed framework is evaluated based on clustering accuracy and ranked against other state-of-the-art clustering methods. The obtained results demonstrate that the DRBM-ClustNet outperforms state-of-the-art clustering algorithms.

Original languageEnglish
Pages (from-to)2560-2574
Number of pages15
JournalIEEE Transactions on Neural Networks and Learning Systems
Volume35
Issue number2
DOIs
Publication statusPublished - 1 Feb 2024

Bibliographical note

Publisher Copyright:
© 2012 IEEE.

Other keywords

  • Bayesian information criterion (BIC)
  • data clustering
  • deep restricted Boltzmann machine (DRBM)
  • Kohonen network (KN)

Fingerprint

Dive into the research topics of 'DRBM-ClustNet: A Deep Restricted Boltzmann-Kohonen Architecture for Data Clustering'. Together they form a unique fingerprint.

Cite this