Ensemble of Unsupervised Deep Learning for Clustering Imbalanced Tabular Data

Pulock Das, Yina Hou, Md. Kamrozzaman Bhuiyan, Manar D. Samad · 2026

Read Ensemble of Unsupervised Deep Learning for Clustering Imbalanced Tabular Data by Pulock Das, Yina Hou, Md. Kamrozzaman Bhuiyan, Manar D. Samad (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2608-00346.txt.

Introduction

Das and co-authors test deep clustering ensembles on skewed tabular data. Skew hurts supervised methods through majority-class bias. False negatives grow, and accuracy reads too high. Clustering learns with no class labels, so it can dodge that bias. Deep clustering for tabular data is still new, though.

They run top deep clustering methods under varied skew levels. Two ensemble designs are new here. One merges outputs across embedding sizes. The other votes among the best methods. Sixteen binary tabular sets carry the tests, with skew set by hand. On average, the ensembles beat single methods on ACC, NMI, and ARI. Deep clustering is a strong label-free option under skew, they conclude.

Catalog record

CREATORPulock Das, Yina Hou, Md. Kamrozzaman Bhuiyan, Manar D. Samad
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2608.00346

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Ensemble of Unsupervised Deep Learning for Clustering Imbalanced Tabular Data Pulock Das, Yina Hou, Md. Kamrozzaman Bhuiyan, Manar D. Samad Abstract Data imbalance poses a major challenge in supervised classification, where the majority-class bias contributes to false negatives and overestimates classification accuracy. Unsupervised deep clustering can be immune to class imbalance because representation learning for clustering is performed without class labels. Deep clustering has been proposed for images, languages, and graphs, while its application to tabular data has only emerged recently. This paper is among the first to examine the performance of state-of-the-art deep clustering methods under varying levels of data imbalance. We introduce two novel cluster ensemble approaches: one aggregates deep clustering assignments across different embedding dimensions, and the other applies majority voting to the best-performing clustering algorithms. Experiments on 16 binary tabular datasets with varying and artificially induced levels of imbalance reveal distinct strengths of different deep clustering methods. On average, our ensemble methods outperform individual clustering methods in ACC, NMI, and ARI scores, offering greater resilience to data imbalance when identifying ground-truth classes without supervision. Therefore, in imbalance data settings, deep clustering can serve as a strong alternative to supervised classification. September 16, 2026 K eywords deep clustering, ensemble method, tabular data, imbalanced data, uneven clusters 1 Introduction The deep learning revolution has largely centered on vision and language models, which have been repurposed for a vast range of supervised classification tasks. Supervised classification tasks are entirely dependent on labeled data in which class labels drive model training and performance. Model training supervised by class labels makes classifier models prone to overfitting and highly vulnerable to the well-known problem of class imbalance. Therefore, deep learning solutions for unsupervised data clustering can obviate the need for data labeling and may alleviate overfitting and data imbalance problems. Deep clustering approaches have been developed predominantly for image [ 3 ] , language [ 27 ] , and graph data [ 17 ] , largely overlooking one of the most prevalent data formats, namely tabular data [ 1 ] . The clustering of tabular data still relies on traditional K -means clustering because a robust learning objective to train a deep neural network without involving class labels is not trivial. This paper investigates the performance of several newly proposed state-of-the-art deep clustering methods for tabular data with a three-fold objective. First, the paper evaluates and compares state-of-the-art deep clustering approaches, as these methods have not been systematically assessed against each other in earlier work. Second, we investigate the effectiveness of the proposed ensemble of deep clustering inferences in matching the actual class labels. Third, the state-of-the-art methods are evaluated at varying rates of data imbalance. The findings of this paper may provide useful directions for addressing major shortcomings of supervised classifiers in deep learning by effectively leveraging cutting-edge deep clustering methods. 2 Related work Deep clustering methods primarily learn cluster-friendly representations (embedding) for images [ 26 , 10 ] without using class labels. Clustering performance against the original class labels demonstrates the effectiveness of deep representation learning without class supervision. Various deep representation learning methods have been proposed for image datasets [ 2 , 9 , 7 , 18 ] due to the underperformance of traditional clustering algorithms, such as K-means, in high-dimensional pixel spaces. In contrast, traditional clustering methods (e.g., K-means) are a de facto choice for structured tabular data with raw features, whereas deep learning methods have not shown much success. However, K-means clustering performance is sensitive to the presence of uneven clusters [ 29 ] , which is equivalent to data imbalance in classification. Recent deep clustering methods for tabular data [ 19 , 5 , 24 , 28 , 25 ] perform well on only a subset of datasets, and their robustness has not yet been systematically benchmarked to establish the state of the art. Among recent methods, Gaussian Cluster Embedding in Autoencoder Latent Space (G-CEALS) [ 19 ] learns the Gaussian distribution parameters of cluster embeddings in a deep learning framework. Despite competitive performance against traditional clustering, the performance of G-CEALS is sensitive to the embedding dimension. Quaternion Graph Representation Learning (QGRL) [ 5 ] uses heterogeneous data graphs to capture data relationships at different levels, such as between individual values, features, feature types, and samples. QGRL simultaneously optimizes a graph reconstruction and a spectral clustering objective to obtain a quaternion-based graph representation, which rotates feature vectors within a four-dimensional space. It outperforms several traditional and graph-based clustering methods on selective datasets. Interpretable Deep Clustering (IDC) [ 24 ] is a tabular deep clustering method that learns cluster assignments leveraging feature-level explanations. A neural clustering head assigns samples to clusters by minimizing a coding-rate objective, which encourages well-separated clusters while keeping samples within each cluster tightly grouped. However, the performance of IDC is limited to high-dimensional biomedical tabular datasets. TabClustPFN [ 28 ] extends a transformer-based tabular data classification framework, Tabular Prior-Data Fitted Network (TabPFN) [ 12 ] , to unsupervised clustering. TabClustPFN is pretrained in synthetic data clustering to subsequently cluster unseen tabular data in a single forward pass (zero-shot). Without requiring per-dataset retraining, TabClustPFN demonstrates state-of-the-art performance on synthetic and real-world tabular benchmarks. However, TabPFN methods can process a limited number of test samples due to memory limitations. Deep Clustering using the Soft Silhouette (DCSS) [ 25 ] optimizes a soft silhouette score using autoencoder-based deep clustering. Maximizing the silhouette score promotes compact and well-separated clusters. However, DCSS has so far been evaluated on only four tabular datasets. In addition, these existing methods rely on a fixed embedding dimension and do not systematically investigate the effect of this model hyperparameter on clustering performance. This paper seeks to address three important gaps in the existing literature. First, individual deep clustering methods are generally evaluated on selective datasets. The literature does not report comparative performance of deep clustering methods for tabular datasets. Second, there is no single clustering algorithm that consistently achieves the best performance on every possible dataset. By aggregating the output of several clustering methods into an ensemble of cluster assignments, we may reduce the limitations of a single method. Third, it remains unknown how well deep clustering performs when faced with different degrees of class imbalance in tabular datasets. In deep representation learning, samples from the minority class can be absorbed into the majority class, leading to collapsed clusters within the latent space of an autoencoder [ 19 ] . A clustering approach that shows robust performance under high class imbalances has an advantage over supervised classification techniques, which are strongly affected by this issue. 3 Background 3.1 Preliminaries A tabular dataset (X,y) consists of N samples, each D -dimensional, where X\in\mathbb{R}^{N\times D} , and the corresponding class labels are denoted as y\in\mathbb{Z}_{+}^{N} . Given a total of C distinct classes, a perfectly uniform class distribution is achieved when each class has N_{k}=\frac{N}{C} samples, for k=\{1,2,\ldots,C\} . Class imbalance occurs when there is substantial inequality in the class distribution, represented as { N_{1}<N_{2}<\ldots<N_{C} }, such that the size ratio between the majority class ( N_{mj} ) and the minority class ( N_{mn} ) can range from tenfold to one hundredfold. Some examples of highly imbalanced data scenarios include patient samples with a diagnosis

Read the complete text