Cluster Contrast for Unsupervised Visual Representation Learning
Nikolaos Giakoumoglou, Tania Stathaki · 2025
Read Cluster Contrast for Unsupervised Visual Representation Learning by Nikolaos Giakoumoglou, Tania Stathaki (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12359.txt.
Introduction
Giakoumoglou and Stathaki teach computers to learn from unlabeled images in a 2025 paper. Labels are costly, so methods learn by comparing images instead. Their scheme, CueCo, marries that contrast style with clustering.
Two networks, a query and a slow-moving key, process the images. A contrast loss pushes unlike features apart, sharpening class borders. A clustering goal pulls same-cluster features together, tightening each group. On standard test sets the method scored about ninety-one percent on CIFAR-10 and sixty-nine on CIFAR-100 with a modest backbone. ImageNet-100 reached about seventy-nine percent. The pair argue the blend of spreading and grouping is a fresh direction for label-free vision.
Catalog record
| CREATOR | Nikolaos Giakoumoglou, Tania Stathaki |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-12359
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cluster Contrast for Unsupervised Visual Representation Learning Nikolaos Giakoumoglou, Tania Stathaki Abstract We introduce Cluster Contrast (CueCo), a novel approach to unsupervised visual representation learning that effectively combines the strengths of contrastive learning and clustering methods. Inspired by recent advancements, CueCo is designed to simultaneously scatter and align feature representations within the feature space. This method utilizes two neural networks, a query and a key, where the key network is updated through a slow-moving average of the query outputs. CueCo employs a contrastive loss to push dissimilar features apart, enhancing inter-class separation, and a clustering objective to pull together features of the same cluster, promoting intra-class compactness. Our method achieves 91.40% top-1 classification accuracy on CIFAR-10, 68.56% on CIFAR-100, and 78.65% on ImageNet-100 using linear evaluation with a ResNet-18 backbone. By integrating contrastive learning with clustering, CueCo sets a new direction for advancing unsupervised visual representation learning. † † address: Department of Electrical and Electronic Engineering, Imperial College London, London, UK {nikos, t.stathaki}@imperial.ac.uk 1 Introduction Self-supervised learning focuses on extracting features without relying on manual annotations, increasingly closing the performance gap with supervised training techniques in computer vision. Recent state-of-the-art methods in contrastive learning treat each image and its variations as distinct classes, yielding representations that can discriminate between different images while achieving invariance to image transformations. Key to these methods are two fundamental components: (a) a contrastive loss mechanism [ 1 ] and (b) a series of image transformations [ 2 ] . Both elements are crucial for the performance of the resulting models [ 2 , 3 ] . Unlike contrastive learning, which primarily focuses on intra-image invariance, clustering-based methods enable exploration of similarities between different images [ 4 ] . While initial assessments of these methods were generally conducted on smaller datasets [ 5 ] , recent approaches have advanced clustering-based representation learning to larger scales [ 4 ] . Specifically, these methods generate pseudo-labels through clustering, which then serve as supervision for subsequent training [ 6 ] . Recent innovations have simplified this process by performing clustering and network updates simultaneously, enhancing the adaptation of the model to evolving data characteristics [ 7 ] . In this work, we introduce Cluster Contrast (CueCo), a novel self-supervised learning framework designed to enhance visual representation learning by leveraging the synergistic effects of contrastive learning and clustering methodologies (see Figure 1 ). Inspired by the “push-pull” dynamics observed in physical forces, CueCo utilizes a dual mechanism that optimizes the feature space: the contrastive component, leveraging the InfoNCE loss [ 8 ] , effectively “pushes” dissimilar representations apart, akin to repulsive forces, ensuring that distinct classes are well-separated. Concurrently, the clustering component “pulls” similar representations closer, analogous to attractive forces, promoting tighter clusters of like data points. We make the following contributions : (a) We introduce a novel unsupervised method that employs a dual mechanism to optimize the feature space through “push-pull” dynamics, effectively leveraging both contrastive and feature space clustering losses to refine feature discriminability; (b) We provide a comprehensive theoretical analysis of the objectives of our framework, illustrating how the integration of contrastive loss with feature space clustering losses cohesively enhances feature representation; (c) We demonstrate state-of-the-art performance on CIFAR-10, CIFAR-100, and ImageNet-100, underscoring the effectiveness of CueCo. Figure 1: CueCo framework. Like typical contrastive methods, CueCo processes two augmented views, v and v^{\prime} , of the same image x through encoders f_{\theta} and f_{\xi} , producing feature vectors \mathbf{z}=f_{\theta}(v) and \mathbf{z^{\prime}}=f_{\xi}(v^{\prime}) . In addition to that, CueCo: (a) enforces inter-class separation via contrastive loss, (b) improves intra-class cohesion through clustering, and (c) integrates both for refined feature representation. 2 Related Work 2.1 Contrastive Methods Contrastive learning employs instance discrimination, where each image is treated as a unique class. This approach pulls together anchor and “positive” samples while pushing apart “negative” samples [ 2 ] . Positive pairs are generated through multiple views like augmentations [ 2 , 9 ] , patches [ 8 ] , or teacher-student models [ 10 , 11 ] . Training typically uses InfoNCE-based objectives [ 8 , 2 ] . To address computational constraints, methods like MoCo [ 9 ] introduce memory structures. Recent approaches eliminate negative samples [ 10 , 12 ] or use regularization [ 13 , 14 , 15 ] to prevent collapse, while others enhance learning through synthetic negatives [ 16 ] . 2.2 Clustering Methods Clustering approaches like DeepCluster [ 6 ] use K-means to form groups and learn features iteratively. While ODC [ 17 ] and CoKe [ 18 ] attempt to improve this process, the inherent delay in supervisory signals remains problematic. SwAV [ 4 ] reframes grouping as pseudo-labelling with optimal transport, though their equipartition constraints may reduce grouping effectiveness. Alternative approaches include prototype-based methods [ 19 ] , momentum clusters [ 7 ] , and contrastive clustering [ 20 ] which treats rows and columns of feature matrices as instance and cluster representations directly. However, our approach differs by introducing separate instance-level and cluster-level queues with both soft and hard assignments, providing more flexible feature learning. 3 Methodology 3.1 Contrastive Learning Contrastive learning serves as the backbone of our framework, primarily focusing on scattering features across the feature space to enhance their discriminability. Contrastive learning seeks to differentiate between similar and dissimilar data pairs. We utilize a dual-crop strategy, similar to the methods in [ 2 , 9 ] , with random data augmentations. Given an image x , and two distributions of image augmentation \mathcal{T} and \mathcal{T}^{\prime} , we create two augmented views of the same image using the transformation t\sim\mathcal{T} and t^{\prime}\sim\mathcal{T}^{\prime} , i.e., v=t(x) and v^{\prime}=t^{\prime}(x) . Two encoders, f_{\theta} and f_{\xi} , generate the vectors \mathbf{z}=f_{\theta}(v) and \mathbf{z^{\prime}}=f_{\xi}(v^{\prime}) respectively. The learning objective minimizes a contrastive loss using the InfoNCE criterion [ 8 ] : \mathcal{L}_{\text{1}}(\mathbf{z},\mathbf{z^{\prime}})=-\log\frac{\exp(\mathbf{z}^{\top}\cdot\mathbf{z}^{\prime}/\tau)}{\exp(\mathbf{z}^{\top}\cdot\mathbf{z}^{\prime}/\tau)+\sum\limits_{k=1}^{K}\exp(\mathbf{z}^{\top}\cdot\mathbf{z}_{k}/\tau)} (1) where, \mathbf{z}^{\prime} is f_{\xi} ’s output from the same augmented image as \mathbf{z} , and \{\mathbf{z}_{k}\}_{k=1}^{K} includes outputs from different images, representing negative samples. The temperature parameter \tau adjusts scaling for the \ell_{2} -normalized vectors \mathbf{z} and \mathbf{z}^{\prime} . This loss function scatters the feature representations by forcing them to occupy distinct points in the feature space, reducing the likelihood of different instances collapsing into indistinguishable points. Following [ 9 , 21 ] , we maintain a queue of negative keys, refreshing only the queries and positive keys in each training batch. A momentum encoder updates the base encoder to ensure consistent representations across updates \xi\leftarrow m\cdot\xi+(1-m)\cdot\theta , where m is the momentum coefficient [ 9 , 10 ] . 3.2 Feature Space Clustering Beyond contrastive learning, our goal is to develop an encoder that groups images of the same class into distinct regions of the feature space. While contrastive learning spreads the feature vectors of different classes, we introduce an objective to pull together features of the same class, forming tight clusters. Since true class labels are not available during pretraining, we apply a clustering algorithm, such as K-means, to infer pseudo-classes. We then gather pre-softmax features, termed activation vectors, from images classified under the same pseudo-class. With this, we can store a running average class prototype, or mean activation vector, \mathbf{c_{i}} , given a key \mathbf{z^{\prime}}=f_{\xi}(x) that belongs to the set