Center-Oriented Prototype Contrastive Clustering

1 st Shihao Dong, 2 nd Xiaotong Zhou, 3 rd Yuhui Zheng, 4 th Huiying Xu ⋆, 5 th Xinzhong Zhu · 2025

Read Center-Oriented Prototype Contrastive Clustering by 1 st Shihao Dong, 2 nd Xiaotong Zhou, 3 rd Yuhui Zheng, 4 th Huiying Xu ⋆, 5 th Xinzhong Zhu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15231.txt.

Introduction

Grouping data into clusters without labels works better when each group is summed up by a prototype, a stand-in centre. Shihao Dong and four co-authors sharpen that trick in 2025. Past prototype methods work the centre out from hard picks, which can drift from the true centre and can pull groups into clash.

Their soft method weighs each sample by its chance of belonging to a group when the centre is built. That cuts drift and eases the clash between groups. A twin check then lines up two warped views of the same sample, and lines up near neighbours across samples. The blend keeps each group's points tight while their meaning holds steady under warps. The frame is tested as a general tool for cluster work.

Catalog record

CREATOR1 st Shihao Dong, 2 nd Xiaotong Zhou, 3 rd Yuhui Zheng, 4 th Huiying Xu ⋆, 5 th Xinzhong Zhu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-15231

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Center-Oriented Prototype Contrastive Clustering Thanks: ⋆ Corresponding author. This work was funded in part by the National Natural Science Foundation of China (92470202, 62272468 and 62376252); Key Project of Natural Science Foundation of Zhejiang Province (LZ22F030003); Zhejiang Province Leading Geese Plan (2025C02025, 2025C01056); Zhejiang Province Province-Land Synergy Program (2025SDXT004-3). 1 st Shihao Dong, 2 nd Xiaotong Zhou, 3 rd Yuhui Zheng, 4 th Huiying Xu ⋆, 5 th Xinzhong Zhu Abstract Contrastive learning is widely used in clustering tasks due to its discriminative representation. However, the conflict problem between classes is difficult to solve effectively. Existing methods try to solve this problem through prototype contrast, but there is a deviation between the calculation of hard prototypes and the true cluster center. To address this problem, we propose a center-oriented prototype contrastive clustering framework, which consists of a soft prototype contrastive module and a dual consistency learning module. In short, the soft prototype contrastive module uses the probability that the sample belongs to the cluster center as a weight to calculate the prototype of each category, while avoiding inter-class conflicts and reducing prototype drift. The dual consistency learning module aligns different transformations of the same sample and the neighborhoods of different samples respectively, ensuring that the features have transformation-invariant semantic information and compact intra-cluster distribution, while providing reliable guarantees for the calculation of prototypes. Extensive experiments on five datasets show that the proposed method is effective compared to the SOTA. Our code is published on https://github.com/LouisDong95/CPCC. I Introduction In the data-driven world, deep clustering, as a basic tool for exploring the intrinsic structure and patterns of high-dimensional data, has been a research hotspot in the fields of deep learning and data mining. In recent years, contrastive learning [ 1 , 2 ] has been widely used in clustering tasks due to its ability to efficiently learn feature representations of data without expensive labels by using the information of the data itself as training signals. Fig. 1: Our motivation . The circular squares represent samples with different transformations. The prototypes are calculated by random sampling. The hard prototype calculation treats each sample equally, causing the calculated prototype to deviate from the true cluster center. The soft prototype assigns higher weights to samples close to the cluster center and reduces the weights of distant points, so that the calculated prototype is closer to the true cluster center Although some works [ 3 , 4 , 5 , 6 ] have achieved good performance by combining deep clustering with contrastive learning, contrastive learning treats the same samples and their transformations as positive pairs, while the remaining samples are treated as negative pairs. Negative pairs contain samples of the same class with the same semantic information, which inevitably leads to inter-class conflicts, thereby destroying the discriminative information. Therefore, how to alleviate false pairs has always been a hot topic of concern in contrastive learning. Most existing methods alleviate the impact of false pairs by reducing the weight of false negative pairs and mining false positive pairs. GCC [ 7 ] constructs positive pairs through the adjacency graph, and NNM [ 6 ] constructs positive pairs by combining local and global neighbors. GDCL [ 8 ] deleted false negative samples that are similar to the original samples through a bias elimination strategy. TCL [ 9 ] removed the false negative samples from the contrastive loss denominator. HSAN [ 10 ] reduced the weight between easy sample pairs and increased the weight between difficult sample pairs. DIVIDE [ 11 ] reduces the weight of false positive samples through random walks. Although conflicts between classes are effectively mitigated, it does not fundamentally solve this problem. To avoid inter-class conflicts, PCL [ 12 ] calculates K prototypes and considers the sample and its corresponding prototype as a positive pair, while the remaining prototypes are considered negative samples. ProPos [ 13 ] calculates 2K prototypes in pairs through data augmentation, and considers prototypes of the same class as positive pairs, which not only avoids class conflicts but also greatly improves the efficiency of contrastive learning. Although the prototype contrast method effectively avoids inter-class conflicts, it treats samples equally when calculating the prototype, which inevitably introduces noise, causing the prototype estimation to deviate from the true cluster center and inaccurate prototype calculation, as shown in the Fig. 1 . To address the above problem, we propose a C enter-oriented P rototype C ontrastive C lustering method, termed CPCC. Our method consists of soft prototype contrastive (SPC) and dual consistency learning (DCL). Specifically, SPC considers prototypes from the same category as positive pairs and prototypes from different categories as negative pairs. The prototype is calculated by taking the square of the probability that each sample belongs to its cluster center as the weight, so that high-confidence samples are assigned higher weights, otherwise, they are assigned lower weights. This strategy can not only avoid category conflicts but also reduce the deviation of prototypes from cluster centers. In addition, DCL learns the consistency of the features of the same sample under different transformations and the consistency of the features between different samples and their neighbors, resulting in further compression of the intra-class feature space. The contributions are summarized as follows: • We propose a novel prototype contrastive clustering method to avoid inter-cluster conflicts and improve intra-cluster compactness through prototype contrast and consistency learning. • Compared with hard prototypes, we propose a soft prototype construction method that can avoid prototype drift. • Extensive experimental results on five benchmark datasets demonstrate the effectiveness of the proposed method compared with the existing SOTA. II Related Work II-A Deep Clustering Deep clustering utilizes deep learning techniques to perform clustering tasks. It guides the learning process through the features and structure of the data itself without relying on human intervention. According to the network model, deep clustering can be divided into generative network-based and discriminative network-based deep clustering. 1) Generative network-based, such as DEC [ 14 ] realized clustering on embedded features by reconstructing the data through AE. VaDE [ 15 ] sampled from Gaussian Mixture Models distributions which not only realized clustering but also generated new samples. ClusterGAN [ 16 ] realized clustering and generated samples through the generative adversarial network. 2) Discriminative networks-based, such as SCAN [ 3 ] pre-trained a pair of siamese networks with shared weights by contrastive learning and combined them with neighbor assignment consistency to achieve clustering. NNM [ 6 ] extended neighbor assignment consistency to local neighbors based on SCAN. CC [ 4 ] improved the discrimination of the cluster space through bi-level contrasts. SPICE [ 5 ] combined contrastive learning and pseudo-labeling for semi-supervised training of networks. II-B Contrastive Learning Recently, contrastive learning has received much attention for its ability to learn discriminative feature representations from unlabeled data. Such methods are usually combined with a specific task to implement clustering based on MoCo [ 1 ] or SimCLR [ 2 ] , whose loss functions are usually implemented by InfoNEC or NT-Xnet. However, these two methods usually require a large number of negative samples, which leads to class conflicts. One way to avoid conflicts is to not require negative sample pairs: BYOL [ 17 ] is unique in that it does

Read the complete text