Towards Learnable Anchor for Deep Multi-View Clustering

Bocheng Wang, Chusheng Zeng, Mulin Chen, Xuelong Li · 2025

Read Towards Learnable Anchor for Deep Multi-View Clustering by Bocheng Wang, Chusheng Zeng, Mulin Chen, Xuelong Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-12427.txt.

Introduction

Bocheng Wang, Chusheng Zeng, Mulin Chen, and Xuelong Li wrote this paper in two thousand twenty-five. It groups data seen from many views in linear time, by letting the anchor points of the graph be learned, not picked by hand.

Anchor methods dodge the square cost of full graph learning, but hand-picked anchors stay fixed and can drift from the true groups. In this model a dose of Gaussian noise lets the anchors move, and a new loss pulls each one near its samples. A graph step then reads the group shape the anchors form. A mutual information loss aligns the views. With tuned anchors the full graph is built and a sharp embedding read off. Tests on many sets beat the top rivals on score and speed both.

Catalog record

CREATORBocheng Wang, Chusheng Zeng, Mulin Chen, Xuelong Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-12427

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Learnable Anchor for Deep Multi-View Clustering Bocheng Wang, Chusheng Zeng, Mulin Chen, Xuelong Li Abstract Deep multi-view clustering incorporating graph learning has presented tremendous potential. Most methods encounter costly square time consumption w.r.t. data size. Theoretically, anchor-based graph learning can alleviate this limitation, but related deep models mainly rely on manual discretization approaches to select anchors, which indicates that 1) the anchors are fixed during model training and 2) they may deviate from the true cluster distribution. Consequently, the unreliable anchors may corrupt clustering results. In this paper, we propose the Deep Multi-view Anchor Clustering (DMAC) model that performs clustering in linear time. Concretely, the initial anchors are intervened by the positive-incentive noise sampled from Gaussian distribution, such that they can be optimized with a newly designed anchor learning loss, which promotes a clear relationship between samples and anchors. Afterwards, anchor graph convolution is devised to model the cluster structure formed by the anchors, and the mutual information maximization loss is built to provide cross-view clustering guidance. In this way, the learned anchors can better represent clusters. With the optimal anchors, the full sample graph is calculated to derive a discriminative embedding for clustering. Extensive experiments on several datasets demonstrate the superior performance and efficiency of DMAC compared to state-of-the-art competitors. 1 School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University, China 2 Institute of Artificial Intelligence (TeleAI), China Telecom, China [email protected], [email protected], [email protected], [email protected] Introduction In real-world data acquisition, a sample is often recorded from different views or sources ( Cui et al. 2024 ) , constituting multi-view data. For instance, an image can be distilled by multiple feature descriptors (e.g., color, shape, and spatial relation), and a document can be interpreted from multiple perspectives (e.g., topic distribution, word sequence, and word frequency). To adapt to the actual application environment, many types of unsupervised Multi-View Clustering (MVC) have emerged. Among them, deep MVC incorporates the enormous advantages of neural networks on representation learning, and has presented outstanding performance in real-world scenarios. In general, deep MVC sets up a separate auto-encoder for each view, and then the learned multiple view-specific embeddings are fused into a consensus to infer clusters. To mitigate the inter-view conflict and perceive multi-view consistency, many representation alignment strategies are leveraged, such as contrastive learning ( Xu et al. 2022b ; Hu et al. 2023 ) , and label distribution alignment ( Cheng et al. 2021 ; Xu et al. 2022a ; Liu et al. 2024 ) . Overall, most deep MVC models emphasize the discriminability of the output embedding to improve clustering. Recently, some works integrate the graph learning theory into deep MVC, which considers the structure relationship between samples while learning the discriminative embedding ( Yang et al. 2023 ; Yan et al. 2023 ; Wang et al. 2024 ) . These novel models capture the topological structure by constructing a data similarity graph, and thus optimizing representation learning based on graph data mining techniques, such as graph convolution network and structure preservation scheme ( Wang et al. 2023b ; Xiao et al. 2023 ) . These methods usually require computing the edge weights between any two samples to build a full sample graph, which leads to costly time complexity O(n^{2}) where n is the amount of samples. One theoretical solution to this problem is anchor graph learning that can accelerate the training to linear time w.r.t. n ( Dong et al. 2023 ; Cui et al. 2023 ) . The performance of anchor graph learning and final clustering heavily depends on the anchor quality. However, most deep models employ non-differentiable manual procedures (e.g., random selection and k -means) to determine the final anchors, which means the anchors are not learnable. Ideally, each sample should be represented by a certain anchor, and the anchors should reflect the cluster distribution. If the selected anchors cannot represent the original samples and cluster centroids well, the clustering result may be adversely affected. Figure 1: Pipeline of DMAC. Note that the encoders are omitted. For the a -th view, \mathbf{Z}^{(a)} is the data embedding, \mathbf{A}^{(a)} is the anchor graph, \mathrm{AGCN}_{a} is the corresponding anchor graph convolution network, and \mathbf{F}^{(a)} is the anchor clustering distribution that records the probability of an anchor belonging to each cluster. \mathbf{Z} is the shared fusion embedding among views. \mathbf{U} represents the learnable anchors injected with the perturbation. The overall framework is updated by minimizing Eq. ( 16 ). The final result is gained by performing k -means on the convergent \mathbf{Z} . To remedy the problems, we establish the Deep Multi-view Anchor Clustering (DMAC) model. As shown in Fig. 1 , the pipeline of DMAC can be partitioned into three main items. Firstly, the positive-incentive perturbation is injected into the initial anchors to yield a learnable mechanism for the anchors. Then, anchor graph convolution is used to produce the cluster indicator of anchors for each view, and the cross-view agreement is obtained by the proposed mutual information maximization loss. Finally, the learned anchors are leveraged to reveal the structural relationship between samples to impel a discriminative embedding. The key contributions of this paper are listed as follows. • Anchor graph learning is incorporated into the deep multi-view clustering framework. Compared to most competitors, the proposed model can capture structural information with learnable anchors in a high-efficiency linear time to ameliorate embedding learning. • A perturbation-driven mechanism is proposed to improve the anchor quality adaptively during model training. By infusing beneficial perturbations, the learned anchors are adjusted to foster a distinct similarity relationship with the samples, thus representing the original data more comprehensively. • An anchor graph convolution network is devised to infer the anchor clustering distribution of each view. The mutual information among multiple distributions is maximized to explore the consistent anchor clustering distribution, so as to produce clustering-oriented anchors. Related Work Deep Multi-View Clustering Benefiting from the powerful representation learning ability of neural networks, deep MVC has achieved dominant clustering performance in practical applications ( Fang et al. 2023b ) . Generally, deep MVC leverages auto-encoders to learn a series of view-specific embeddings, and then executes representation fusion to infer the consensus cluster indications. Many models are proposed to promote the clustering-friendly deep embedding. DAMC ( Li et al. 2019 ) introduces the adversarial training mechanism to improve the discriminability of the learned embedding. DEMVC ( Xu et al. 2021 ) pursues a consistent cluster structure between views to exploit the cross-view complementary information. In ( Trosten et al. 2021 ) , the importance of representation alignment for MVC is analyzed theoretically, and a contrastive learning based deep MVC method is established. MFLVC ( Xu et al. 2022b ) performs the feature- and cluster-level contrastive learning simultaneously to inhibit the adverse effects of view-private information. CVCL ( Chen et al. 2023 ) advocates unifying the cluster assignment by multi-view contrastive learning. The abovementioned representatives have presented good clustering capacity in experiments. However, most models focus on the intrinsic features while neglecting the structure relationship among samples that is essential to detect the clustering distribution ( Huang et al. 2019 ; Wang et al. 2019 ; Chen, Wang, and Li 2024 ) . Recently, some scholars introduce the graph learning theory

Read the complete text