Dual Consistent Constraint via Disentangled Consistency and Complementarity for Multi-view Clustering
Bo Li, Jing Yun · 2025
Read Dual Consistent Constraint via Disentangled Consistency and Complementarity for Multi-view Clustering by Bo Li, Jing Yun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-04676.txt.
Introduction
Bo Li and Jing Yun propose a new method for multi-view clustering in a 2025 paper. Clustering data seen from several angles can reveal shared meaning, but most methods chase only what the views agree on and drop what each view alone can add.
Their framework splits each view into shared and private parts using a disentangled variational autoencoder. Contrastive learning pulls the shared parts together, and two consistency checks then put the private parts to work through within-view and cross-view rebuilding. The design forces the model to keep both the common story and each view's extra detail. Tests in the paper show the fuller picture sharpens the clusters that come out.
Catalog record
| CREATOR | Bo Li, Jing Yun |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-04676
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dual Consistent Constraint via Disentangled Consistency and Complementarity for Multi-view Clustering Bo Li, Jing Yun Abstract Multi-view clustering can explore common semantics from multiple views and has received increasing attention in recent years. However, current methods focus on learning consistency in representation, neglecting the contribution of each view’s complementarity aspect in representation learning. This limit poses a significant challenge in multi-view representation learning. This paper proposes a novel multi-view clustering framework that introduces a disentangled variational autoencoder that separates multi-view into shared and private information, i.e., consistency and complementarity information. We first learn informative and consistent representations by maximizing mutual information across different views through contrastive learning. This process will ignore complementary information. Then, we employ consistency inference constraints to explicitly utilize complementary information when attempting to seek the consistency of shared information across all views. Specifically, we perform a within-reconstruction using the private and shared information of each view and a cross-reconstruction using the shared information of all views. The dual consistency constraints are not only effective in improving the representation quality of data but also easy to extend to other scenarios, especially in complex multi-view scenes. This could be the first attempt to employ dual consistent constraint in a unified MVC theoretical framework. During the training procedure, the consistency and complementarity features are jointly optimized. Extensive experiments show that our method outperforms baseline methods. [orcid=0009-0003-7011-4134] [style=chinese] keywords Multi-view clustering ,Consistency ,Complementarity ,Disentanglement ,Constrastive Learning † † titlenote: This work was supported by the National Natural Science Foundation of China under Grants 62062055. Youth Talents of Science and Technology in Universities of Inner Mongolia Autonomous Region under Grants NJYT24061. The Natural Science of Foundation of Inner Mongolia Autonomous Region under Grants JY20240061. † † credit: Conceptualization of this study, Methodology, Software, Validation, Data curation, Writing - original draft † † credit: Supervision, Writing - review & editing † † corresponding: Corresponding author (Jing Yun). 1 INTRODUCTION Figure 1: Our basic idea. Taking a bi-view data as showcase, in left of figure, we use 2 oval panels to denote 2 views, polygons with different colors and shapes to indicate different categories. In right of figure, the solid and dotted rectangles denote the shared information and the private information. The red dotted rectangles denote ignoring the role of private information in multi-view clustering. The orange brackets indicate the reconstruction of multi-view data. Traditional methods improve clustering performance by pursuing multi-view consistency, which ignoring private information. However, when dual consistency constraints guarantee consistency learning, our method utilizes private information for view reconstruction. The goal of the cross-view consistency constraints is to maximize the mutual information between View 1 and View 2. The goal of the shared information consistency constraint is to express properly View 1 and View 2. Since complementarity information is specific to each view, multi-view representation learning requires explicitly preserving it to guarantee information completion during reconstruction. Multi-view data consists of data collected from different sources and is widely existent in real-world application scenarios [ 12 , 33 , 52 , 74 ] . For example, we typically describe news events in terms of visual features and textual features that originate from different feature extractors. To handle such heterogeneous features, multi-view clustering (MVC), as an important unsupervised paradigm for multi-view learning, aims to improve the learning of common semantics by mining the latent structures that are hidden in multi-view data to obtain better clustering performance. MVC is a fundamental task in the fields of data mining, pattern recognition, etc. It has received increasing attention in recent years [ 22 , 44 , 56 ] . Consistency and complementarity are two key ingredients for boosting MVC. Consistency is able to analyze data from many perspectives and come up with the same result. In fact, a multi-view can accurately convey every aspect of an objective, but an individual view cannot. Thus, a comprehensive analysis leads to a more complete representation of the object. For example, in medical diagnosis and criminal analysis, complementary information affects the accuracy of judgment and is critical to decision-making. The critical factor to the success of the existing work is to learn consistency across different views. However, in the pursuit of consistency, complementary information is unavoidably ignored. Thus, multi-view clustering remains a challenging problem. Traditional multi-view clustering methods are based on machine learning methods for clustering and can be divided roughly into three categories. Namely, (i) subspace-based clustering methods work on dimensionalizing high-dimensional, multi-view data and exploring its specific subspaces to learn shared and integrated subspace representations [ 22 , 89 ] . Zhang et al. [ 93 ] learn consistent information about samples by fusing representations of multi-view. Yang et al. [ 81 ] proposed a subspace-based MVC hierarchical representation model with integration of intra-sample adaptive latent representation learning, intra-view global similarity structure learning, and inter-view structure-preserved consistency learning to address the problem of imprecise low-dimensional subspace representation and the inadequacy of exploring consistency. (ii) matrix factorization-based clustering methods factorize multi-view data into a consensus representation that is universally shared by all views [ 72 , 94 , 33 , 49 ] . Cui et al. [ 13 ] automatically weighted learned matrices for each view for clustering by deep factorization of multi-view matrices. (iii) graph-based clustering methods learn a consensus graph by mutual augmentation of nodes and edges [ 44 , 49 , 48 , 68 ] . Nie et al. [ 53 ] learn a multi-view clustering structure by exploring Laplace rank-constrained graphs. However, these methods suffer from poor representation capabilities and high computational complexity. The performance is limited in complex real-world data scenarios. Due to the powerful fitting capabilities of deep neural networks, deep multi-view clustering methods have recently been extensively developed with increasingly superior feature representation capabilities. Li et al. [ 45 ] incorporate features of all views to achieve a common representation of all views. Lin et al. [ 47 ] explored the common semantics of all views by dimensionalizing the features and employing a consistent learning objective. However, meaningless complementary information may dominate the feature learning process, thus interfering with the clustering quality. To reduce the influence of view complementarity information on clustering, several methods were designed for different alignment models [ 16 , 64 , 80 , 97 ] . For instance, aligning representation distributions and labeling distributions from different views by KL divergence [ 31 ] . They might be difficult to distinguish between clusters since the categories of one view might be aligned with different categories in another view. In addition, other methods aligned the representations from different views through contrastive learning [ 47 , 80 , 46 , 82 , 66 ] . However, they usually need to achieve the reconstruction objective on the same features to avoid the trivial solution. Although the above methods achieve significant MVC performance improvement by considering the common semantics of learning consistency and reducing the effect of complementarity through alignment, the interference caused by entanglement of information among multi-view is also ignored. To be specific, consistency and complementarity information are entangled in a single feature space, which reduces the ability of the model to learn and reconstruct the representation data. Based on the above observations, we found that cluster information is