Compositional Distributed Learning for Multi-View Perception: A Maximal Coding Rate Reduction Perspective
Zhuojun Tian, Mehdi Bennis, Fellow, IEEE · 2025
Read Compositional Distributed Learning for Multi-View Perception: A Maximal Coding Rate Reduction Perspective by Zhuojun Tian, Mehdi Bennis, Fellow, IEEE (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08707.txt.
Introduction
Zhuojun Tian and Mehdi Bennis design a learning scheme for teams of agents that each see the world from a different viewpoint. Their framework rests on the maximal coding rate reduction principle, a rule that shapes learned representations to be compact within classes yet diverse across them.
Each agent periodically factors its learned subspaces and sends truncated basis matrices to its peers. Fused subspaces emerge from the exchange, and a projection step pulls every agent's outputs toward the shared result. The authors prove the coding-rate change stays bounded and that basis fusion is consistent across agents. Simulations show high classification accuracy while the agents' representations stay diverse. Baseline methods, by contrast, collapse toward correlated subspaces and tangled representations.
Catalog record
| CREATOR | Zhuojun Tian, Mehdi Bennis, Fellow, IEEE |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-08707
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Compositional Distributed Learning for Multi-View Perception: A Maximal Coding Rate Reduction Perspective Zhuojun Tian, Mehdi Bennis, Fellow, IEEE Abstract In this letter, we formulate a compositional distributed learning framework for multi-view perception by leveraging the maximal coding rate reduction principle combined with subspace basis fusion. In the proposed algorithm, each agent conducts a periodic singular value decomposition on its learned subspaces and exchanges truncated basis matrices, based on which the fused subspaces are obtained. By introducing a projection matrix and minimizing the distance between the outputs and its projection, the learned representations are enforced towards the fused subspaces. It is proved that the trace on the coding-rate change is bounded and the consistency of basis fusion is guaranteed theoretically. Numerical simulations validate that the proposed algorithm achieves high classification accuracy while maintaining representations’ diversity, compared to baselines showing correlated subspaces and coupled representations. I Introduction In conventional distributed learning, each agent has access to its own full-view training data and cooperates with others to achieve consensus. However, in large scale scenarios, each agent may only observe a partial view of the global environment due to limited sensing capability or various geographical locations [ 1 , 2 ] , leading to the multi-view perception problem [ 3 ] . Through information exchange among agents, compositional distributed learning seeks to integrate partial local knowledge into a global understanding of the environment. There have been extensive studies on multi-view perception. Conventional methods include subspace-based approaches [ 4 , 5 , 6 , 7 ] , such as canonical correlation analysis (CCA) [ 4 ] and its generalized version GCCA [ 5 ] , as well as spectral-based methods [ 8 , 9 ] . With the development of deep learning, high-level associations among multi-view data can be better captured through non-linear neural networks [ 10 , 11 , 12 , 13 , 14 , 15 ] . Deep CCA [ 10 ] and DGCCA [ 11 ] adopt a common strategy of learning joint representations across multiple views at a higher level, while capturing view-specific features in the lower layers. Another line of research leverages auto-encoders [ 16 , 17 , 18 ] to construct a shared latent space from multi-view inputs. Although insightful, they are primarily designed for centralized settings and overlook data privacy concerns in distributed environments. To address multi-view datasets collected by distributed agents, recent studies have introduced federated multi-view clustering (FedMVC) [ 19 , 20 , 21 , 22 ] . The authors in [ 21 ] leverage global self-supervised information to extract complementary cluster information, while the method in [ 22 ] coined as FMCSC further considers hybrid views using contrastive learning techniques. These methods however fail to exploit the structure of representation spaces and lack interpretability. The authors in [ 23 ] introduced the Maximal Coding Rate Reduction (MCR 2 ) principle generating independent feature subspaces where features are distributed isotropically. As a result, the principal directions within these subspaces become more stable and uniformly distributed. Inspired by the stability and interpretability of the captured subspaces, our work introduces MCR 2 as a discriminative criterion for multi-view feature fusion, in order to provide a rigorous information-theoretic interpretation. Given the well-structured principle components of the learned subspaces, we design a periodic basis fusion procedure to compose the local subspaces into global one. Our contributions can be summarized as follows: • We formulate a distributed multi-view perception problem leveraging the MCR 2 principle. By utilizing the isotropical properties of the subspaces, we design a periodic basis fusion to integrate the local subspaces, and the projection loss to adjust the output features’ subspace. • The bound on the variation of the coding rate is characterized by the projection residual energy. We further establish the convergence rate of the fused subspace matches that of the local covariance estimation error. • We evaluate the algorithm on multi-view perception tasks and benchmark it against several baselines, demonstrating that the output representations preserve the diversity and discriminability properties of the MCR 2 principle. II System Model and Problem Formulation II-A System Model Consider a decentralized multi-agent communication network, which can be represented by an undirected graph \mathcal{G} with N distributed agents/nodes. Each agent has access to a partial view of the global objects, collecting local dataset denoted by \mathcal{D}_{i}=\{\mathcal{X}_{i},\mathcal{Y}_{i}\} . The output of the representation learning neural network in agent i is defined as \bm{Z}_{i}\in\mathbb{R}^{d\times m_{i}} , where d is the dimension of the output feature and m_{i} is the number of data samples in node i . If we denote the representation learning neural network (encoder) in agent i by f_{i} , which is parameterized by \bm{\theta}_{i} , then the output can be represented as \bm{Z}_{i}=f_{i}(\bm{X}_{i},\bm{\theta}_{i}) . II-B Maximal Coding Rate Reduction The compactness of the learned features \bm{Z} as a whole can be measured by the average coding length per sample when the sample size is large enough, i.e., the coding rate subject to the distortion [ 24 , 23 ] , is given by: R(\bm{Z},\epsilon)=\frac{1}{2}\log\det(\bm{I}+\frac{d}{m\epsilon^{2}}\bm{Z}\bm{Z}^{T}), (1) which represents the minimal number of binary bits needed to encode \bm{Z} such that the expected decoding error is less than \epsilon [ 24 ] . Considering that the generated features \bm{Z} have multiple classes from different subspaces, w.r.t. this partition, the average number of bits per sample (the coding rate) is given in ( 2 ), where \bm{\Pi}_{k} is a diagonal matrix whose diagonal entries indicate the membership of the samples in the multiple classes. In this regard, the label serves as side information. R^{c}(\bm{Z},\epsilon|\bm{\Pi})\!=\!\sum_{k=1}^{K}\frac{tr(\bm{\Pi}_{k})}{2m}\log\det(\bm{I}+\frac{d}{tr(\bm{\Pi}_{k})\epsilon^{2}}\bm{Z}\bm{\Pi}_{k}\bm{Z}^{T}). (2) To maximize the discrimination of the features among different classes, the whole space of \bm{Z} must be as large as possible, so that features of different samples are maximally incoherent to each other. On the other hand, within each class, the subspace should be of small volume to make the representation compact and more correlated. Therefore, the loss function on the principle of Maximal Coding Rate Reduction can be expressed as follows [ 23 ] : \max\hskip 10.00002pt\mathcal{M}(\bm{Z})=R(\bm{Z},\epsilon)-R^{c}(\bm{Z},\epsilon|\bm{\Pi}). (3) MCR 2 principle produces features spaces that are between-class discriminative and maximally diverse within each class [ 23 ] . Each subspace corresponds to a class, where the principal directions are more stable and evenly distributed. On this basis, we develop the algorithm in the following section. III Proposed Algorithm In this section, we develop the compositional distributed learning framwework, as shown in Fig. 1 . In each agent, the encoder learns well-structured subspaces through the MCR 2 principle, which are composed through the basis fusion and the designed projection loss term. Fig. 1: Illustration of the proposed multi-view perception framework. III-A Periodic basis fusion Specifically, the output features of agent i corresponding to the k -th class are denoted by \bm{Z}_{i,k} . This formulated subspace can be represented by its principal components, which can be obtained through the singular value decomposition (SVD), i.e., \bm{Z}_{i,k}=\bm{U}_{i,k}\bm{\Sigma}_{i,k}\bm{V}_{i,k}^{T} . Here \bm{U}_{i,k}\in\mathbb{R}^{d\times d} is the left singular vectors with orthonormal basis for the column space giving the feature directions. The principle components of the corresponding subspace can be obtained through the leading p_{k} columns of \bm{U}_{i,k} , denoted by \hat{\bm{U}}_{i,k} . The principle components represent the corresponding subspace. Sorting the singular values in