Cooperation of Experts: Fusing Heterogeneous Information with Large Margin
Shuo Wang, Shunyang Huang, Jinghui Yuan, Zhixiang Shen, Zhao Kang · 2025
Read Cooperation of Experts: Fusing Heterogeneous Information with Large Margin by Shuo Wang, Shunyang Huang, Jinghui Yuan, Zhixiang Shen, Zhao Kang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20853.txt.
Introduction
Shuo Wang and four co-authors set out the Cooperation of Experts framework in twenty twenty-five. It is for fusing heterogeneous information. Modern data come in many types and semantic spaces. Fusion methods in most cases flatten how object patterns differ in each type. Their frame encodes multi-typed data as unified heterogeneous multiplex networks. It smooths over gaps in modality and in how things connect.
Set encoders act as experts for one domain each. Each learns the relational patterns of one semantic space. The experts then work as a team through a large margin mechanism. A tailored optimization strategy helps them pool what each knows, in a robust way. Theory backs the feasibility and stability of the frame. Wide tests across many benchmarks showed top performance. They showed broad use across fields too. The authors put their code out in the open.
Catalog record
| CREATOR | Shuo Wang, Shunyang Huang, Jinghui Yuan, Zhixiang Shen, Zhao Kang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-20853
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cooperation of Experts: Fusing Heterogeneous Information with Large Margin Shuo Wang, Shunyang Huang, Jinghui Yuan, Zhixiang Shen, Zhao Kang Abstract Fusing heterogeneous information remains a persistent challenge in modern data analysis. While significant progress has been made, existing approaches often fail to account for the inherent heterogeneity of object patterns across different semantic spaces. To address this limitation, we propose the Cooperation of Experts (CoE) framework, which encodes multi-typed information into unified heterogeneous multiplex networks. By transcending modality and connection differences, CoE provides a powerful and flexible model for capturing the intricate structures of real-world complex data. In our framework, dedicated encoders act as domain-specific experts, each specializing in learning distinct relational patterns in specific semantic spaces. To enhance robustness and extract complementary knowledge, these experts collaborate through a novel large margin mechanism supported by a tailored optimization strategy. Rigorous theoretical analyses guarantee the framework’s feasibility and stability, while extensive experiments across diverse benchmarks demonstrate its superior performance and broad applicability. Our code is available at https://github.com/strangeAlan/CoE . † † affiliationnotice: Equal contribution † † corresponding-author: Corresponding author 1 Introduction Most real-world objects and data are heterogeneous in the form of multiple types or diverse forms of interactions, which pose significant challenges for modeling their intricate relationships ( Han, 2009 ; Shen and Kang, 2025 ) . For instance, multimodal data combines diverse sources, such as images and text, where each modality contributes unique features that collectively offer a richer understanding of the underlying phenomena; in a social network, people are linked with different types of ties: friendship, family relationship, professional relationship, etc. To characterize the complexities of this heterogeneity, we encode multi-typed information into a unified heterogeneous multiplex network, where each layer contains the same number of nodes (possibly with different attributes) but a different type of links, enabling a comprehensive and effective representation of the diverse relationships inherent in real-world data ( Sun and Han, 2013 ) . Inspired by the success of graph neural networks (GNNs) ( Kipf and Welling, 2016 ; Wang et al., 2019 ) , numerous approaches have been proposed for multiplex network representation learning ( Jing et al., 2021 ; Shen et al., 2024b ) . However, these methods often rely on training a single predictor across the entire network, which can lead to suboptimal results by neglecting the intrinsic heterogeneity and varying characteristics of different link patterns ( Wang et al., 2024 ) . As shown in Figures 1(a) and 1(b) , classifier performance, which is independently trained on each network, differs significantly across different layers, highlighting the importance of accounting for this variability. To effectively capture diverse node patterns, dedicated experts —components designed to focus on specific aspects of the network, are introduced ( Shi et al., 2024 ) . Each expert specializes in learning from a particular type of interaction, thereby reducing cross-interference between relationships and enabling a more nuanced representation of complex structures. When utilizing multiple experts, effective collaboration among them becomes crucial. Existing Mixture of Experts (MoE) approaches employ a gating mechanism that activates only a subset of experts during both training and inference ( Li et al., ; Shi et al., ) . While this strategy improves efficiency, it inherently limits the ability to fully exploit the rich and diverse information embedded in heterogeneous data. This highlights the importance of fostering collaboration rather than competition among experts to leverage cross-layer knowledge effectively. However, this shift introduces two key challenges that must be addressed. (a) ACM (b) Yelp (c) Impact of fusion procedure on Yelp. Figure 1 : (a) and (b) present the classification results on different networks from the ACM and Yelp datasets, representing the diverse and intricate patterns within networks. (c) “+” symbol denotes directly adding the networks, while “ \& ” represents the fusion procedure used in CoE. First, given the challenges of capturing the diverse and intricate patterns within networks, a key question arises: how can we design a framework that effectively extracts and integrates such complex information across all networks? To address this, we propose Cooperation of Experts (CoE) , a novel architecture specifically designed to enable an efficient division of labor among experts. The framework adopts a two-level experts framework: low-level experts focus on learning patterns from individual networks, while high-level experts operate on a fused representation to capture cross-network relationships. Unlike simple concatenation, the fused representation is optimized by maximizing mutual information across networks. As shown in Figure 1(c) , this approach enhances performance by encoding complementary information, enabling more robust and comprehensive representations. Second, how can well-trained experts collaboratively contribute to the final prediction? To promote cooperation rather than competition, we assign each expert a weighted influence in the decision-making process, determined by its proficiency in capturing distinct patterns. This is achieved through a learnable confidence tensor that dynamically adjusts the authority of each expert based on its specialization. To ensure effective collaboration, we introduce an innovative optimization mechanism for the confidence tensor, which strategically maximizes the margin between the two most confidently predicted outcomes. This mechanism not only balances the contributions of different experts but also addresses disparities in their expertise, ultimately boosting overall predictive performance. Our primary contributions can be summarized as: • We propose the Cooperation of Experts (CoE) , a novel expert coordination framework designed to extract stable and nuanced node patterns from multiplex networks. By tailoring experts to capture both specialized and shared features, CoE effectively disentangles and integrates heterogeneous information, uncovering intricate connections across diverse relationships. • Our work further advances the utilization of multiple experts. To the best of our knowledge, this is the first framework to emphasize expert cooperation rather than competition. We introduce a novel large margin optimization strategy that maximizes the effectiveness of each expert’s specialized expertise, fostering a more holistic and in-depth understanding of the underlying knowledge within networks. • The effectiveness of our method is validated through rigorous theoretical analysis and extensive experimental evaluation. We conduct comprehensive experiments with various state-of-the-art methods on both multi-relational and multi-modal tasks. 2 Related Work 2.1 Multiplex Network Learning Multiplex network learning focuses on capturing diverse structural patterns in multi-relational networks to support tasks such as node classification, clustering, and link prediction ( Qian et al., 2024 ; Xie et al., 2025 ) . With the rise of GNNs, HAN ( Wang et al., 2019 ) integrates structural and attribute information using attention mechanisms at both the node and semantic levels, while MAGNN ( Fu et al., 2020 ) and MHGCN ( Yu et al., 2022 ) leverage graph convolution to extract relational features across multiple layers. MGBO ( Huang et al., 2024 ) employs self-expression learning for homophily modeling, whereas HDMI ( Jing et al., 2021 ) and DMG ( Mo et al., 2023 ) utilize contrastive learning to enhance self-supervised representations. However, these methods heavily rely on reliable network topology structures, limiting their effectiveness in real-world scenarios with noisy or incomplete data. 2.2 Graph Structure Learning Graph Structure Learning (GSL) has become a crucial area of research in GNNs, particularly for optimizing unreliable graph structures with significant noise. Supervised GSL methods often generate new adjacency matrices with learnable components, optimized using label information. These methods include probabilistic models (e.g., LDS