Distilling and Adapting: A Topology-Aware Framework for Zero-Shot Interaction Prediction in Multiplex Biological Networks

Alana Deng, Sugitha Janarthanan, Yan Sun, Zihao Jing, Pingzhao Hu · 2026

Read Distilling and Adapting: A Topology-Aware Framework for Zero-Shot Interaction Prediction in Multiplex Biological Networks by Alana Deng, Sugitha Janarthanan, Yan Sun, Zihao Jing, Pingzhao Hu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-06618.txt.

Introduction

Deng and team propose a framework for zero-shot interaction prediction in multiplex biological networks, where multiple link types matter for complex biological systems. Their approach uses foundation models for embeddings and a topology-aware graph splitter catching layers and connectivity. Paired learning aligns codes across modalities, and teacher-student teaching enables zero-shot reach. Tests demonstrate it beats state-of-the-art methods in layered living network link guessing, providing a tool for mapping living links and pushing therapeutics.

Catalog record

CREATORAlana Deng, Sugitha Janarthanan, Yan Sun, Zihao Jing, Pingzhao Hu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE89811
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.06618

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Distilling and Adapting: A Topology-Aware Framework for Zero-Shot Interaction Prediction in Multiplex Biological Networks Alana Deng, Sugitha Janarthanan, Yan Sun, Zihao Jing, Pingzhao Hu Abstract Multiplex Biological Networks (MBNs), which represent multiple interaction types between entities, are crucial for understanding complex biological systems. Yet, existing methods often inadequately model multiplexity, struggle to integrate structural and sequence information, and face difficulties in zero-shot prediction for unseen entities with no prior neighbourhood information. To address these limitations, we propose a novel framework for zero-shot interaction prediction in MBNs by leveraging context-aware representation learning and knowledge distillation. Our approach leverages domain-specific foundation models to generate enriched embeddings, introduces a topology-aware graph tokenizer to capture multiplexity and higher-order connectivity, and employs contrastive learning to align embeddings across modalities. A teacher–student distillation strategy further enables robust zero-shot generalization. Experimental results demonstrate that our framework outperforms state-of-the-art methods in interaction prediction for MBNs, providing a powerful tool for exploring various biological interactions and advancing personalized therapeutics. 1 Introduction Exploring complex interactions within biological networks is vital for advancing personalized medicine and drug discovery. These interactions enable targeted therapies and the study of disease pathways, calling for predictive models that are both precise and reliable. Moving beyond traditional single-layer analyses, multiplex networks provide a powerful framework to capture the multi-dimensional nature of biological systems, with each layer representing a distinct interaction type, providing a holistic picture of biological connectivity across diverse contexts. Current predictive models ( 41 ; 30 ; 75 ; 51 ; 62 ; 17 ) , often rely on single-layer network analyses. Their limitations can be summarized in three areas: (1) Handling Multiplex Data: Single-layer representations discard relational heterogeneity and semantic distinctions between interaction types, overlooking context-dependent reasoning where interactions may rely on both relation type and broader network context. (2) Integrating Multimodal Information: These models have limited capacity to combine biological or chemical sequence features with network topology, which is essential for capturing complex biological interactions. (3) Zero-Shot Prediction: They struggle to predict interactions for unseen entities without prior neighborhood data, restricting generalization to novel biochemical entities. To address these shortcomings, we propose CAZI-MBN (Context-Aware and Zero-shot Interaction prediction in Multiplex Biological Networks) , a framework tailored for multiplex biological interaction prediction. Its four key contributions include: (1) Multiplex-oriented representation learning , capturing interaction-type-specific, context-aware patterns across layered networks. (2) Unified graph–sequence learning , leveraging domain-specific LLMs for biochemically informed representations. (3) Strategic knowledge distillation , transferring latent knowledge from observed to unobserved regions to enable zero-shot prediction. (4) A Mixture of Experts (MoE) , adaptively modeling diverse interaction types and label dependencies for multi-label prediction. 2 Related Work Domain-Specific LLMs. Pre-trained language models have become useful tools for biological sequence analysis by learning patterns from large corpora of protein, molecular, or genomic sequences. ProtTrans ( 20 ) and ESM-2 ( 45 ) enhance predictions of protein function and structure, while ChemBERTa ( 15 ) , trained on tens of millions of SMILES strings ( 39 ) , captures chemical syntax and substructure patterns. DNABERT ( 34 ) and DNABERT-2 ( 74 ) extend these approaches to genomic motifs and regulatory elements. Interaction Prediction and Graph Representation Learning. Interaction prediction in networks has advanced through graph representation learning, which embeds nodes or subgraphs into vector spaces preserving topology. Random-walk methods ( 50 ; 53 ; 19 ; 25 ; 27 ) gave way to Graph Neural Networks (GNNs) ( 56 ; 67 ; 72 ; 68 ; 38 ) , including GCN ( 41 ) , Graph Transformer ( 59 ) , and GraphSAGE ( 30 ) for neighborhood aggregation. Contrastive approaches like DGI ( 64 ) further improve representations by maximizing mutual information. Relation-aware GNNs ( 57 ; 12 ) also expand these capabilities by parameterizing message passing with respect to edge types, enabling the model to learn relation-specific transformations and aggregate signals that vary across interaction modes. Multiplex Network Modeling. Multiplex networks can be modeled as Knowledge Graphs (KGs), which enable semantic reasoning ( 65 ; 46 ; 11 ; 9 ) but flatten layered structures and lose interaction-type specificity, limiting zero-shot performance. Multi-layer network models ( 48 ; 37 ; 24 ; 28 ) instead preserve intra- and inter-layer dependencies, supporting relation-aware learning and multiplex link prediction. Yet, in MBNs ( 69 ; 70 ; 63 ) , integrating sequence features and capturing complex biomedical dependencies across layers remains an open challenge. Knowledge Distillation. Knowledge distillation ( 32 ) trains a smaller "student" to emulate a larger "teacher," enabling efficient deployment with minimal performance loss. It has proven effective in computer vision ( 10 ) and NLP ( 55 ) . However, its potential to MBNs and zero-shot generalization remains largely unexplored. To summarize, existing approaches lack a systematic framework that unifies sequence embeddings with multiplex structures. Single-layer methods overlook relational heterogeneity, multiplex models underuse multimodal features, and most approaches rely on neighborhood data, with little effort devoted to exploring zero-shot generalization. 3 Problem Statement Definition: Multiplex Networks. A multiplex network is a graph \mathcal{G}=\{V,P,E_{intra}\}=\{\mathcal{G}_{1},\dots,\mathcal{G}_{L}\} where V is a set of nodes across layers, P is a set of entities, and E_{intra} represents the set of intra-layer edges. Each layer \mathcal{G}_{i}=\{P_{i},V_{i},E_{i}\} represents the graph of an interaction type in \mathcal{G} , where P_{i} , V_{i} , and E_{i} are respectively the entity set, node set, and edge set for layer i , for i=1,\dots,L . In a multiplex network, an entity (e.g. gene, compound, protein) can be present as nodes in multiple layers, while node sets and the connectivity (edges) can differ from one layer to another. That is, P_{1},\dots,P_{L}\in P are intersecting while V_{1},\dots,V_{L}\in V and E_{1},\dots,E_{L}\in E are disjoint. Each node v\in V_{i} corresponds to an entity p\in P . This allows the representation of different types of relationships or interactions between the same set of entities. An inter-layer graph G_{inter}=(V,E_{inter}) can be formed by connecting the same entities in different layers of \mathcal{G} . Supra-Adjacency Matrix. Given a multiplex network \mathcal{G} , there is a set of adjacency matrices A=\{A_{1},A_{2},\dots,A_{L}\} where A_{i}\in\mathcal{R}^{|V_{i}|\times|V_{i}|} is the layer-specific adjacency matrix for layer i . A encodes the intra-layer links in \mathcal{G} . G_{inter} can be represented by an inter-layer adjacency matrix C\in\mathcal{R}^{|V|\times|V|} . The supra-adjacency matrix, which encodes both intra-layer and inter-layer connections, is defined as \hat{A}=\bigoplus_{{i\in\{1,\dots,L\}}}A_{i}+C, (1) where \bigoplus denotes the direct sum. The illustration of an example multiplex network and its supra-adjacency matrix can be found in Figure 1 . Figure 1: Illustration of an example multiplex network and its supra-adjacency matrix. A_{1} and A_{2} are the layer-specific adjacency matrices for layer 1 and 2 , C is the inter-layer adjacency matrix, and \hat{A} is the supra-adjacency matrix that represents the example multiplex network \mathcal{G} . Generalizing Interaction Prediction in Multiplex Networks: From Seen to Unseen Entities. Interaction prediction in multiplex networks is a multi-label classification task, since entity pairs can share multiple interaction types. Transductive settings predict missing links among seen entities, while zero-shot settings require predicting interactions for entirely unseen entities with no prior known neighborhood. 4 Methods The proposed CAZI-MBN framework addresses multiplex biological interaction prediction in both transductive and zero-shot settings. It integrates domain-specific LLM embeddings (see Supplementary Section A ) with topology-aware network

Read the complete text