CAME-AB: Cross-Modality Attention with Mixture-of-Experts for Antibody Binding Site Prediction
Hongzong LiGenerative AI Research and Development CenterThe Hong Kong University of Science and TechnologyHong Kong [email protected], Jiahao MaMILESThe University of Hong KongHetao SZ-HK Cooperation Zone [email protected] Zhanpeng Shi,College of Veterinary MedicineJilin UniversityJilin, Chin · 2025
Read CAME-AB: Cross-Modality Attention with Mixture-of-Experts for Antibody Binding Site Prediction by Hongzong LiGenerative AI Research and Development CenterThe Hong Kong University of Science and TechnologyHong Kong [email protected], Jiahao MaMILESThe University of Hong KongHetao SZ-HK Cooperation Zone [email protected] Zhanpeng Shi,College of Veterinary MedicineJilin UniversityJilin, Chin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06465.txt.
Introduction
Predicting where an antibody will grip its target is the goal of a 2025 computational biology paper led by Hongzong Li, with seven co-authors. Such binding sites matter for designing antibody medicines. Older methods used only a protein's letter sequence or only its shape, and often missed sites that are specific to one antibody.
Their system, CAME-AB, merges five kinds of evidence, from raw amino acid codes and substitution tables to language-model features, shape data, and biochemical graphs refined by a graph network. A fusion module learns how much weight each kind deserves for each input. A transformer with a mixture-of-experts design, plus contrastive training that pulls similar cases together, completes the model. On standard test sets it beats strong rivals across several accuracy measures.
Catalog record
| CREATOR | Hongzong LiGenerative AI Research and Development CenterThe Hong Kong University of Science and TechnologyHong Kong [email protected], Jiahao MaMILESThe University of Hong KongHetao SZ-HK Cooperation Zone [email protected] Zhanpeng Shi,College of Veterinary MedicineJilin UniversityJilin, Chin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-06465
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CAME-AB: Cross-Modality Attention with Mixture-of-Experts for Antibody Binding Site Prediction Hongzong LiGenerative AI Research and Development CenterThe Hong Kong University of Science and TechnologyHong Kong [email protected], Jiahao MaMILESThe University of Hong KongHetao SZ-HK Cooperation Zone [email protected] Zhanpeng Shi,College of Veterinary MedicineJilin UniversityJilin, China [email protected] Rui Xiao,School of Chemistry and Chemical EngineeringSouth China University of TechnologyGuangzhou, China [email protected] Fanming Jin,School of Biomedical SciencesThe University of Hong KongHong Kong [email protected] Ye-Fan Hu ,Computational Immunology CentreBayVax Biotech LimitedHong Kong [email protected] Hangjun Che,College of Electronic and Information EngineeringSouthwest UniversityChongqing, China [email protected], Jian-Dong HuangSchool of Biomedical SciencesThe University of Hong KongHong Kong [email protected] Abstract Antibody binding site prediction plays a pivotal role in computational immunology and therapeutic antibody design. Existing sequence or structure methods rely on single-view features and fail to identify antibody-specific binding sites on the antigens. In this paper, we propose CAME-AB , a novel Cross-modality Attention framework with a Mixture-of-Experts (MoE) backbone for robust antibody binding site prediction. CAME-AB integrates five biologically grounded modalities, including raw amino acid encodings, BLOSUM substitution profiles, pretrained language model embeddings, structure-aware features, and GCN-refined biochemical graphs, into a unified multimodal representation. To enhance adaptive cross-modal reasoning, we propose an adaptive modality fusion module that learns to dynamically weight each modality based on its global relevance and input-specific contribution. A Transformer encoder combined with an MoE module further promotes feature specialization and capacity expansion. We additionally incorporate a supervised contrastive learning objective to explicitly shape the latent space geometry, encouraging intra-class compactness and inter-class separability. To improve optimization stability and generalization, we apply stochastic weight averaging during training. Extensive experiments on benchmark antibody-antigen datasets demonstrate that CAME-AB consistently outperforms strong baselines on multiple metrics, including Precision, Recall, F1-score, AUC-ROC, and MCC. Ablation studies further validate the effectiveness of each architectural component and the benefit of multimodal feature integration. The model implementation details and the codes are available on https://anonymous.4open.science/r/CAME-AB-C525 K eywords Antibody Binding Site Prediction \cdot Antibody-antigen Interaction \cdot Multiview \cdot Transformer \cdot Adaptive Modality Fusion \cdot Mixture-of-Experts (MoE) \cdot Contrastive Learning 1 Introduction Predicting antibody binding site—the regions on antigens recognized by specific antibodies—is a critical task in immunological research, vaccine development, and antibody-based therapeutic design [ 1 ] . Accurate identification of these binding sites enables a deeper understanding of immune recognition mechanisms, significantly facilitating rational vaccine and therapeutic antibody engineering [ 2 , 3 ] . Traditional approaches predominantly rely on experimentally determined three-dimensional structures or computational sequence-based methods [ 4 ] . However, these methods often face limitations due to structural data scarcity and the inability of sequence-based predictors to capture complex structural relationships essential for accurate predictions [ 5 ] . Antibody binding site prediction methods based solely on sequence alignment often fail to account for the structural interactions essential to antibody-antigen specificity. For example, sequence-based tools such as BepiPred [ 6 ] , BLAST [ 7 ] and ClustalW [ 8 ] are inherently limited in their ability to capture the spatial arrangements and residue interactions critical for accurate prediction. In contrast, structure-based approaches, such as docking simulations and homology modeling, depend heavily on experimentally resolved structures obtained through techniques such as X-ray crystallography or cryo-electron microscopy [ 9 ] . However, these methods are both time-intensive and costly, significantly limiting their widespread applicability. Recent research in computational biology has shifted attention towards integrating multiple data modalities to address these shortcomings [ 10 ] . Deep learning methods, particularly transformer architectures and graph neural networks (GNNs), have demonstrated exceptional capability in capturing complex, long-range dependencies in both sequential and spatial data [ 11 ] . Transformers have shown great potential in language modeling tasks by effectively modeling long-range dependencies through self-attention mechanisms [ 12 ] . Likewise, GNNs have demonstrated strong capabilities in capturing spatial dependencies not only within protein tertiary structures but also in modeling the topological relationships in protein–protein interaction [ 12 , 13 ] , thereby showing the importance of incorporating both structural and interaction-based information in predictive tasks [ 14 , 13 ] . The introduction of AlphaFold2 has marked a paradigm shift in protein structure prediction, enabling high-accuracy structural information to be inferred solely from amino acid sequences [ 15 ] . The availability of reliable predicted structures provides an unprecedented opportunity to integrate structural context without requiring experimental resolution, significantly expanding the practical applicability of computational predictions. Additionally, protein language models, such as ProteinBERT [ 16 ] and evolutionary scale modeling (ESM) [ 17 ] , have demonstrated impressive capability in encoding evolutionary and functional information into dense continuous embeddings. These pretrained models have captured deep evolutionary relationships, contributing significantly to the performance of downstream prediction tasks. Integrating these pretrained embeddings into epitope prediction tasks offers a promising strategy to enhance prediction accuracy and generalizability. Figure 1: Comparison between the traditional prediction approach and our proposed cross-modality attention learning framework. Motivated by recent advances in protein modeling and multimodal learning, we propose CAME-AB , a novel Cross-Modality Attention framework equipped with a Mixture-of-Experts (MoE) backbone for antibody binding site prediction. CAME-AB systematically integrates complementary biological information from multiple representation spaces (as shown in Figure 1 ). Given the critical role of the CDR region in antigen-antibody recognition [ 18 ] , CAME-AB focuses on the antibody heavy-chain variable region (VH), including CDR-H1, CDR-H2, and CDR-H3 loops, and extracts semantically rich features using diverse encoding strategies. Specifically, CAME-AB incorporates five biologically grounded modalities: (i) one-hot encoding and BLOSUM matrices to capture residue identity and evolutionary substitution patterns; (ii) pretrained contextual embeddings from a large protein language model, i.e., ESMC; (iii) structural features derived from ESM’s structure-aware output layers; and (iv) residue-level biochemical similarity graphs constructed using PyBioMed descriptors, from which we obtain structural-aware node embeddings via a graph convolutional network. These heterogeneous representations are projected into a unified latent space and fused via a learnable adaptive modality fusion module that jointly models modality informativeness, sample-specific variation, and class-aware semantic priors. To improve discriminative capacity and model generalization, our proposed architecture incorporates three additional components: (1) a Mixture-of-Experts (MoE) module to encourage feature specialization across latent subspaces; (2) a supervised contrastive learning objective to enforce intra-class compactness and inter-class separability in the embedding space; and (3) Stochastic Weight Averaging (SWA) for optimization smoothing and enhanced generalization. We evaluate our framework on multiple public antibody-antigen binding datasets. Extensive experiments show that our method consistently outperforms state-of-the-art baselines on multiple metrics. Ablation studies further verify the effectiveness of each multi-view feature and architectural component. Our key contributions are summarized as follows: • We present a unified multimodal deep learning framework that integrates sequence, structural, and biochemical modalities for antibody binding site prediction. • We propose a novel combination of adaptive modality fusion, contrastive learning, and MoE, jointly optimized under a robust training strategy incorporating SWA. • We achieve state-of-the-art performance on benchmark datasets and provide comprehensive ablation studies to validate the contribution of each design component. 2 Related Work 2.1 Antibody Binding Site Prediction Antibody binding site prediction aims to identify antigen regions (epitopes) capable of interacting with antibodies. While critical for vaccine design and therapeutic development, conventional approaches exhibit a fundamental limitation: they predict where binding may occur on an antigen surface, but cannot determine which specific antibodies