EvoStruct: Bridging Evolutionary and Structural Priors for Antibody CDR Design via Protein Language Model Adaptation

Mansoor Ahmed, Sujin Lee, Umar Khayaz, Murray Patterson · 2026

Read EvoStruct: Bridging Evolutionary and Structural Priors for Antibody CDR Design via Protein Language Model Adaptation by Mansoor Ahmed, Sujin Lee, Umar Khayaz, Murray Patterson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21485.txt.

Introduction

Mansoor Ahmed and co-authors present EvoStruct, bridging evolutionary and structural priors for antibody CDR design. Graph network methods for CDR design achieve top sequence recovery but suffer vocabulary collapse. They over-predict a narrow set of amino acids, such as tyrosine and glycine. EvoStruct bridges a frozen protein language model with 3D structural context via a cross-attention adapter, targeting collapse through progressive adaptation.

Catalog record

CREATORMansoor Ahmed, Sujin Lee, Umar Khayaz, Murray Patterson
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36925
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.21485

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EvoStruct: Bridging Evolutionary and Structural Priors for Antibody CDR Design via Protein Language Model Adaptation Mansoor Ahmed, Sujin Lee, Umar Khayaz, Murray Patterson Abstract Equivariant graph neural network (GNN) methods for antibody complementarity-determining region (CDR) design achieve the highest sequence recovery but suffer from severe vocabulary collapse. The current best GNN methods over-predict very few amino acids, such as tyrosine and glycine, while ignoring functionally important residues. We trace this failure to GNN encoders learning amino acid distributions de novo from limited structural data, discarding substitution patterns encoded in evolutionary databases. To resolve this, we propose EvoStruct , which bridges a frozen protein language model (PLM) with 3D structural context from an E(3)-equivariant GNN via a cross-attention adapter. Unlike prior PLM-structure adapters for general protein design, EvoStruct targets the vocabulary collapse problem specific to CDR design through progressive PLM unfreezing and R-Drop consistency regularization. On the Chimera-Bench benchmark, EvoStruct achieves the highest amino acid recovery and lowest perplexity among several antibody design methods, improving sequence recovery by 16% and reducing perplexity by 43% relative to the best GNN baselines, while recovering 2.3 × \times greater amino acid diversity and the highest binding-pair correlation with ground truth. 1 Introduction Antibodies bind antigens through their complementarity-determining regions (CDRs), six hypervariable loops whose sequence and structure determine binding specificity ( 6 ) . Computational CDR design methods condition on antigen structure to generate sequences and backbone conformations for these loops ( 16 ; 11 ; 12 ; 25 ) . A growing body of evidence shows that existing methods largely fail to leverage antigen information. Predictions remain nearly unchanged when the antigen is removed ( 13 ) , and BLOSUM substitution matrices explain model outputs as well as learned likelihoods ( 21 ; 5 ) . A systematic evaluation on the Chimera-Bench benchmark ( 2 ) reveals that GNN methods with greedy decoding exhibit three linked failure modes. Vocabulary collapse reduces predicted amino acids to a fraction of the native diversity, with models overpredicting tyrosine and glycine while ignoring functionally important residues. This echoes the germline bias identified by 17 in antibody language models, but manifests more severely in structure-conditioned GNN methods. Poor binding-pair learning limits paratope-epitope amino acid pair correlation, indicating that no baseline captures the full binding-pair structure. Contact position weakness produces dramatically lower recovery at antigen-contacting positions compared to non-contacting positions, confirming that models learn general CDR statistics rather than antigen-specific binding preferences. These failures share a common root. GNN encoders learn amino acid distributions de novo from limited structural training data ( {\sim} 3,000 complexes), discarding the substitution patterns encoded in evolutionary sequence databases spanning hundreds of millions of proteins. Recent work on structure-informed PLM adaptation ( 26 ) has shown that bridging frozen protein language models with structural encoders via cross-attention adapters preserves the PLM’s vocabulary calibration for general protein design. We apply this paradigm to CDR design with EvoStruct , which bridges a frozen ESM-2 ( 15 ) with an E(3)-equivariant GNN encoder through a cross-attention adapter that operates in ESM-2’s representation space. Unlike general inverse folding adapters ( 26 ; 19 ) , EvoStruct targets the vocabulary collapse problem specific to CDR design through progressive PLM unfreezing ( 7 ) and R-Drop consistency regularization ( 14 ) , and provides a systematic failure mode analysis quantifying the diversity-accuracy tradeoff that constrains existing GNN methods. Our contributions are: 1. A quantitative diagnosis of vocabulary collapse in CDR design using effective vocabulary ( V_{\text{eff}} ) and binding-pair correlation metrics, revealing that GNN methods recover only 20–35% of native amino acid diversity. 2. An adaptation of PLM-structure bridging for CDR design with progressive unfreezing and R-Drop regularization. 3. Empirical evidence that PLM vocabulary calibration transfers to CDR design, breaking the diversity-accuracy tradeoff with 16% higher sequence recovery, 43% lower perplexity, and 2.3 \times greater amino acid diversity than the best GNN baselines. The rest of this paper is organized as follows. Section 2 discusses related work, and Section 3 defines the task, graph construction, and failure mode analysis. Section 4 describes the EvoStruct architecture. Section 5 presents experimental results and failure mode resolution. Section 6 concludes. 2 Related Work GNN-based CDR design. Equivariant GNN methods including MEAN ( 11 ) , dyMEAN ( 12 ) , and RAAD ( 25 ) condition on antigen through spatial message passing and achieve the highest sequence recovery among all paradigms. However, these methods predict amino acids through simple linear or MLP heads operating in the GNN’s learned embedding space, which suffers from severe vocabulary collapse under greedy decoding. Multiple studies document this and broader conditioning failures in CDR design methods: 13 show that predictions change minimally when the antigen is removed, 21 demonstrate that BLOSUM matrices explain model outputs as well as learned likelihoods, and 5 find that simple computational methods can match deep learning approaches for generating diverse binder-enriched libraries. 17 identify a related germline bias in antibody language models where overprediction of germline residues limits design utility. We provide a systematic quantification of this vocabulary collapse in structure-conditioned CDR design and demonstrate that PLM adaptation is an effective solution. Generative CDR design. Diffusion-based methods such as DiffAb ( 16 ) , AbFlowNet ( 1 ) , and AbMEGD ( 3 ) model CDR generation on SE(3), while AbODE ( 22 ) uses conjoined ODEs. RefineGNN ( 10 ) generates CDRs autoregressively without antigen input. These sampling-based methods maintain higher vocabulary diversity but achieve substantially lower sequence recovery. FlowDesign ( 24 ) addresses prior distribution quality for CDR design, targeting structural diversity rather than the sequence vocabulary collapse we identify. Among PLM-based approaches, AntiFold ( 8 ) fine-tunes ESM-IF1 for antibody inverse folding with CDR-weighted masking. AbEgDiffuser ( 27 ) and RADAb ( 23 ) incorporate frozen ESM-2 features through additive injection or concatenation with GNN residue embeddings, but neither uses cross-attention adaptation or operates the sequence head in PLM embedding space. Structure-informed PLM adaptation. LM-Design ( 26 ) introduced the paradigm of inserting cross-attention adapters into frozen PLMs to inject structural context from GNN encoders for protein inverse folding. IgDesign ( 19 ) applies a similar bottleneck adapter between IgMPNN and ESM2-3B specifically for antibody design, with in vitro experimental validation. Our work builds on this paradigm but differs in motivation and training strategy. Where LM-Design and IgDesign target general sequence recovery, we diagnose and address the vocabulary collapse problem specific to CDR design. We additionally employ progressive PLM unfreezing following the schedule of 7 and R-Drop consistency regularization ( 14 ) , which to our knowledge has not been applied in protein design. The shadow paratope loss from dyMEAN ( 12 ) provides pairwise distance supervision for CDR-epitope geometry. 3 Preliminaries 3.1 Task Definition Following Chimera-Bench ( 2 ) , we formulate the CDR design task as follows. Given an antigen structure A=\{(s_{j},\mathbf{x}_{j})\mid j\in V_{A}\} , an epitope specification E\subseteq V_{A} , and an antibody framework F=\{(s_{i},\mathbf{x}_{i})\mid i\in V_{\text{FR}}\} , we design CDR residues R=\{(s_{k},\mathbf{x}_{k})\mid k\in V_{\text{CDR}}\} that maximize the conditional likelihood subject to epitope contact constraints: R^{*}=\argmax_{R}\;p_{\theta}\!\bigl(R\mid A,E,F\bigr),\quad\text{s.t.}\;\;\mathcal{C}(R,A)\neq\emptyset (1) where each residue has amino acid type s_{k}\in\{1,\ldots,20\} and C \alpha coordinate \mathbf{x}_{k}\in\mathbb{R}^{3} . The contact set \mathcal{C}(R,A)=\{j\in V_{A}\mid\exists\,k\in V_{\text{CDR}}\!:\|\mathbf{x}_{k}-\mathbf{x}_{j}\|<d_{c}\} denotes antigen residues contacted within cutoff d_{c} . We

Read the complete text