Chimera-Bench : A Benchmark Dataset for Epitope-Specific Antibody Design

Mansoor Ahmed, Nadeem Taj, Imdad Ullah Khan, Hemanth Venkateswara, Murray Patterson · 2026

Read Chimera-Bench : A Benchmark Dataset for Epitope-Specific Antibody Design by Mansoor Ahmed, Nadeem Taj, Imdad Ullah Khan, Hemanth Venkateswara, Murray Patterson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13431.txt.

Introduction

Mansoor Ahmed and co-authors introduce CHIMERA-Bench for epitope-specific antibody design. Dozens of deep generative methods have appeared in three years, but no standard benchmark exists for fair comparison. Methods are tested on varied SAbDab snapshots, test sets, and metrics that do not align. CHIMERA-Bench centers on one task: epitope-conditioned CDR sequence-structure co-design. It holds a curated set of 2,922 antibody-antigen complexes with epitope and paratope labels. Three splits test unseen epitopes, unseen antigen folds, and future targets, and 11 methods are benchmarked.

Catalog record

CREATORMansoor Ahmed, Nadeem Taj, Imdad Ullah Khan, Hemanth Venkateswara, Murray Patterson
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51023
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.13431

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Chimera-Bench : A Benchmark Dataset for Epitope-Specific Antibody Design Mansoor Ahmed, Nadeem Taj, Imdad Ullah Khan, Hemanth Venkateswara, Murray Patterson Abstract Computational antibody design has seen rapid methodological progress, with dozens of deep generative methods proposed in the past three years, yet the field lacks a standardized benchmark for fair comparison and model development. These methods are evaluated on different SAbDab snapshots, non-overlapping test sets, and incompatible metrics, and the literature fragments the design problem into numerous sub-tasks with no common definition. We introduce Chimera-Bench ( C DR M odeling with E pitope-guided R edesign), a unified benchmark built around a single canonical task: epitope-conditioned CDR sequence–structure co-design . Chimera-Bench provides (1) a curated, deduplicated dataset of 2,922 antibody–antigen complexes with epitope and paratope annotations; (2) three biologically motivated splits testing generalization to unseen epitopes, unseen antigen folds, and prospective temporal targets; and (3) a comprehensive evaluation protocol with five metric groups including novel epitope-specificity measures. We benchmark representative methods spanning different generative paradigms and report results across all splits. Chimera-Bench is the largest dataset of its kind for the antibody design problem, allowing the community to develop and test novel methods and evaluate their generalizability. The source code and data are available at: https://github.com/mansoor181/chimera-bench.git 1 Introduction Antibodies are among the most important classes of biotherapeutics ( 22 ) . Their binding specificity is largely determined by six complementarity-determining regions (CDRs), particularly CDR-H3, which makes these loops the primary targets for computational design. Deep generative models have recently transformed this space, with diffusion models ( 20 ; 21 ) , flow matching ( 29 ) , equivariant graph neural networks ( 35 ; 15 ; 16 ) , autoregressive models ( 14 ) , and foundation models ( 33 ) all proposed for CDR sequence–structure co-design. Yet despite this rapid progress, there is no standardized way to compare these methods. They are trained on different snapshots of the Structural Antibody Database (SAbDab) ( 10 ) with varying filtering criteria, evaluated on non-overlapping test sets from the RAbD dataset ( 2 ) to hold-outs, and scored with incompatible metrics computed under different definitions. For example, contact cutoffs vary from 4.5 to 6.6 Å across methods, and RMSD is computed with or without Kabsch alignment. The methods also require inputs in different and incompatible formats, making head-to-head comparison impractical without building separate data pipelines for each method. A more fundamental issue is the absence of a common task definition. The literature fragments antibody design into numerous sub-tasks, including inverse folding, structure prediction, co-design, docking, affinity optimization, de novo generation, and epitope-conditioned design, and individual methods address different subsets. This makes it unclear what is being compared, even when two papers report the same metric name. We argue that in many therapeutic settings, the target epitope is specified and propose epitope-conditioned CDR sequence–structure co-design as the canonical formulation. Given an antigen structure, an epitope specification, and an antibody framework, the task is to design CDR residues that are structurally valid, contact the target epitope, and avoid off-target binding. This formulation subsumes the sub-tasks above as special cases and accommodates all baseline methods. Methods that natively support epitope conditioning map directly to this definition, while the remaining methods can be evaluated as-is, with epitope-specificity metrics revealing whether their designs contact the intended site. We introduce Chimera-Bench ( C DR M odeling with E pitope-guided R edesign), a benchmark dataset for this task. Our contributions are: • A canonical problem definition that unifies seven sub-tasks from the literature into a single epitope-conditioned CDR co-design formulation. • A curated dataset of deduplicated, quality-filtered antibody–antigen complexes from SAbDab, CDR masks, epitope/paratope annotations, and contact maps. • Three evaluation splits (epitope-group, antigen-fold, and temporal), each with cluster-level leakage prevention, testing generalization along distinct biological axes. • A comprehensive evaluation protocol with five metric groups covering sequence quality, structural accuracy, binding interface quality, epitope specificity, and designability, including novel epitope-specificity metrics not reported by any existing method. 2 Related Work Antibody CDR design methods. Early learning-based approaches to CDR design were autoregressive. RefineGNN ( 14 ) generates CDR residues left-to-right while iteratively refining the predicted structure, and AbDockGen ( 13 ) combines hierarchical equivariant refinement with antibody–antigen docking. MEAN ( 15 ) recast the problem as E(3)-equivariant graph translation, and dyMEAN ( 16 ) extended this to end-to-end full-atom antibody design. RAAD ( 35 ) later introduced relation-aware equivariance for settings where the epitope is unknown. Diffusion models have since become the dominant paradigm, beginning with DiffAb ( 20 ) , which pioneered antigen-conditioned CDR diffusion over sequences, coordinates, and orientations simultaneously. AbX ( 41 ) augmented this framework with evolutionary and physical constraints, and LEAD ( 38 ) introduced property-guided sampling through black-box optimization in a shared latent space. dyAb ( 29 ) applies flow matching to flexible antibody design using AlphaFold-predicted pre-binding antigen conformations, and AbODE ( 32 ) formulates CDR generation through conjoined ODEs. RFAntibody ( 5 ) fine-tunes RFdiffusion on {\sim} 8,100 PDB antibody structures for de novo design of complete variable regions (VHHs and scFvs) conditioned on a target epitope. In the broader protein design space, BoltzGen ( 27 ) is an all-atom diffusion model that unifies binder design and structure prediction across modalities, including nanobodies, though it targets general binder design rather than CDR-level co-design. ProteinMPNN ( 8 ) , while also not antibody-specific, serves as a strong inverse folding baseline for CDR sequence design given a fixed backbone. Existing benchmarks and datasets. SAbDab ( 10 ) is the primary structural database for antibodies but provides no standardized splits, evaluation protocol, or task definition for generative design and contains redundant complexes that require preprocessing for training neural networks. The RAbD benchmark ( 2 ) defines 60 antibody–antigen complexes for CDR-H3 redesign but lacks epitope annotations and modern generative metrics such as DockQ or diversity. SKEMPI v2 ( 12 ) provides experimental binding affinity measurements for protein complexes including approximately 53 antibody entries, but targets mutation-level affinity prediction rather than generative design. AbBiBench ( 40 ) benchmarks antibody binding affinity maturation with 184,500+ experimental measurements across 14 antibodies, but focuses on affinity prediction rather than generative CDR design. In the broader protein domain, ProteinGym ( 23 ) benchmarks fitness prediction across 250+ deep mutational scanning assays and ATOM3D ( 30 ) defines molecular learning tasks on 3D structures, but neither addresses the antibody-specific challenges of CDR co-design, epitope conditioning, or binding interface evaluation. To our knowledge, Chimera-Bench is the first benchmark to combine standardized data curation, biologically motivated splits, epitope-specificity metrics, and cross-method format compatibility for computational antibody design. 3 The Chimera-Bench Benchmark 3.1 Task Definition As discussed above, the antibody design literature fragments the problem into numerous sub-tasks, and individual methods address different subsets. Chimera-Bench consolidates these into a single canonical task, epitope-conditioned CDR sequence–structure co-design , motivated by the observation that in many therapeutic settings the target epitope is specified. Given an antigen structure A=\{(s_{j},\mathbf{x}_{j})\mid j\in V_{A}\} , an epitope E\subseteq V_{A} , and an antibody framework F=\{(s_{i},\mathbf{x}_{i})\mid i\in V_{\text{FR}}\} , the task is to design CDR residues that maximize the learned conditional distribution while satisfying epitope contact and precision constraints. Following 20 , each residue is represented as a tuple of

Read the complete text