Tokenizing Loops of Antibodies

Ada Fang, Robert G. Alberstein, Simon Kelow, Frédéric A. Dreyer · 2025

Read Tokenizing Loops of Antibodies by Ada Fang, Robert G. Alberstein, Simon Kelow, Frédéric A. Dreyer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-08707.txt.

Introduction

Ada Fang and 3 co-authors introduce Igloo, a tokenizer for antibody loops, in a 2025 paper. Antibody loops called CDRs bind to antigens and shape new drug design. Older grouping methods cover only part of loop diversity and fit poorly with protein foundation models.

Igloo encodes both backbone angles and sequence, trained so similar loops sit close in latent space. It retrieves matching loops better than prior methods and assigns tokens to all loops. Added to protein language models, it improves binding prediction on most targets tested. It also samples new loops that are diverse in sequence yet consistent in structure.

Catalog record

CREATORAda Fang, Robert G. Alberstein, Simon Kelow, Frédéric A. Dreyer
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-08707

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Tokenizing Loops of Antibodies Ada Fang, Robert G. Alberstein, Simon Kelow, Frédéric A. Dreyer Abstract The complementarity-determining regions (CDRs) of antibodies are loop structures that are key to their interactions with antigens, and of high importance to the design of novel biologics. Since the 1980s, categorizing the diversity of CDR structures into canonical clusters has enabled the identification of key structural motifs of antibodies. However, existing approaches have limited coverage and cannot be readily incorporated into protein foundation models. Here we introduce I mmuno G lobulin LOO p Tokenizer, Igloo , a multimodal antibody loop tokenizer that encodes backbone dihedral angles and sequence. Igloo is trained using a contrastive learning objective to map loops with similar backbone dihedral angles closer together in latent space. Compared to state-of-the-art protein encoding approaches, Igloo can efficiently retrieve the closest matching loop structures from a structural antibody database, outperforming the existing methods on identifying similar H3 loops by 5.9%. Igloo assigns tokens to all loops, addressing the limited coverage issue of canonical clusters, while retaining the ability to recover canonical loop conformations. To demonstrate the versatility of Igloo tokens, we show that they can be incorporated into protein language models with IglooLM and IglooALM . On predicting binding affinity of heavy chain variants, IglooLM outperforms the base protein language model on 8 out of 10 antibody-antigen targets. Additionally, it is on par with existing state-of-the-art sequence-based and multimodal protein language models, performing comparably to models with 7 × 7\times more parameters. IglooALM samples antibody loops which are diverse in sequence and more consistent in structure than state-of-the-art antibody inverse folding models. Igloo demonstrates the benefit of introducing multimodal tokens for antibody loops for encoding the diverse landscape of antibody loops, improving protein foundation models, and for antibody CDR design. 1 Introduction Antibodies are a class of proteins that are essential in the body’s immune response and a widely used therapeutic modality ( Crescioli et al. 2025 ) . They are comprised of two identical light and two identical heavy chains. The light and heavy chains are divided into a constant and variable domain, where the variable domain is comprised of complementarity-determining regions (CDRs), 1 1 1 Here we consider four CDR regions. The fourth CDR is the loop joining the D and E strands adjacent to CDR1 and CDR2, which is often considered part of the framework ( Kelow et al. 2020 ) . which are structurally distinct flexible loops between antiparallel beta strands in the immunoglobulin fold. The CDRs play an essential role in the antibody’s ability to recognize and bind antigens in a highly specific manner ( Xu & Davis 2000 ) . Protein and antibody language models trained on amino acid sequence tokens have been powerful for learning evolutionary patterns that are useful for function prediction ( Kulmanov et al. 2024 ) , sequence design ( Zhao et al. 2025b ) , and variant effect prediction ( Hie et al. 2024 ; Notin et al. 2023 ) . Recently, the development of multimodal protein language models ( Su et al. 2023 ; Heinzinger et al. 2024 ; Hayes et al. 2025 ) has expanded to incorporate structure tokens in addition to sequence tokens. However, such approaches tokenize structures at the amino acid level, focus on reconstruction, and do not consider the higher-level organization and modularity of protein domains ( Sigrist et al. 2010 ; Mistry et al. 2021 ) . A multimodal tokenizer for antibodies should therefore consider the inherent organisation in antibody structures and sequences for effective representation learning. Tokenization or clustering of immunoglobulin loop regions based on their dihedral backbone angles into ‘canonical clusters’ has been adopted since Chothia & Lesk 1987 . Such a grouping of loops has been useful for understanding the structural diversity of antibodies ( Teplyakov et al. 2016 ) , designing antibody loops with consistent structure and diverse sequences ( Adolf-Bryfogle et al. 2018 ) , and for studying conformational changes of antibody loops in MD simulations ( Fernández-Quintero et al. 2020 ; Fernández-Quintero et al. 2019 ) . These approaches are limited by their (1) limited coverage of antibody structures, with 20.3% of all loops having no known matching canonical cluster, including 76.3% of H3 loops (Table E.2 ), (2) all existing clusters only consider backbone coordinates or dihedral angles, without incorporating sequence information, and (3) existing clusters cannot be readily applied to protein language models. Thus, the tokenization of immunoglobulin loops for multimodal representation remains an open challenge. Figure 1: Left Igloo is a multimodal tokenizer for antibody loops. Right Organization of the Igloo latent space is achieved through a contrastive learning objective on dihedral angle distance between backbones. Present work. We introduce I mmuno G lobulin LOO p Tokenizer, Igloo , a multimodal antibody loop tokenizer for encoding backbone dihedral angles and sequence (Fig. 1 ). Unlike existing structure tokenizers, which focus on the amino acid scale, Igloo tokenizes at the substructure loop level. Igloo is trained on 807,815 loop regions from heavy and light chains of experimentally-derived and computationally predicted structures. We develop a contrastive learning objective based on the dihedral angle distance defined by North et al. 2011 to train Igloo . While being a self-supervised model, Igloo successfully reproduces known canonical conformations assigned for 90.6% of loops in SAbDab Dunbar et al. 2014 . To demonstrate the versatility and utility of Igloo tokens, we present three key applications: • Retrieval of similar loop structures from large structural databases. By learning to compare loop structures, Igloo retrieves more similar loop structures from SAbDab compared to state-of-the-art protein encoding approaches. For the H3 loop, which exhibits the most sequence and structure diversity, Igloo outperforms the previous best model on retrieving H3 loops with similar dihedral angle backbones by 5.9%. • Improved antibody affinity prediction with protein language models. We incorporate Igloo loop tokens into an antibody language model, and train IglooLM . By using the representations learned from IglooLM to predict binding affinity of heavy chain variants, we show it outperforms the base model on 8 out of 10 antibody-antigen targets and performs on par to models with 7\times more parameters. • Sampling diverse loops with consistent structure. IglooALM is a protein language model with the Igloo loop tokens and Igloo multimodal residue tokens. When loop sequences are masked out, the loops sampled from IglooALM are diverse in sequence and more consistent in structure than state-of-the-art antibody inverse folding models. Redesigned CDR H3 loops of a SARS-CoV-2 antibody with IglooALM achieves an average sequence identity of 0.27 while achieving less than 1Å RMSD to the original loop. By introducing multimodal tokens for antibody loops, Igloo captures the structural and functional diversity of loop conformations, improving the expressiveness of protein foundation models and advancing rational antibody design. 2 Related Work Tokenization of protein structure. The construction of classifications of protein structures at the domain level has been applied for understanding the relationship with domain function ( Lo Conte et al. 2000 ; Ouzounis et al. 2003 ; Sigrist et al. 2010 ; Mistry et al. 2021 ) . Learning structurally informed residue-level representations can be achieved with geometric features ( Jing et al. 2020 ) , multiview contrastive learning between sequence

Read the complete text