Harnessing Preference Optimisation in Protein LMs for Hit Maturation in Cell Therapy
Katarzyna Janocha, Annabel Ling, Alice Godson, Yulia Lampi, Nils Y. Hammerla · 2024
Read Harnessing Preference Optimisation in Protein LMs for Hit Maturation in Cell Therapy by Katarzyna Janocha, Annabel Ling, Alice Godson, Yulia Lampi, Nils Y. Hammerla (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01388.txt.
Introduction
Katarzyna Janocha and co-authors tune protein language models for cell therapy design in a 2024 paper. Cell therapies can treat cancer and autoimmune disease, but most lab candidates fail early. Data are scarce and cell systems are complex, so machine learning has lagged here. The team uses a high-throughput test platform to build training data for protein models.
Models tuned with a preference task mirror lab assay results surprisingly well, they report. The tuned models then guide few-shot improvement of CAR designs, the engineered receptors used in cell therapy. The authors present this as a proof of concept that could extend to other therapy types facing thin data.
Catalog record
| CREATOR | Katarzyna Janocha, Annabel Ling, Alice Godson, Yulia Lampi, Nils Y. Hammerla |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-01388
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Harnessing Preference Optimisation in Protein LMs for Hit Maturation in Cell Therapy Katarzyna Janocha, Annabel Ling, Alice Godson, Yulia Lampi, Nils Y. Hammerla Abstract Cell and immunotherapy offer transformative potential for treating diseases like cancer and autoimmune disorders by modulating the immune system. The development of these therapies is resource-intensive, with the majority of drug candidates failing to progress beyond laboratory testing. While recent advances in machine learning have revolutionised areas such as protein engineering, applications in immunotherapy remain limited due to the scarcity of large-scale, standardised datasets and the complexity of cellular systems. In this work, we address these challenges by leveraging a high-throughput experimental platform to generate data suitable for fine-tuning protein language models. We demonstrate how models fine-tuned using a preference task show surprising correlations to biological assays, and how they can be leveraged for few-shot hit maturation in CARs. This proof-of-concept presents a novel pathway for applying ML to immunotherapy and could generalise to other therapeutic modalities. 1 Introduction Cell and immunotherapy hold tremendous promise for treating traditionally incurable diseases, with applications ranging from oncology and autoimmune disorders to age-related conditions. The overarching goal is to modulate the patient’s immune response, either by directly engineering immune cells or by introducing engineered proteins to enhance or suppress immune function. The main modality we will explore in this work are Chimeric Antigen Receptors (CARs) - engineered proteins that are expressed on the surface of T-cells. CARs act as artificial receptors designed to bind to a specific antigen (target), for instance on the cell surface of a tumor, and trigger an immune response. The development of immunotherapies, and drug development in general, is a resource-intensive process. Despite extensive efforts to evaluate candidates in the lab, the great majority of identified drug compounds will fail to progress through clinical trials to become viable treatments for patients [ Mullard 2016 ] . To improve the performance of candidate drug compounds, the field of drug discovery has increasingly turned to computational approaches to make better use of experimental data and facilitate exploration of the vast design space for such molecules. Over recent years, the modelling of discrete time-series such as natural text has seen tremendous progress, where the capabilities of transformer-based language models [ Vaswani 2017 ] far exceeded the expectations by domain experts. Naturally, these methods have been applied to protein engineering, aiming to construct biologically relevant representations of amino-acid (or tokenised DNA-) sequences via masking [ Lin et al. 2023 , Hayes et al. 2024 ] or auto-regressive Protein Language Models (PLMs) [ Nijkamp et al. 2023 ] . Areas such as structure prediction Abramson et al. 2024 , structure generation [ Watson et al. 2023 ] , and protein-protein interactions such as docking [ Corso et al. 2022 ] have seen significant progress via large and sophisticated ML models based on transformers or diffusion generative models, among other approaches. This progress is largely spurred by the availability of relevant data at scale [ Suzek et al. 2015 , Steinegger and Söding 2018 ] and clearly defined research questions, which has led to a rich and mature ecosystem of academic and commercial interest around ML applications in protein engineering. Another area of focus has been around in-silico design and optimisation of antibodies [ Joubbi et al. 2024 ] , with large datasets available for academic and commercial use [ Olsen et al. 2022 ] . Applications include the virtual screening of potential binders [ Bachas et al. 2022 ] , affinity maturation [ Ruffolo et al. 2021 , Clark et al. 2023 , Hie et al. 2024 ] or the optimisation of enzymes [ He et al. 2024 ] . Much of the work in this space is driven by the availability of language models trained on antibody data, including masking [ Ruffolo et al. 2021 , Tobias H. Olsen and Deane 2022 , Prihoda et al. 2022 ] as well as auto-regressive models [ Shuai et al. 2021 , Nijkamp et al. 2023 ] . In contrast, ML applications in immunotherapy are relatively scarce, and have predominantly relied on basic ML such as motif-based optimisation of CARs [ Castellanos-Rueda et al. 2022 , Daniels et al. 2022 ] , with more sophisticated modelling only being explored recently for bispecific antibodies [ Mullin et al. 2024 ] . This is partly due to the lack of publicly accessible, standardized datasets, as well as the inherent complexity of the problem compared to small molecule drug design. The data in this field are influenced by a multitude of factors related to living cells, making it challenging to generate datasets at a scale sufficient for effective training or fine-tuning of large models. The field thus continues to rely on manual, predominantly low-throughput approaches to drug discovery. In this work we attempt to bridge this gap, demonstrating how large-scale, low-precision yet high throughput testing of thousands of drug compounds in cells can be harnessed to generate data suitable for fine-tuning PLMs for the task of hit maturation in CARs. We show, perhaps surprisingly, that model loss of an auto-regressive PLM, fine-tuned using a preference task, is highly correlated to the results of standard biological assays, and that we can reliably find improved mutants via few-shot exploration of the design space. This provides a proof-of-concept that such models can effectively guide the design of CARs, which could generalise to other modalities in immunotherapy. 2 Chimeric Antigen Receptors (CARs) Figure 1: CAR structure with scFV and VHH binding domains (see text for details). Briefly, immunotherapies use a variety of mechanisms to harness the immune system to recognise and eliminate diseases. These immunotherapies include monoclonal antibodies (mAb), checkpoint inhibitors, T cell engagers and CAR-T cell therapy. CAR-T cell therapy has predominantly been used to treat haematological malignancies such as multiple myeloma and leukemia, where it may lead to complete remission in a significant fraction of patients [ Cappell and Kochenderfer 2023 ] . It also shows potential in other malignant diseases and autoimmune diseases [ Blache et al. 2023 ] . Typically, a CAR consists of a binding domain which binds to antigens on tumour cells, a hinge domain that gives the binder flexibility, a transmembrane domain that anchors the CAR to the T cell membrane, and a signalling domain which facilitates T cell activation (Figure 1 ). Various types of binding domains can be presented on the CAR, but most common are those based on single-chain fragment variable (scFv) of mAb. In contrast, here we explore the use and optimisation of variable heavy domain of heavy chain (VHH) fragments, which are antibody fragments naturally derived from the Camelidae family. scFvs and VHH fragments are comparable in terms of affinity [ Muyldermans 2013 ] yet the reduced size of VHHs promotes advantageous stability, solubility and immunogenicity characteristics [ Gorovits and Koren 2019 ] . VHHs consist of three hypervariable complementary determining regions (CDRs) interspersed with framework regions (FRs), as depicted in Figure 1 . CDRs play a critical role in antigen binding, with their flexible structures adapting to fit the binding site. In contrast, FRs serve as a scaffold to support the CDRs for effective antigen binding, and therefore exhibit significantly less sequence diversity in comparison to