Low-N Protein Activity Optimization with FolDE
Jacob B. Roberts, Catherine R. Ji, Isaac Donnell, Thomas D. Young, Allison N. Pearson, Graham A. Hudson, Leah S. Keiser, Mia Wesselkamper, Peter H. Winegar, Janik Ludwig, Sarah H. Klass, Isha V. Sheth, Ezechinyere C. Ukabiala, Maria C. T. Astolfi, Benjamin Eysenbach, Jay D. Keasling · 2025
Read Low-N Protein Activity Optimization with FolDE by Jacob B. Roberts, Catherine R. Ji, Isaac Donnell, Thomas D. Young, Allison N. Pearson, Graham A. Hudson, Leah S. Keiser, Mia Wesselkamper, Peter H. Winegar, Janik Ludwig, Sarah H. Klass, Isha V. Sheth, Ezechinyere C. Ukabiala, Maria C. T. Astolfi, Benjamin Eysenbach, Jay D. Keasling (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24053.txt.
Introduction
Jacob B. Roberts and fifteen co-authors present FolDE, a method for optimizing proteins with very few experiments. Improving a protein means building and measuring mutants, which is slow and expensive. Active learning-guided directed evolution cuts the cost by predicting winners and testing in rounds, but naive rounds pick the top predictions, yielding look-alike training data that starves later rounds.
FolDE is designed to maximize campaign success. Its engine is naturalness-based warm-starting: outputs from a protein language model augment the activity measurements and sharpen predictions from the start. A constant-liar batch selector adds diversity, which matters in multi-mutation campaigns. Across simulations on twenty protein targets, FolDE found twenty-three percent more top-decile mutants than the baseline and was fifty-five percent likelier to land a top one percent mutant. The workflow is open source, putting the savings within any lab's reach.
Catalog record
| CREATOR | Jacob B. Roberts, Catherine R. Ji, Isaac Donnell, Thomas D. Young, Allison N. Pearson, Graham A. Hudson, Leah S. Keiser, Mia Wesselkamper, Peter H. Winegar, Janik Ludwig, Sarah H. Klass, Isha V. Sheth, Ezechinyere C. Ukabiala, Maria C. T. Astolfi, Benjamin Eysenbach, Jay D. Keasling |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-24053
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Low-N Protein Activity Optimization with FolDE Jacob B. Roberts, Catherine R. Ji, Isaac Donnell, Thomas D. Young, Allison N. Pearson, Graham A. Hudson, Leah S. Keiser, Mia Wesselkamper, Peter H. Winegar, Janik Ludwig, Sarah H. Klass, Isha V. Sheth, Ezechinyere C. Ukabiala, Maria C. T. Astolfi, Benjamin Eysenbach, Jay D. Keasling Abstract Proteins are traditionally optimized through the costly construction and measurement of many mutants. Active Learning-assisted Directed Evolution (ALDE) alleviates that cost by predicting the best improvements and iteratively testing mutants to inform predictions. However, existing ALDE methods face a critical limitation: selecting the highest-predicted mutants in each round yields homogeneous training data insufficient for accurate prediction models in subsequent rounds. Here we present FolDE, an ALDE method designed to maximize end-of-campaign success. In simulations across 20 protein targets, FolDE discovers 23% more top 10% mutants than the best baseline method (p=0.005) and is 55% more likely to find top 1% mutants. FolDE achieves this primarily through naturalness-based warm-starting, which augments limited activity measurements with protein language model outputs to improve activity prediction. We also introduce a constant-liar batch selector, which improves batch diversity; this is important in multi-mutation campaigns but had limited effect in our benchmarks. The complete workflow is freely available as open-source software, making efficient protein optimization accessible to any laboratory. 1 Joint BioEnergy Institute, Emeryville, CA, USA 2 Department of Bioengineering, UCSF / UCB 3 Biological Systems and Engineering, Lawrence Berkeley National Laboratory, Berkeley, CA, USA 4 Princeton University 5 Chemistry Department, UCB 6 Department of Plant and Microbial Biology, UCB 7 QB3 Institute, University of California, Berkeley, CA, USA 8 Department of Chemical and Biomolecular Engineering, UCB 9 Bioengineering Department, UCB 10 Faculty of Biology, Ludwig-Maximilians-Universität München 11 Chemical Biology Department, UCB 12 The Novo Nordisk Foundation Center for Biosustainability, Technical University Denmark, Kemitorvet, Kongens Lyngby, Denmark # Corresponding authors: Jay D. Keasling ( [email protected] ); Benjamin Eysenbach ( [email protected] ) Keywords Low-N Protein Engineering \cdot ALDE \cdot Reinforcement Learning 1 Introduction Proteins power processes in medicine, manufacturing, and agriculture. The relationship between a protein’s sequence and its activity defines a complex, often rugged landscape ( Wu et al. 2016 ; Meger et al. 2024 ; Husain and Murugan 2020 ) . Protein language models (PLMs) – neural networks trained on databases of naturally occurring protein sequences – have emerged as powerful tools for navigating these landscapes ( Jiang et al. 2025 ; Yang et al. 2025 ; Meier et al. 2021 ; Alley et al. 2019 ) . PLMs learn to predict how likely a given amino acid sequence is to occur in nature. They provide two key capabilities. First, the relative probability a PLM assigns to a mutated sequence, which we term its naturalness, correlates with protein activity ( Hie et al. 2022 ; Meier et al. 2021 ) . Second, PLMs can convert variable-length sequences into fixed-length embeddings, which can be used to extrapolate between sequences with known activity ( Alley et al. 2019 ) . Directed evolution improves protein activity through sequential rounds of mutation and screening or selection ( Sellés Vidal et al. 2023 ) . Traditional campaigns require thousands to millions of mutants, but many targets lack high-throughput screens, limiting researchers to dozens of mutants. Active learning for directed evolution (ALDE) methods make optimization feasible under these constraints by using computational models to select batches of mutants between rounds ( Yang et al. 2025 ) . State-of-the-art ALDE methods achieve impressive results: EVOLVEpro successfully improved five targets with as few as 16 mutants per round ( Jiang et al. 2025 ) . The methods are varied but follow key patterns. Most begin with randomly selected mutants in the first round ( Bao et al. 2022 ) ; others begin with the top ranked naturalness mutants ( Singh et al. 2025 ) . In later rounds, they predict activities for a pool of prospective mutants, often using PLM embeddings, then select the highest ranked (top-N selection). While successful, current approaches leave unresolved tradeoffs. There is no consensus on the impact of starting a campaign with naturalness-based mutants, and there is no clearly successful mechanism for diversifying selected mutants while continuing to search for top performers. We consider protein optimization as an iterative, closed loop process in which decisions in each round determine the data available in later rounds. Through this lens, we identify two failure modes of current methods that occur in such small-budget protein optimization campaigns. First, there is tension between round-1 and round-2 model performance. Starting a campaign with naturalness-based zero-shot selection in round-1 provides much better mutants than random selection (3.8× more top 10% mutants, 3.6× higher chance of finding a top 1% mutant, Fig. 1 b,c), but this early exploitation comes at a cost. The resulting mutants are clustered in high naturalness regions of sequence space, providing insufficient diversity to train conventional activity prediction models (like random forest) in round-2. As a result, starting a campaign with naturalness-based selection yields better mutants in round-1, but no better than random mutants in round-2. Second, in later rounds, the highest ranked mutants selected are often slight variants of top performing mutants from previous rounds, providing little new information about the activity landscape. These failure modes are manifestations of a classic exploration-exploitation tradeoff ( Berger-Tal et al. 2014 ) in an iterative, data-limited problem. We present the FolDE (Foldy’s Directed Evolution) protein optimization method, which avoids some pitfalls of over-exploration or -exploitation. FolDE includes two new policies: incorporation of PLM outputs in activity prediction with naturalness warm-starting and diversity-aware batch selection (Fig. 1 a). In simulation, we compared FolDE to a random forest ALDE baseline (representing EVOLVEpro): FolDE discovers about 23% more top 10% mutants in rounds 1-3 (p=0.005), and is 55% more likely to find a top 1% mutant. FolDE is released as open-source software with a user interface, making sophisticated protein optimization accessible to any lab. Figure 1: The FolDE Workflow (a) schematic of the FolDE workflow, starting with the zero-shot prediction before data has been collected, followed by few-shot prediction and Bayesian batch building, in a design-build-test-learn cycle. (b) Performance on the single-mutation and (c) multi-mutation benchmark for FolDE vs three baselines: random selection, zero-shot naturalness-based selection, and a random forest with embeddings (representing EVOLVEpro, Jiang et al. 2025 ). Metrics shown are the cumulative top 10% mutants discovered (top) and probability of finding a top 1% mutant (bottom). 2 Main Text 2.1 Experimental Design To develop and evaluate protein optimization workflows, we created an iterative simulation benchmark using pre-collected data from ProteinGym ( Notin et al. 2023a ) . We partitioned ProteinGym datasets into a training set of 9 proteins for workflow development and a test set comprising 17 single-mutation and 3 multi-mutation datasets (Table S1). In each simulation, workflows iteratively select batches of 16 mutants across three rounds (48 total mutants), mimicking real low-throughput protein engineering campaigns. FolDE was developed and optimized using the training datasets, and then compared to baselines on the single- and multi-mutation sets. Real protein optimization campaigns routinely explore sequence space six or more mutations away from the wild-type sequence, with some campaigns venturing as far as 29 mutations ( Patsch et al. 2024 ; Cobb et al. 2013