Self-Improvement Imitation with Biologically Guided Search for Protein Design Under Oracle Budgets
Ashima Khanna, Dominik Grimm, [1ex] Bioinformatics, Technical University of MunichTUM Campus Straubing, 94315 Straubing, Germany, [0.5ex] University of Applied Sciences Weihenstephan-Triesdorf, 94315 Straubing, Germany[1ex] {ashima.khanna, dominik.grimm}@tum.de · 2026
Read Self-Improvement Imitation with Biologically Guided Search for Protein Design Under Oracle Budgets by Ashima Khanna, Dominik Grimm, [1ex] Bioinformatics, Technical University of MunichTUM Campus Straubing, 94315 Straubing, Germany, [0.5ex] University of Applied Sciences Weihenstephan-Triesdorf, 94315 Straubing, Germany[1ex] {ashima.khanna, dominik.grimm}@tum.de (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26690.txt.
Introduction
Khanna and Grimm introduce SILO, a method for designing protein sequences when only a small number of lab evaluations is affordable. The system proposes mutations in two steps, first choosing a position and then a replacement residue, and learns by imitating the best trajectories found so far. Tested on eight protein fitness landscapes, SILO beats five rival methods on the highest and average top-100 fitness scores, and stays strong when data are scarce or noisy.
Catalog record
| CREATOR | Ashima Khanna, Dominik Grimm, [1ex] Bioinformatics, Technical University of MunichTUM Campus Straubing, 94315 Straubing, Germany, [0.5ex] University of Applied Sciences Weihenstephan-Triesdorf, 94315 Straubing, Germany[1ex] {ashima.khanna, dominik.grimm}@tum.de |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76193 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.26690
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Self-Improvement Imitation with Biologically Guided Search for Protein Design Under Oracle Budgets Ashima Khanna, Dominik Grimm, [1ex] Bioinformatics, Technical University of MunichTUM Campus Straubing, 94315 Straubing, Germany, [0.5ex] University of Applied Sciences Weihenstephan-Triesdorf, 94315 Straubing, Germany[1ex] {ashima.khanna, dominik.grimm}@tum.de Abstract Protein sequence optimization under tight oracle budgets requires methods that explore vast combinatorial spaces while making each evaluation informative. Existing reinforcement learning and off-policy generative approaches often degrade under surrogate noise, and position-agnostic mutation proposals risk disrupting functionally critical residues. We introduce SILO, a trajectory-level self-improvement imitation framework for oracle-budgeted protein design. SILO uses a hierarchical edit policy that decomposes each mutation into a position choice followed by a residue choice. In each active-learning round, the policy samples candidate trajectories via incremental stochastic beam search without replacement (SBS), and a UCB-based proxy ensemble, combined with an alanine-scan fitness score (AFS), selects candidates with functionally relevant edits for in silico oracle evaluation. The policy is then updated by next-action cross-entropy imitation on the round’s best oracle-labeled trajectories, avoiding value-function estimation. Across eight reproduced protein fitness landscapes and five strong baselines from prior work, SILO achieves the highest maximum and top-100 mean fitness on 8 of 8 landscapes within our evaluations, often exhibiting faster early-stage improvement. In low-data and noisy-proxy stress tests on two landscapes per setting, SILO remains competitive or best when several baselines degrade. Ablations show that SBS with AFS account for much of the gains, with iterative imitation providing additional improvement. Code is available at: https://github.com/grimmlab/SILO.git † † footnotetext: Code available at: https://github.com/grimmlab/SILO.git 1 Introduction Protein engineering enables the development of proteins with tailored functional properties, with applications ranging from therapeutics to enzyme engineering [ 35 , 30 , 23 ] . This engineering can be framed as a sequential-decision making optimization problem under a strict evaluation budget, where the goal is to propose mutations to an initial sequence that maximize a "fitness" function quantifying a desired property such as thermostability, binding affinity, or catalytic efficiency. The problem is challenging due to the combinatorial size of the sequence space [ 13 ] and the prevalence of epistasis, which yields rugged, sparse, and highly non-convex fitness landscapes [ 10 ] . Locally plausible edits can produce highly non-additive outcomes, making efficient exploration critical. A range of learning- and search-based methods address this problem. Reinforcement learning (RL) approaches optimize a generative policy via on-policy algorithms such as proximal policy optimization (PPO) [ 38 ] using learned reward models [ 2 , 24 ] . Self-play approaches based on AlphaZero [ 40 ] combine policy-value networks with Monte Carlo Tree Search [ 21 ] , enabling structured exploration through look-ahead search [ 48 , 25 ] . Generative methods such as GFlowNets [ 3 ] instead learn to sample diverse high-reward candidates via off-policy training [ 15 ] on existing datasets. Despite these advances, sequence optimization under limited evaluation budgets faces three persistent challenges. First, value-based optimization can be unstable, sensitive to hyperparameters [ 38 , 12 ] , and prone to error propagation when value estimates are computed over noisy surrogate rewards [ 1 ] . Although off-policy generative methods improve stability [ 15 ] , they remain sensitive to the quality and coverage of training data. This can lead to distributional shifts and poor generalization to unseen regions [ 39 ] . Moreover, their performance degrade under unreliable reward estimates when evaluating out-of-distribution generated candidates [ 17 , 45 ] . Second, mutational proposals are typically position-agnostic, and edits at conserved residues can compromise protein function. Third, efficient exploration under strict evaluation budgets requires prioritizing high-value regions while avoiding redundant evaluations. Together, these challenges motivate approaches that integrate robust learning, structured search, and biologically informed selection. Recent works in neural combinatorial optimization (NCO) have explored self-improvement imitation learning (SIL) [ 27 , 32 , 7 ] as an alternative to value-based optimization. SIL iteratively improves a policy by supervised next-action prediction on trajectories that produced the highest-quality solutions found so far, relying on strong sampling procedures to generate candidates. Crucially, because the training signal comes from the actions of oracle-labeled top performers rather than from value estimates over a noisy surrogate, SIL sidesteps the value-propagation failures that destabilize RL under approximate rewards. While effective in settings such as routing problems with cheap evaluation, adapting SIL to oracle-budgeted settings with limited or noisy feedback is non-trivial. Evaluations must be allocated carefully, and the sampling procedure must surface candidates that are both promising under the surrogate and unlikely to disrupt protein function. Main contributions Motivated by the challenges above, we introduce SILO, an active-learning framework that combines structured sampling , biologically-informed selection , and trajectory-level imitation learning . Our contributions are: 1. Structured sampling and biologically informed selection. We combine incremental stochastic beam search without replacement (SBS) [ 22 ] for diverse trajectory generation with a UCB acquisition function augmented by an alanine-scan fitness score (AFS) [ 20 ] that down-weights candidates whose mutated positions are predicted to be functionally disruptive. Ablations indicate that this combination drives the majority of performance gains across evaluated tasks. 2. Adapting trajectory-level SIL to oracle-budgeted protein design. Building on the SIL paradigm of Pirnay and Grimm 2024 , we train a transformer-based hierarchical edit policy over frozen ESM Cambrian embeddings, decomposing each mutation into a position choice followed by a residue choice, and learning from action trajectories of oracle-labeled top performers. This provides additional improvements over the structured sampling and selection. 3. Empirical analysis under realistic constraints. Across eight protein fitness landscapes and five reproduced baselines, our approach consistently identifies high-fitness candidates across all landscapes. Under low-data and noisy-proxy conditions on four tasks, our performance remains stable and competitive where several baselines degrade. 2 Problem formulation We consider protein sequence optimization over a discrete sequence space. Let x\in\mathcal{V}^{L} denote a protein sequence of length {L} , where \mathcal{V} is a finite vocabulary of |\mathcal{V}|=20 (the standard amino acids). The objective is to maximize an expensive-to-evaluate oracle fitness function O:\mathcal{V}^{L}\to\mathbb{R} measuring a desired property such as binding affinity, thermostability, or activity. We assume that oracle evaluations are expensive and only available through queries. The optimization proceeds in an active-learning setting, following prior protein design works [ 2 , 15 ] . We assume access to an initial dataset \mathcal{D}_{0}=\{(x_{i},O(x_{i}))\}_{i=1}^{M_{0}} of M_{0}=|\mathcal{D}_{0}| oracle-labeled sequences, and initialize a starting sequence as x_{\text{start}}= argmax {}_{x\in\mathcal{D}_{0}}O(x) . At each active-learning round n\in\{1,\ldots,N\} , we select a batch B_{n}\subset\mathcal{V}^{L} of K candidate sequences for oracle evaluation, where K is the per-round oracle query budget and each candidate differs from x_{start} by at most d_{max} mutations. After observing their oracle fitness values, the dataset is updated as \mathcal{D}_{n}=\mathcal{D}_{n-1}\cup\{(x,O(x)):x\in B_{n}\} , giving a total of at most NK new oracle evaluations. Because direct oracle evaluation is limited, we train a proxy model f_{\phi} on the currently available oracle-labeled dataset by minimizing \mathcal{L}({\phi})=\mathbb{E}_{(x,O(x))\sim\mathcal{D}_{n-1}}\left[(O(x)-f_{\phi}(x))^{2}\right] (1) The proxy guides candidate selection before oracle evaluation, while final performance is always measured by the oracle O . The goal is to design sequences with higher fitness than x_{start} within the budget NK . 3 Active learning with SILO We follow an active learning loop, namely iterating over four steps, as illustrated in Figure 1 and outlined in Algorithm 1 :