RosettaSearch: Multi-Objective Inference-Time Search for Protein Sequence Design

Meghana Kshirsagar, Allen Nie, Ching-An Cheng, Fanglei Xue, Rahul Dodhia, Juan Lavista Ferres, Kevin K. Yang, Frank DiMaio · 2026

Read RosettaSearch: Multi-Objective Inference-Time Search for Protein Sequence Design by Meghana Kshirsagar, Allen Nie, Ching-An Cheng, Fanglei Xue, Rahul Dodhia, Juan Lavista Ferres, Kevin K. Yang, Frank DiMaio (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17175.txt.

Introduction

Kshirsagar and seven colleagues present RosettaSearch, an inference-time tool for backbone-based sequence design. Large language models act as the tool inside a search algorithm balancing search and use, scored by RosettaFold3 on a fixed budget. Applied to 400 weak strings from LigandMPNN, it finds designs that single-pass decoding misses. Design scores improve by 18 to 68 percent, and success rate rises 2.5-fold over the baseline. Gains hold under an outside Chai-1 check, reach across two model families, and extend to ProteinMPNN designs on de novo backbones.

Catalog record

CREATORMeghana Kshirsagar, Allen Nie, Ching-An Cheng, Fanglei Xue, Rahul Dodhia, Juan Lavista Ferres, Kevin K. Yang, Frank DiMaio
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54427
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17175

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RosettaSearch: Multi-Objective Inference-Time Search for Protein Sequence Design Thanks: prior work before joining Thanks: partial work done previously at Microsoft Research Meghana Kshirsagar, Allen Nie, Ching-An Cheng, Fanglei Xue, Rahul Dodhia, Juan Lavista Ferres, Kevin K. Yang, Frank DiMaio Abstract We introduce RosettaSearch, an inference-time multi-objective optimization approach for backbone conditioned protein sequence design. We use large language models (LLMs) as a generative optimizer within a search algorithm capable of controlled exploration and exploitation, using rewards computed from RosettaFold3, a structure prediction model, under a strict computational budget. In a large-scale evaluation, we apply RosettaSearch to 400 suboptimal sequences generated by LigandMPNN (a state-of-the-art model trained for protein sequence design), recovering high-fidelity designs that LigandMPNN’s single-pass decoding fails to produce. RosettaSearch’s designs show improvements in structural fidelity metrics ranging between 18% to 68%, translating to a 2.5 × \times improvement in design success rate. We observe that these gains in success rate are robust when RosettaSearch-designed sequences are evaluated with an independent structure prediction oracle (Chai-1) and generalize across two distinct LLM families (o4-mini and Gemini-3), with performance scaling consistently with reasoning capability. We further demonstrate that RosettaSearch improves the sequence fidelity of ProteinMPNN designs for de novo backbones from the Dayhoff atlas, showing that the approach generalizes beyond native protein structures to computationally generated backbones. We also demonstrate a multi-modal extension of RosettaSearch with vision-language models, where images of predicted protein structures are used as feedback to incorporate structural context to guide protein sequence generation. To our knowledge, this is the first large-scale demonstration that LLMs can serve as effective generative optimizers for backbone-conditioned protein sequence design, yielding systematic gains without any model retraining. 1 Introduction Protein sequence design — the task of identifying amino acid sequences that fold into a target three-dimensional structure with desired functional properties - is a foundational challenge in computational biology with broad implications for drug discovery, enzyme engineering, the design of novel therapeutics etc. We focus specifically on backbone-conditioned sequence design : given a fixed target backbone structure, find a sequence that confidently and accurately folds into it. We use the term fidelity to refer to this property — whether a designed sequence, when its structure is predicted independently, recapitulates the target backbone with high confidence and geometric accuracy. Despite remarkable progress in deep learning approaches to backbone-conditioned sequence design such as LigandMPNN 8 and ProteinMPNN 7 , a persistent and practically significant gap remains: sequences generated by state-of-the-art models frequently exhibit low fidelity 3 . This matters because fidelity is the key bottleneck between computational protein design and experimental success: a sequence that cannot be reliably predicted to adopt the target structure is unlikely to do so in the wet lab, wasting costly synthesis and experimental validation effort. The core difficulty is that backbone-conditioned sequence design is a high-dimensional, combinatorial optimization problem. The sequence space over amino acid alphabets is astronomically large, structural evaluation is expensive (requiring a full structure prediction call per candidate), and the relationship between sequence and fold is highly non-linear, with many local optima. Current approaches fall short in complementary ways. Single-pass sequence design models operate through a single forward pass of autoregressive decoding with no mechanism for self-correction: when a generated sequence lands in a low-fidelity region of sequence space, the model cannot recover since it cannot revisit or revise its output in response to downstream structural feedback. As a consequence, a meaningful fraction of designed sequences exhibit poor predicted structural confidence and geometric deviation from the target backbone, even when the model is given the native template as input. Optimization-based alternatives — reinforcement learning, directed evolution, and preference fine-tuning — enable iterative improvement but require task-specific training that is expensive and inflexible to new objectives. LLMs have been explored for protein design but only in one-shot settings, producing sequences with substantially lower structural fidelity than task-specific models 32 . Generative optimization with LLMs has shown promise in other discrete optimization settings such as prompt, code, and hyperparameter optimization ( 14 ; 2 ) , but its potential as an optimizer for backbone-conditioned sequence design — capable of reasoning over structural feedback and proposing targeted sequence modifications — has not been systematically explored. See Section 2 for a full discussion of related work. We introduce RosettaSearch (See Figure 2 ), an inference-time multi-objective optimization approach that addresses these limitations by deploying LLMs as generative optimizers within a structured search algorithm guided by structural rewards. Rather than asking an LLM to design a sequence from scratch — a task that strains its implicit knowledge of sequence-structure relationships — RosettaSearch instead asks it to refine an existing candidate by reasoning over structured feedback from a structure prediction model (RosettaFold3 6 ). This feedback combines global scalar rewards (derived from structure prediction metrics) with local, residue-level annotations identifying problematic regions. The LLM uses this feedback to propose targeted sequence edits within a priority search algorithm that explores multiple modification trajectories in parallel, avoiding premature convergence. Because the reward function and feedback can be redefined at inference time, RosettaSearch requires no retraining or fine-tuning to adapt to new design objectives. We also extend the framework to vision-language models (VLMs), incorporating rendered images of predicted structures as feedback to provide additional spatial context, and find that this produces richer reasoning in the model’s chain-of-thought. To the best of our knowledge, this is the first large-scale demonstration that LLMs can function as effective generative optimizers for backbone-conditioned sequence design, yielding systematic gains over popular baselines without retraining or task-specific fine-tuning. Figure 1 : Inference-time optimization with RosettaSearch dramatically improves the structural fidelity of designed protein sequences. For a protein in our dataset (PDB: 7z05 ), RosettaSearch transforms a low-fidelity LigandMPNN design into a near-native structure, achieving large gains in pLDDT, TM-score, and RMSD using only inference-time feedback, without model retraining. We show the single sequence pLDDT obtained on each predicted structure (no multiple sequence alignment, i.e. MSA input). Also shown is the TM-score obtained by comparing the predicted structure to the PDB structure in blue. (1. Blue) Native 3D structure downloaded from PDB. (2. Golden) Predicted structure given the native sequence. (3. Red) Predicted structure of the best design generated by LigandMPNN. (4. Green) Predicted structure of the best design generated by RosettaSearch. Arrows next to the metrics indicate the desired direction of improvement. See Table 9 for the amino-acid sequences corresponding to each structure. Additional examples of structures that were optimized by RosettaSearch are shown in Figure 5 (native monomers) and Figure 6 (Dayhoff atlas backbones). 2 Related Work Backbone-conditioned sequence design. The dominant paradigm for backbone-conditioned sequence design involves learning a direct mapping from a fixed three-dimensional backbone structure (i.e. the 3D coordinates of backbone atoms are the inputs) to a compatible amino acid sequence (amino acid sequence is the output). Models such as ProteinMPNN 7 and LigandMPNN 8 exemplify this approach, achieving strong sequence recovery rates on held-out structures and serving as widely adopted tools in the protein design community. However, these models operate through a single forward pass of autoregressive decoding and are optimized for sequence recovery rather than structural fidelity under independent evaluation. As a result, a meaningful fraction of their designs exhibit low confidence or poor geometric

Read the complete text