ProtInvTree: Deliberate Protein Inverse Folding with Reward-guided Tree Search

Mengdi Liu, Xiaoxue Cheng, Zhangyang Gao, Hong Chang, Cheng Tan, Shiguang Shan, Xilin Chen · 2025

Read ProtInvTree: Deliberate Protein Inverse Folding with Reward-guided Tree Search by Mengdi Liu, Xiaoxue Cheng, Zhangyang Gao, Hong Chang, Cheng Tan, Shiguang Shan, Xilin Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00925.txt.

Introduction

Mengdi Liu and six co-authors present a 2025 arXiv paper on designing proteins by thinking in trees. The task, inverse folding, asks for amino acid chains that fold into a chosen shape. Many different chains can fold the same way, so a good designer should offer variety, not just the natural chain. Their system, ProtInvTree, treats design as a step-by-step search it can deliberate over.

At each step the search picks a position, then a building block, guided by rewards, with room to look ahead and backtrack. A shortcut judges half-built designs without finishing them, keeping the search fast. Built on pretrained protein language models, it can spend more search time for better results without retraining. Across benchmarks it beat leading methods, producing chains that were both shape-true and diverse, some far from the natural original.

Catalog record

CREATORMengdi Liu, Xiaoxue Cheng, Zhangyang Gao, Hong Chang, Cheng Tan, Shiguang Shan, Xilin Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00925

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ProtInvTree: Deliberate Protein Inverse Folding with Reward-guided Tree Search Mengdi Liu, Xiaoxue Cheng, Zhangyang Gao, Hong Chang, Cheng Tan, Shiguang Shan, Xilin Chen Abstract Designing protein sequences that fold into a target 3D structure—known as protein inverse folding—is a fundamental challenge in protein engineering. While recent deep learning methods have achieved impressive performance by recovering native sequences, they often overlook the one-to-many nature of the problem: multiple diverse sequences can fold into the same structure. This motivates the need for a generative model capable of designing diverse sequences while preserving structural consistency. To address this trade-off, we introduce ProtInvTree , the first reward-guided tree-search framework for protein inverse folding. ProtInvTree reformulates sequence generation as a deliberate, step-wise decision-making process , enabling the exploration of multiple design paths and exploitation of promising candidates through self-evaluation, lookahead, and backtracking. We propose a two-stage focus-and-grounding action mechanism that decouples position selection and residue generation. To efficiently evaluate intermediate states, we introduce a jumpy denoising strategy that avoids full rollouts. Built upon pretrained protein language models, ProtInvTree supports flexible test-time scaling by expanding the search depth and breadth without retraining. Empirically, ProtInvTree outperforms state-of-the-art baselines across multiple benchmarks, generating structurally consistent yet diverse sequences, including those far from the native ground truth. 1 Introduction Proteins are 3D folded linear chains of amino acids that perform essential biological functions, such as metabolic control, transmitting signals, and regulating cellular processes ( huang2016coming ; bryson1995protein ) . Designing sequences of amino acids that fold into a desired protein structure, also known as protein “inverse folding” (IF) ( yue1992inverse ) , is a crucial task with great potential for protein engineering and synthetic biology ( khakzad2023new ; zhu2024generative ; chu2024sparks ) . Recent deep learning approaches typically recover the native sequence conditioned on a target structure through the following three paradigms: autoregressive generation , which models sequence dependencies step-by-step ( ingraham2019generative ; jinglearning ; tan2022generative ; hsu2022learning ; dauparas2022robust ) ; one-shot prediction , which directly maps structure to sequence in a single forward operation ( gao2023pifold ; mao2024de ; gao2024uniif ) ; and iterative refinement , which progressively improves an initial design through multiple passes ( zheng2023structure ; gao2024kwdesign ; gao2022alphadesign ; zhubridge ) . Despite of achieving impressive recovery performance, these methods often overlooked the inherently one-to-many nature of the problem ( silva2025fast ; murphy2012increasing ; hamamsy2023protein ) , where multiple distinct amino acid sequences are capable of folding into the same protein backbone structure. As a result, rather than predicting a single native sequence, it is often desirable to generate a diverse set of sequences while preserving structural consistency. This goal, however, reveals an inherent trade-off: while diversity prefers broad exploration of the sequence space, structural consistency strictly requires a feasible subspace that has good local residue compatibility and global foldability. To address this challenge, we advocate for a deliberate, step-wise design process that progressively explores the solution space of feasible sequences. Inspired by the dual process theory in cognitive science ( kahneman2002representativeness ; stanovich1999rational ; sloman1996empirical ) , where System 1 is characterized by fast, automatic, and heuristic-driven responses, while System 2 involves slow, deliberate, and analytical reasoning, we propose to model the protein design process as a deliberate and iterative decision-making process that should (1) explore multiple alternatives at each design step rather than one single candidate, (2) dynamically assess and revise each design step through lookahead and backtracking to optimize the overall designed sequence, and (3) maintain a structured decision history to support effective credit assignment and multi-step planning. Figure 1 : (A) Schematic illustration on various approaches of structure-based protein design. Each node denotes an intermediate sequence conditioned on the target structure, progressively expanding toward full generation. See the complete framework and details in Figures 2 . (B) Landscape of scTMscore across the sequence space with respect to the target structure. The ground truth sequence is marked, and candidate sequences are distributed across multiple local optima. To this end, we propose ProtInvTree , a training-free framework for structure-based protein design that formalizes the design process as a sequence of branching decisions and leverages Monte Carlo Tree Search (MCTS) during generation. Specifically, we iteratively perform the design process, sampling multiple decisions at each step and looking ahead to compute reward signals that evaluate the quality of current choices, thereby guiding the overall sequence design. At each decision step, we introduce a two-stage focus-and-grounding action mechanism that first selects the positions in the sequence to modify ( focus ) and then generates new residues at these positions ( grounding ). Moreover, we employ fast, jumpy denoising as an evaluation mechanism, efficiently estimating trajectory quality without costly forward model rollouts. Through these designs, ProtInvTree is capable of making globally optimal decisions rather than settling for locally optimal ones, which allows it to design novel yet plausible sequences that may deviate significantly from the native sequence (as shown in Fig. 1 ). Additionally, the explicit exploration of design paths may offer potential insights into the interpretability of protein sequences. To our knowledge, this is the first work to apply a tree-search framework to structure-based protein sequence design. Empirically, we comprehensively evaluate ProtInvTree across fixed-backbone and de novo protein design tasks. We demonstrate that ProtInvTree outperforms state-of-the-art baselines and excels in the design of plausible proteins with high structural consistency. Besides, it achieves Pareto-optimal trade-offs in both the scTMscore-diversity and scTMscore-novelty. Notably, we observe that existing approaches aggressively optimizing for sequence recovery achieve limited novelty at the same sc-TMscore level. Further analyses reveal that increasing planning depth and expansion width can effectively improve structural consistency, demonstrating that the paradigm of test-time scaling can effectively unlock the potential of pretrained protein language models (PLMs). In summary, our contributions are as follows: • We propose ProtInvTree , the first test-time reward-guided tree search framework for protein inverse folding. It formulates protein design as a deliberate, step-wise decision process, enabling exploration of multiple trajectories and exploitation of promising candidates. • We introduce a two-stage focus-and-grounding mechanism decoupling position selection and residue generation, and a fast, jumpy denoising strategy for efficient reward evaluation. • We demonstrate that ProtInvTree achieves state-of-the-art performance across multiple benchmarks, with a test-time scaling capability that improves both structural consistency and sequence diversity without retraining or finetuning. 2 Related Works 2.1 Protein Inverse Folding Recently, AI algorithms have spurred a major revolution in modeling protein inverse folding, enabling accurate sequence design conditioned on target structures. Existing approaches can be broadly categorized into the following three paradigms based on their generation strategies. Autoregressive models generate sequences residue-by-residue, conditioned on both the 3D structure and previously generated tokens. Pioneering models like GraphTrans ( ingraham2019generative ) and GVP ( jinglearning ) introduced SE(3)-invariant graph encoders with attention or geometric modules. Later, models such as GCA ( tan2022generative ) , ESM-IF ( hsu2022learning ) , and ProteinMPNN ( dauparas2022robust ) incorporated global context and fine-grained pairwise distance modeling. These models offer accurate recovery but suffer from slow inference on long sequences. One-shot models bypass iterative steps by directly predicting full sequences from structure. PiFold ( gao2023pifold ) introduced an efficient graph encoder with an MLP decoder, achieving significant speedups and improved accuracy on long proteins. Uni-IF ( gao2024uniif ) generalizes

Read the complete text