Training-Free Guidance Beyond Differentiability: Scalable Path Steering with Tree Search in Diffusion and Flow Models

Yingqing Guo ∗, Yukang Yang ∗, Hui Yuan, Mengdi Wang · 2025

Read Training-Free Guidance Beyond Differentiability: Scalable Path Steering with Tree Search in Diffusion and Flow Models by Yingqing Guo ∗, Yukang Yang ∗, Hui Yuan, Mengdi Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11420.txt.

Introduction

Yingqing Guo and co-authors steer image and molecule makers without retraining them, in a 2025 paper. Diffusion and flow models build outputs step by step, and users often want to push the result toward a goal. Common steering tools need smooth, math-friendly goals, which rules out many real aims, such as rules that pass or fail. The team's method, TreeG, grows a tree of candidate paths at each step and keeps the best.

TreeG proposes options, scores them, and prunes the weak, all in parallel. Three flavors of the method cover smooth and rough goals alike, for both smooth data and symbol-like data. Tests on music, small molecules, and DNA stretches beat the best older steering tools by wide margins. Gains grew as more compute went in, a scaling pattern the authors chart for future work.

Catalog record

CREATORYingqing Guo ∗, Yukang Yang ∗, Hui Yuan, Mengdi Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE106 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-11420

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Training-Free Guidance Beyond Differentiability: Scalable Path Steering with Tree Search in Diffusion and Flow Models Yingqing Guo ∗, Yukang Yang ∗, Hui Yuan, Mengdi Wang Abstract Training-free guidance enables controlled generation in diffusion and flow models, but most methods rely on gradients and assume differentiable objectives. This work focuses on training-free guidance addressing challenges from non-differentiable objectives and discrete data distributions. We propose TreeG : Tree Search-Based Path Steering G uidance, applicable to both continuous and discrete settings in diffusion and flow models. TreeG offers a unified framework for training-free guidance by proposing, evaluating, and selecting candidates at each step, enhanced with tree search over active paths and parallel exploration. We comprehensively investigate the design space of TreeG over the candidate proposal module and the evaluation function, instantiating TreeG into three novel algorithms. Our experiments show that TreeG consistently outperforms top guidance baselines in symbolic music generation, small molecule design, and enhancer DNA design with improvements of 29.01 % , 16.6 % , 29.01\%,16.6\%, and 18.43 % 18.43\% . Additionally, we identify an inference-time scaling law showing TreeG’s scalability in inference-time computation. 1 Introduction During the inference process of diffusion and flow models, guidance methods steer generations toward desired objectives, achieving remarkable success in vision ( Dhariwal and Nichol, 2021 ; Ho and Salimans, 2022 ) , audio ( Kim et al., 2022 ) , biology ( Nisonoff et al., 2024 ; Zhang et al., 2024 ) , and decision making Ajay et al. (2022) ; Chi et al. (2023) . In particular, training-free guidance offers high applicability by directly controlling the generation process with off-the-shelf objective functions without extra training ( Song et al., 2023 ; Zhao et al., 2024a ; Bansal et al., 2023 ; He et al., 2023 ) . Most training-free guidance methods are gradient-based, leveraging the objective’s gradient to steer inference, and thus assume the objective function is differentiable ( Ye et al., 2024 ; Guo et al., 2024 ) . However, recent advances have pushed the boundaries of guided generation beyond differentiability: guidance objectives have expanded to include non-differentiable goals ( Huang et al., 2024 ; Ajay et al., 2022 ) ; diffusion and flow models have shown strong performance on discrete data ( Austin et al., 2021 ; Vignac et al., 2022 ) , where objectives are inherently non-differentiable unless approximated via differentiable features ( Li et al., 2015 ; Yap, 2011 ) . In such settings, training-free methods designed for differentiable objectives face fundamental limitations. Yet, the design space beyond differentiability remains under-explored: only a few methods exist ( Lin et al., 2025 ; Huang et al., 2024 ) , they differ significantly and appear disconnected from prior guidance principles ( Lin et al., 2025 ; Chung et al., 2022 ) . This underscores the need for a unified perspective and comprehensive study of guidance beyond differentiability. To this end, we propose an algorithmic framework TreeG : Tree Search-Based Path Steering G uidance, designed for both diffusion and flow models across continuous and discrete data spaces. TreeG is based on path steering guidance, providing a unified perspective on training-free guidance beyond differentiability. Let \bm{x}_{0},\cdots,\bm{x}_{t},\bm{x}_{t+\Delta t},\cdots,\bm{x}_{1} denote the inference trajectory of a diffusion or flow model. While gradients of the objective, when available, can offer a precise direction to steer inference at each step, an alternative is to search for a favorable path: propose multiple next state candidates \bm{x}_{t+\Delta t} (via BranchOut module), evaluate them using a value function (denoted by V ) that reflects the objective, and select the best candidate to proceed. This structured search enables TreeG using only zeroth-order information, making it applicable beyond differentiability. TreeG adopts a tree-search mechanism to explore multiple trajectories, further enhancing the effectiveness of path steering guidance. An active set of size A is maintained at each inference step (Fig. 1 (a)). Each sample in the active set branches into multiple candidate next states, from which the top A candidates, ranked by the value function V , are selected for the next step. This process iterates until the final step, where the best sample from the active set is chosen as the output. By enlarging A , TreeG achieves higher objective values while flexibly adapting to the computational budget. (a) Tree-Search Inference Process (b) Designs for BranchOut and Value Function V , gradient-based guidance Figure 1: TreeG Overview: (a) An active set of size A is maintained, where each sample branches into K candidates. At each step, the top A candidates are retained, and the best sample is selected at the final step. (b) Left: The current state -based ( BranchOut , V ) evaluates candidates via a lookahead estimate of the clean sample (Sec. 5.1 ). Middle: branching and selection occur in the destination state space (Sec. 5.2 ). Right: Gradient-based guidance can be applied to the current state branch-out module when a differentiable objective predictor is available (Sec. 5.3 ). TreeG’s design space is over the branching-out module and value function, offering flexible and comprehensive configurations. Effective search requires both efficient exploration and reliable evaluation. As shown in Fig. 1 (b), we propose two compatible pairs of (\texttt{BranchOut},V) : one based on the current state ( \bm{x}_{t} ), the other on the predicted destination ( \hat{\bm{x}}_{1} ). The former uses the original diffusion model to generate multiple next states and evaluates them via a lookahead estimate of the clean sample. The latter generates candidate destinations, which indicate the orientation of the next state, and selects the optimal using an off-the-shelf objective function. The top-ranked destination determines the next state. In addition, TreeG introduces a novel gradient-based algorithm for guiding discrete flow models using gradients when a differentiable objective predictor is available. Contributions. Our methodological contributions are as follows: • We propose a novel tree search framework TreeG of training-free guidance. It applies to both continuous and discrete, diffusion and flow models (Sec. 4 ), and supports non-differentiable objectives. • We instantiate three novel algorithms within this framework, and provide theoretical guarantees showing that they recover the posterior conditional distribution (Sec. 5 ). • We show that existing sampling-based methods ( Huang et al., 2024 ; Li et al., 2024 ) are special cases of TreeG (Sec. 5.1 ), limited to exploration at the current state. Our novel exploration strategy at destination states, combined with a comprehensive design space for candidate proposals and value functions, enhances the effectiveness and versatility. Empirically, we demonstrate that TreeG: • Outperforms existing guidance methods on diverse tasks: symbolic music generation (continuous diffusion with non-differentiable objectives), molecular design, and enhancer DNA design (both on discrete flow models). Path steering guidance, the special case of TreeG with the active set size as 1, consistently outperforms the strongest guidance baseline, yielding improvements of 29.01\%,16.6\%, and 18.43\% respectively (Sec. 6.2 ). • Exhibits an inference-time scaling law , where performance consistently improves as inference-time computation increases by larger active set and branch-out sizes (Fig. 2 and Sec. 6.3 ). (a) Symbolic Music (Loss \downarrow ) (b) Small Molecule (QED \uparrow ) (c) Enhancer DNA (Prob \uparrow ) Figure 2: Inference-Time Scaling Law of TreeG. ‘‘Optimal’’ refers to the best-performing combination of active set and branch-out sizes under the same inference time. The

Read the complete text