Inference-Time Compute Scaling for Flow Matching
Adam Stecklov, Noah El Rimawi-Fine, Mathieu Blanchette · 2025
Read Inference-Time Compute Scaling for Flow Matching by Adam Stecklov, Noah El Rimawi-Fine, Mathieu Blanchette (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-17786.txt.
Introduction
Adam Stecklov, Noah El Rimawi-Fine, and Mathieu Blanchette study how extra computing at generation time helps flow matching. Flow matching is a way to train models that turn noise into samples. Spending more compute during sampling has improved language and image models. For flow matching, that trick stayed mostly unexplored.
Their procedures keep the straight-line sampling path that makes flow matching fast. A rival approach bends that path and loses the speed edge. The team tested image generation and, newly, protein generation. Sample quality rose steadily as inference compute increased. The results suggest flow matching can scale at test time too.
Catalog record
| CREATOR | Adam Stecklov, Noah El Rimawi-Fine, Mathieu Blanchette |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-17786
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Inference-Time Compute Scaling for Flow Matching Adam Stecklov, Noah El Rimawi-Fine, Mathieu Blanchette Abstract Allocating extra computation at inference time has recently improved sample quality in large language models and diffusion-based image generation. In parallel, Flow Matching (FM) has gained traction in language, vision, and scientific domains, but inference-time scaling methods for it remain under-explored. Concurrently, Kim et al., 2025 approach this problem but replace the linear interpolant with a non-linear variance-preserving (VP) interpolant at inference, sacrificing FM’s efficient and straight sampling. Additionally, inference-time compute scaling for flow matching has only been applied to visual tasks, like image generation. We introduce novel inference-time scaling procedures for FM that preserve the linear interpolant during sampling. Evaluations of our method on image generation, and for the first time (to the best of our knowledge), unconditional protein generation, show that I) sample quality consistently improves as inference compute increases, and II) flow matching inference-time scaling can be applied to scientific domains. Figure 1: Sample quality improvement with inference-time compute scaling using our RS+NS–DMFM-ODE method on ImageNet 256×256 with the DINO verifier. From left to right: 1×, 2×, 4×, 8× compute budget. Higher compute budgets produce more coherent and detailed images. 1 Introduction Inference-time compute scaling improves generative models by spending more test-time computation without retraining. In discrete settings this includes longer reasoning chains, planning, and verifier-guided selection Gandhi et al. 2024 ; Cobbe et al. 2021 ; Lightman et al. 2023 ; Brown et al. 2024 , with notable examples such as OpenAI’s o1 and o3 models OpenAI 2024 and DeepSeek R1 DeepSeek-AI et al. 2025 . In the continous setting, verifier-guided search for diffusion models Ma et al. 2025 has been introduced and demonstrates improvement in image generation quality as inference-time increases. Flow Matching Lipman et al. 2023 trains a neural velocity field by linearly interpolating between the data distribution and the initial distribution (which, unlike diffusion, is not restricted to a gaussian), and samples straight deterministic paths with an ODE in fewer sampling steps than diffusion. it has achieved state of the art performance in image generation Labs et al. 2025 , and most notably in scientific domains such as protein folding and structure design Huguet et al. 2024 , small molecule generation Dunn & Koes 2025 , and faster Molecular Dynamics simulations Nam et al. 2025 . However, the diffusion inference-time scaling technique introduced in Ma et al. 2025 is not general to FMs formulation, which does not assume gaussian prior distributions. Kim et al. 2025 addresses this by introducing an inference-time scaling algorithm for FM, which relies on transforming the linear interpolant, at inference, into a non-linear variance-preserving (VP) interpolant, effectively transforming it into a diffusion model. This enables diverse trajectories (their primary motivation) at the expense of FM’s fast straight sampling paths. Both methods have only been empirically validated on image generation, yet flow and diffusion models have become popular in the scientific domain. Further, we believe inference-time compute scaling is better suited for scientific challenges, such as drug design or protein folding, where the downstream benefits of higher quality samples is far greater, and we are therefore willing to spend more compute time on these tasks. We are therefore jointly motivated to investigate inference-time compute scaling for flow matching, maintaining the linear interpolant, and to demonstrate its generalizability to tasks in the scientific domain. Our core contributions are as follows: • We present the first inference-time scaling technique for Flow Matching that preserves the linear interpolant at inference , using the Noise Search algorithm, which achieves substantial improvements for relatively small increases in computation, and verify results on Imagenet256 image generation. Further, we present a two-stage method that first runs Best-of-N, then applies our Noise Search algorithm, taking advantage of FM’s prior distribution invariance, and balancing exploration and exploitation to achieve state of the art results. • We show the generalizability of our approach by demonstrating the first application of inference-time scaling for flow matching to a scientific domain, specifically unconditional protein design using FoldFlow2 Huguet et al. 2024 , demonstrating significant increases in protein designability as we scale compute. • We investigate noise schedules that push the sample diversity vs. quality pareto front outwards compared to a traditional SDE. However we find that additional diversity does not necessarily improve search-scaling performance. 2 Preliminaries Notation. Random variables are uppercase (e.g., X ), and realizations are lowercase (e.g., x ). Distributions at time t\in[0,1] are denoted \pi_{t} with density p_{t} ; endpoints are \pi_{0}=\pi_{\mathrm{ref}} and \pi_{1}=\pi_{\mathrm{data}} . Vector fields v:\mathbb{R}^{d}\times[0,1]\to\mathbb{R}^{d} are time‑dependent and (unless stated otherwise) Lipschitz in x and measurable in t . The continuity equation is \partial_{t}p_{t}(x)+\nabla\!\cdot\!\big(p_{t}(x)\,v(x,t)\big)=0,\qquad p_{0},p_{1}\ \text{given}. (1) 2.1 Flow Matching Flow Matching (FM) Lipman et al. 2023 defines a continuous bridge between a reference distribution \pi_{\mathrm{ref}} , typically (but not necessarily) a Gaussian distribution, and a data distribution \pi_{\mathrm{data}} , by modeling trajectories x_{t} that interpolate between samples x_{0}\sim\pi_{\mathrm{ref}} and x_{1}\sim\pi_{\mathrm{data}} . A common choice is the linear path x_{t}=(1-t)x_{0}+tx_{1} , though other conditional paths are possible and lead to generalized or conditional flow matching Tong et al. 2024 ; Song & Ermon 2021 ; Albergo et al. 2023 . This is done via a learned velocity field v_{\theta}(x,t) that satisfies the probability-flow ODE: \frac{dx_{t}}{dt}=v_{\theta}(x_{t},t),\quad t\in[0,1]. To train v_{\theta} , a supervised loss is used where the ground truth velocity is known analytically: v^{\star}(x_{t},t)=x_{1}-x_{0}. This target arises because \frac{dx_{t}}{dt}=x_{1}-x_{0} under linear interpolation. The training loss is then \mathcal{L}_{\mathrm{FM}}=\mathbb{E}_{x_{0}\sim\pi_{\mathrm{ref}},x_{1}\sim\pi_{\mathrm{data}},t\sim\mathcal{U}[0,1]}\left[\left\|v_{\theta}(x_{t},t)-(x_{1}-x_{0})\right\|^{2}\right]. While FM defines its objective using i.i.d. sample pairs (x_{0},x_{1}) , such pairs are typically poorly coupled in high-dimensional space. Minibatch Optimal Transport Flow Matching (OT-FM) Tong et al. 2024 addresses this by using an optimal transport plan computed within each minibatch to generate more meaningful pairs, shortening transport paths and improving training stability. Critically, because the interpolant is linear and the learned dynamics are smooth, FM enables fewer sampling steps while maintaining sample quality. While flow matching can inherently be scaled at inference by reducing the stepsize, gains from this are well known to plateau quickly Lipman et al. 2023 , motivating the use of novel scaling axes. 2.2 Stochastic Interpolants: A Unifying Framework The stochastic interpolants framework Albergo et al. 2023 ; Ma et al. 2024 shows that both FM and diffusion models can be described within the same interpolant framework. A stochastic interpolant is defined by x_{t}=a(t)x_{0}+b(t)x_{1}+\sigma(t)\epsilon,\quad\epsilon\sim\mathcal{N}(0,I), with boundary conditions a(0)=1,\ b(0)=0,\ \sigma(0)=0 and a(1)=0,\ b(1)=1,\ \sigma(1)=0 , and with a,b,\sigma smooth in t . FM is the deterministic special case a(t)=1-t , b(t)=t , \sigma(t)\equiv 0 . Crucially, the stochastic interpolants framework allows inference-time reinterpretation of trained models by simply modifying the schedule (a,b,\sigma) . For instance, a model trained with linear FM ( a(t)=1-t,\ b(t)=t,\ \sigma(t)\equiv 0 ) can, at test time, be sampled using a different valid schedule. One example is the variance-preserving (VP) diffusion schedule, usually written in the two-coefficient form x_{t}=\alpha_{t}x_{\mathrm{data}}+\sigma_{t}\epsilon with \alpha_{t}^{2}+\sigma_{t}^{2}=1 . This is a special case of the three-coefficient interpolant by reinterpreting (x_{0},x_{1})=(\epsilon,x_{\mathrm{data}}) and setting a(t)=\sigma_{t},\ b(t)=\alpha_{t},\ \sigma(t)=0 . In both cases, the learned parameters can be reused without retraining, revealing a continuum of models and motivating inference-time strategies that use the same learned velocity and score fields. 3 Related Work 3.1 Inference-Time Compute