Inference-Time Scaling for Flow Models via Stochastic Generation and Rollover Budget Forcing
Jaihoon Kim Taehoon Yoon Jisung Hwang Minhyuk SungKAIST · 2025
Read Inference-Time Scaling for Flow Models via Stochastic Generation and Rollover Budget Forcing by Jaihoon Kim Taehoon Yoon Jisung Hwang Minhyuk SungKAIST (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19385.txt.
Introduction
Jaihoon Kim and co-authors offered a way in 2025 to get more from image and video models by spending more compute at run time. Flow models make fine output fast, but their steady path blocks the sampling tricks used with diffusion models. The team adds controlled randomness so many tries can run at once.
Other tricks widen the search and shift the budget across steps. One rule, called Rollover Budget Forcing, moves unused budget to later steps. In tests, their best mix beat all past run-time scaling methods. The work shows how extra compute at output time can raise quality without retraining.
Catalog record
| CREATOR | Jaihoon Kim Taehoon Yoon Jisung Hwang Minhyuk SungKAIST |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 101 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-19385
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Inference-Time Scaling for Flow Models via Stochastic Generation and Rollover Budget Forcing Jaihoon Kim Taehoon Yoon Jisung Hwang Minhyuk SungKAIST Abstract We propose an inference-time scaling approach for pretrained flow models. Recently, inference-time scaling has gained significant attention in LLMs and diffusion models, improving sample quality or better aligning outputs with user preferences by leveraging additional computation. For diffusion models, particle sampling has allowed more efficient scaling due to the stochasticity at intermediate denoising steps. On the contrary, while flow models have gained popularity–offering faster generation and high-quality outputs–efficient inference-time scaling methods used for diffusion models cannot be directly applied due to their deterministic generative process. To enable efficient inference-time scaling for flow models, we propose three key ideas: 1) SDE-based generation, enabling particle sampling in flow models, 2) Interpolant conversion, broadening the search space, and 3) Rollover Budget Forcing (RBF), maximizing compute utilization. Our experiments show that SDE-based generation and variance-preserving (VP) interpolant-based generation, improves the performance of particle sampling methods for inference-time scaling in flow models. Additionally, we demonstrate that RBF with VP-SDE achieves the best performance, outperforming all previous inference-time scaling approaches. Project page: flow-inference-time-scaling.github.io . Figure 1 : Diverse applications of our inference-time scaling method. Pretrained flow models struggle to generate images that align with complex prompts (left side of each case), whereas our inference-time scaling effectively extends their capabilities to achieve precise alignment (red box). * * footnotetext: Equal contribution. 1 Introduction Over the past years, scaling laws of AI models have mainly focused on increasing model size and training data. However, recent advancements have shifted attention toward inference-time scaling [ 57 , 59 ] , leveraging computational resources during inference to enhance model performance. OpenAI o1 [ 42 ] and DeepSeek R1 [ 11 ] exemplify this approach, demonstrating consistent output improvements with increased inference computation. Recent research in LLMs [ 41 ] attempting to replicate such improvements has introduced test-time budget forcing , achieving high efficiency with limited token sampling during inference. For diffusion models [ 54 , 56 ] , which are widely used for generation tasks, research on inference-time scaling has been growing in the context of reward-based sampling [ 23 , 30 , 53 ] . Given a reward function that measures alignment with user preferences [ 26 ] or output quality [ 50 , 31 ] , the goal is to find the sample from the learned data distribution that best aligns with the reward through repeated sampling. Fig. 1 showcases diverse applications of inference-time scaling using our method, enabling the generation of faithful images that accurately align with complex user descriptions involving objects quantities, logical relationships, and conceptual attributes. Notably, naïve generation from text-to-image models [ 48 , 28 ] often fails to fully meet user specifications, highlighting the effectiveness of inference-time scaling. Our goal in this work is to extend the inference-time scaling capabilities of diffusion models to flow models. Flow models [ 32 ] power state-of-the-art image [ 15 , 28 ] and video generation [ 7 , 72 ] , achieving high-quality synthesis with few inference steps, enabled by trajectory stratification techniques during training [ 35 ] . Beyond just speed, recent pretrained flow models, equipped with enhanced text-image embeddings [ 46 ] and advanced architectures [ 15 ] , significantly outperform previous pretrained diffusion models in both image and video generation quality. Despite their advantages in generating high-quality results more efficiently than diffusion models, flow models have an inherent limitation in the context of inference-time scaling. Due to their ODE-based deterministic generative process, they cannot directly incorporate particle sampling at intermediate steps, a key mechanism for effective inference-time scaling in diffusion models. Building on the formulation of stochastic interpolant framework [ 1 ] , we adopt an SDE-based sampling method for flow models at inference-time, enabling particle sampling for reward alignment. To further expand the exploration space, we consider not only stochasticity but also the choice of the interpolant . While typical flow models use a linear interpolant, diffusion models commonly adopt a Variance-Preserving (VP) interpolant [ 56 , 18 ] . Inspired by this, for the first time, we incorporate the VP interpolant into the particle sampling of flow models and demonstrate its effectiveness in increasing sample diversity, enhancing the likelihood of discovering high-reward samples. We emphasize that while we propose converting the generative process of a pretrained flow model to align with that of diffusion models—i.e.,VP-SDE-based generation—inference-time scaling with flow models offers significant advantages over diffusion models. Flow models, particularly those with rectification fine-tuning [ 35 , 36 ] , produce much clearer expected outputs at intermediate steps, enabling more precise future reward estimation and, in turn, more effective particle sampling. We additionally explore a strategy for tight budget enforcement in terms of the number of function evaluations (NFEs) of the velocity prediction network. Previous particle-sampling-based inference-time scaling approaches for diffusion models [ 30 , 53 ] allocate the NFEs budget uniformly across timesteps in the generative process, which we empirically found to be ineffective in practice. To optimize budget utilization, we propose Rollover Budget Forcing , a method that adaptively reallocates NFEs across timesteps. Specifically, we perform a denoising step upon identifying a new particle with a higher expected future reward and allocate the remaining NFEs to subsequent timesteps. Experimentally, we demonstrate that our inference-time SDE conversion and VP interpolant conversion enable efficient particle sampling in flow models, leading to consistent improvements in reward alignment across two challenging tasks: compositional text-to-image generation and quantity-aware image generation. Additionally, our Rollover Budget Forcing ( RBF ) provides further performance gains, outperforming all previous particle sampling approaches. We also demonstrate that for differentiable rewards, such as aesthetic image generation, integrating RBF with a gradient-based method [ 8 ] creates a synergistic effect, leading to further performance improvements. In summary, we introduce an inference-time scaling for flow models, analyzing three key factors: • ODE vs. SDE: We introduce an SDE generative process for flow models to enable particle sampling. • Interpolant: We demonstrate that replacing the linear interpolant of flow models with Variance Preserving interpolant expands the search space, facilitating the discovery of higher-reward samples. • NFEs Allocation: We propose Rollover Budget Forcing that adaptively allocates NFEs across timesteps to ensure efficient utilization of the available compute budget. 2 Related Work 2.1 Reward Alignment in Diffusion Models In the literature of diffusion models, reward alignment approaches can be broadly categorized into fine-tuning-based methods [ 5 , 69 , 62 , 9 , 43 , 67 ] and inference-time-scaling-based methods [ 30 , 53 , 13 , 64 , 6 ] . While fine-tuning diffusion models enables the generation of samples aligned with user preferences, it requires fine-tuning for each task, potentially limiting scalability. In contrast, inference-time scaling approaches offer a significant advantage as they can be applied to any reward without requiring additional fine-tuning. Moreover, inference-time scaling can also be applied to fine-tuned models to further enhance alignment with the reward. Since our proposed approach is an inference-time scaling method, we focus our review on related literature in this domain. When the reward is differentiable, gradient-based methods [ 8 , 3 , 71 , 16 , 17 , 63 , 4 ] have been extensively