Adams Bashforth Moulton Solver for Inversion and Editing in Rectified Flow
Yongjia Ma, Donglin Di, Xuan Liu, Xiaokai Chen, Lei Fan, Tonghua Su, Yue Gao · 2025
Read Adams Bashforth Moulton Solver for Inversion and Editing in Rectified Flow by Yongjia Ma, Donglin Di, Xuan Liu, Xiaokai Chen, Lei Fan, Tonghua Su, Yue Gao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-16522.txt.
Introduction
Yongjia Ma and co-authors put forth a new solver for rectified flow models in a 2025 paper. These models make images and video, but their solvers trade speed against how exact the result is. That trade off hurts tasks that undo a made image or edit it.
Their solver uses a predict and correct method with many steps to cut small errors. A step size that adapts on its own helps keep sampling fast at the same time. A mask part marks areas to leave alone during edits, based on how alike image parts are. Tests on high grade image sets show sharper undo results and better edits than past solvers, with no added training.
Catalog record
| CREATOR | Yongjia Ma, Donglin Di, Xuan Liu, Xiaokai Chen, Lei Fan, Tonghua Su, Yue Gao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-16522
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adams Bashforth Moulton Solver for Inversion and Editing in Rectified Flow Yongjia Ma, Donglin Di, Xuan Liu, Xiaokai Chen, Lei Fan, Tonghua Su, Yue Gao Abstract Rectified flow models have achieved remarkable performance in image and video generation tasks. However, existing numerical solvers face a trade-off between fast sampling and high-accuracy solutions, limiting their effectiveness in downstream applications such as reconstruction and editing. To address this challenge, we propose leveraging the Adams-Bashforth-Moulton (ABM) predictor-corrector method to enhance the accuracy of ODE solving in rectified flow models. Specifically, we introduce ABM-Solver, which integrates a multi-step predictor–corrector approach to reduce local truncation errors and employs Adaptive Step Size Adjustment to improve sampling speed. Furthermore, to effectively preserve non-edited regions while facilitating semantic modifications, we introduce a Mask Guided Feature Injection module. We estimate self-similarity to generate a spatial mask that differentiates preserved regions from those available for editing. Extensive experiments on multiple high-resolution image datasets validate that ABM-Solver significantly improves inversion precision and editing quality, outperforming existing solvers without requiring additional training or optimization. 1 Introduction Diffusion models have emerged as the dominant paradigm for high-fidelity image and video generation [ 20 , 39 , 16 , 35 ] . These models learn to reverse the forward process of transforming data into noise, effectively capturing high-dimensional perceptual data structures. Early approaches like DDPM [ 20 ] employ stochastic differential equations (SDEs) for iterative denoising, which is computationally expensive during generation. To enhance efficiency and accuracy, recent advancements in flow matching [ 28 , 27 ] have demonstrated superior generative performance with faster training and inference [ 24 , 16 ] . This shift is attributed to architectures like DiT [ 33 ] , gradually replacing the UNet backbone [ 36 ] and reformulating SDEs as ordinary differential equations (ODEs). By transitioning from stochastic to deterministic formulations, these models directly learn smooth velocity fields, enabling faster and more stable sampling [ 23 , 25 , 45 ] . Building on earlier advancements, Rectified Flow (ReFlow) models optimize velocity trajectories by leveraging numerical solvers, such as the Euler method or high-order Taylor expansions to enforce near-linear transformations [ 43 , 1 ] . These methods reduce cumulative errors and improve inversion quality. However, increasing the solver’s order typically comes at the expense of computational efficiency; alternative approaches like the Midpoint Method [ 11 ] , while potentially faster, can be overly sensitive to step-size selection and may suffer from stability issues. Consequently, the inversion process becomes progressively less accurate over extended integration horizons, which directly undermines the performance of downstream applications including reconstruction and editing. To address discretization errors arising from fixed-step integration, we present the ABM-Solver, a linear multistep method that integrates a two-step predictor–corrector approach [ 14 ] , with an adaptive step size adjustment mechanism to dynamically adjust step sizes driven by local truncation error estimates. During the first stage ( i.e., , explicit prediction), the Adams–Bashforth method estimates the next state from a weighted sum of previously computed gradients, providing fast yet potentially coarse approximations. Subsequently, This is refined by the second stage ( i.e., , implicit corrector) via the Adams–Moulton method, which incorporates newly evaluated gradients to reduce local errors and improve stability. In addition to enhancing inversion precision and reconstruction accuracy, we thoroughly analyze the spatial consistency of attention values between the inversion and sampling stages. Specifically, we introduce a Mask Guided Feature Injection module that effectively supports a wide range of editing tasks while preserving the original content’s semantics. To achieve this, we estimate self-similarity to generate a spatial mask that differentiates between regions requiring preservation and those amenable to modification. This mask-guided fusion of attention features helps retain critical structural details in non-edited areas while enabling flexible semantic alterations where needed. Extensive theoretical analysis and empirical evaluations on multiple high-resolution image datasets demonstrate that our approach effectively balances computational efficiency and numerical precision, outperforming existing methods without requiring additional training or optimization costs. Our contributions are summarized as follows: Figure 1 : Comparison of Vanilla ODE Solver and Our ABM-Solver. (a) Vanilla ODE Solver : Conventional numerical integration accumulates approximation errors, compromising inversion accuracy and editing fidelity. (b) Our ABM-Solver : By integrating a second-order ABM predictor–corrector framework, the Adaptive Step Size Adjustment, and Mask Guided Feature Injection, our method significantly reduces errors and achieves superior inversion and semantic editing performance. • We propose ABM-Solver, a training-free numerical solver that integrates the Adams–Bashforth–Moulton predictor–corrector method with Adaptive Step Size Adjustment, achieving second-order accuracy and reduced local truncation errors in Rectified Flow models without extra computational cost. • We introduce a Mask Guided Feature Injection module, which leverages spatial consistency of attention values to generate masks for selectively fusing features, thereby preserving structural details while enabling semantically consistent editing. • Extensive theoretical analysis and experiments on high-resolution image datasets demonstrate that our approach significantly improves inversion precision and reconstruction accuracy, and supports diverse editing tasks, outperforming existing solvers without requiring extra training. 2 Related Work 2.1 Diffusion Inversion Diffusion inversion maps the real image back to the Gaussian noise to recover its corresponding initial noise [ 39 , 42 , 50 , 10 ] . This process is crucial for a wide range of tasks, including image reconstruction and editing [ 47 , 26 , 3 , 12 , 9 , 8 ] . However, the reconstruction fidelity of DDIM inversion is notably compromised when using a limited number of denoising steps, especially in the context of text-guided diffusion models [ 18 , 38 ] . To achieve more accurate reconstruction, noise map guidanc [ 7 ] employs a gradient from the noise map to direct the reverse diffusion process, forcing its path to correspond with the forward diffusion trajectory. Null-Text Inversion (NTI) [ 31 ] achieves high-fidelity reconstruction by fine-tuning the null-text embedding for each image, but this per-instance optimization strategy comes at a significant computational cost. NPI [ 30 ] trades reconstruction accuracy for computational efficiency by employing a static negative prompt embedding to bypass the optimization step. ReNoise [ 17 ] enhances reconstruction fidelity by employing the backward Euler (or implicit Euler) method as its numerical solver for the inversion process. FreqInv [ 2 ] enhances reconstruction by performing inversion in the frequency domain, where it treats low-frequency structure and high-frequency texture components distinctly. However, this signal decomposition, while effective, renders the process computationally intensive. 2.2 Reflow Inversion Rectified flow models aim to straighten the trajectory between noise and data, offering a more direct path for inversion [ 28 , 23 ] . RF-Inversion [ 37 ] frames the task as a dynamic optimal control problem, deriving a controller via a Linear Quadratic Regulator (LQR). It constructs a new vector field that optimally balances fidelity to the input image against consistency with the model’s learned distribution, thereby improving inversion accuracy without requiring costly test-time optimization. RF-Solver [ 43 ] applies high-order Taylor expansions to reduce approximation errors in the ODEs of rectified flow. FireFlow [ 11 ] introduces a numerical solver that achieves second-order precision with the computational cost of a first-order solver. EE-Edit [ 46 ] achieves significant inversion acceleration by exploiting spatial and temporal redundancy through feature caching and inversion step skipping,