SplitFlow: Flow Decomposition for Inversion-Free Text-to-Image Editing

Sung-Hoon Yoon, Minghan Li, Gaspard Beaudouin, Congcong Wen, Muhammad Rafay Azhar, Mengyu Wang · 2025

Read SplitFlow: Flow Decomposition for Inversion-Free Text-to-Image Editing by Sung-Hoon Yoon, Minghan Li, Gaspard Beaudouin, Congcong Wen, Muhammad Rafay Azhar, Mengyu Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-25970.txt.

Introduction

Sung-Hoon Yoon leads five co-authors in a new method to edit images with text prompts without first inverting the image. Rectified flow models generate images along stable paths, but editing a real photo requires mapping it back into the model latent space, a step called inversion that often goes wrong. Gradients can also tangle during editing, so outputs drift from the prompt.

Yoon and the team split the target prompt into smaller sub prompts, compute a separate flow for each, and merge them into one editing path. A projection step keeps the merged path aligned with the full prompt. The design aims for edits that stay faithful to the source image and to the requested change at once.

Catalog record

CREATORSung-Hoon Yoon, Minghan Li, Gaspard Beaudouin, Congcong Wen, Muhammad Rafay Azhar, Mengyu Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-25970

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SplitFlow: Flow Decomposition for Inversion-Free Text-to-Image Editing Sung-Hoon Yoon, Minghan Li, Gaspard Beaudouin, Congcong Wen, Muhammad Rafay Azhar, Mengyu Wang Abstract Rectified flow models have become a de facto standard in image generation due to their stable sampling trajectories and high-fidelity outputs. Despite their strong generative capabilities, they face critical limitations in image editing tasks: inaccurate inversion processes for mapping real images back into the latent space, and gradient entanglement issues during editing often result in outputs that do not faithfully reflect the target prompt. Recent efforts have attempted to directly map source and target distributions via ODE-based approaches without inversion; however, these methods still yield suboptimal editing quality. In this work, we propose a flow decomposition-and-aggregation framework built upon an inversion-free formulation to address these limitations. Specifically, we semantically decompose the target prompt into multiple sub-prompts, compute an independent flow for each, and aggregate them to form a unified editing trajectory. While we empirically observe that decomposing the original flow enhances diversity in the target space, generating semantically aligned outputs still requires consistent guidance toward the full target prompt. To this end, we design a projection and soft-aggregation mechanism for flow, inspired by gradient conflict resolution in multi-task learning. This approach adaptively weights the sub-target velocity fields, suppressing semantic redundancy while emphasizing distinct directions, thereby preserving both diversity and consistency in the final edited output. Experimental results demonstrate that our method outperforms existing zero-shot editing approaches in terms of semantic fidelity and attribute disentanglement. The code is available at https://github.com/Harvard-AI-and-Robotics-Lab/SplitFlow . † † footnotetext: * Equal contribution. † Corresponding author. 1 Introduction Flow-based generative models have demonstrated superiority in synthesizing images and also in text-to-image generation task. Building on these advances, recent research has actively explored image editing methods that modify a given image to align with a target prompt. Due to the nature of diffusion sohl2015deep ; ho2020denoising ; song2020score and flow-based generative models albergo_building_2023 ; lipman2023flow ; liu2023flow , which generate samples from noise through iterative refinement, editing typically requires an inversion step to estimate the corresponding noisy latent representation. However, this inversion process is often imperfect and fails to recover an exact latent that reconstructs the original image. As a result, the editing process may suffer from semantic drift, visual distortion, or inconsistent attribute manipulation. Even when a precise inversion allows near-perfect reconstruction, an empirical trade-off arises between reconstructability and editability. Latents that are highly optimized to match the input image tend to be rigid and entangled, meaning that adjusting a single attribute often leads to unintended changes in unrelated features dalva_fluxspace_2024 . Recently, some efforts have been made to improve the editing process based on rectified flow models rout_semantic_2024 ; wang_dtaming_nodate ; deng_fireflow_2024 ; xu_dunveil_2025 ; yang_text–image_2025 and also inversion-free method that directly maps the source and target distribution kulikov_dflowedit_2024 , but these methods show limited semantic fidelity due to gradient entanglement and prompt-latent misalignment. In particular, when a complex target prompt contains multiple semantic attributes (e.g., "a german shepard dog with black sunglasses jumping on the grass with mouth opened"), a single editing trajectory guided by the full prompt often leads to entangled gradients and conflicting directions in the semantic space. This makes it difficult to isolate and control the influence of individual attributes, resulting in either under-edited or overly distorted outputs. Motivated by these issues, we propose SplitFlow , which decomposes the flow induced by the target prompt into independent sub-target flows derived from semantically decomposed sub-prompts. By computing independent editing flows for each sub-prompt and aggregating them into a unified trajectory while mitigating flow conflict, our method achieves improvements in both fidelity and editability. Performance on the PIE-Bench benchmark ju_direct_2023 demonstrates that the proposed approach outperforms prior methods. The contributions of this paper are threefold: • We demonstrate that decomposing the editing flow improves the fidelity of the edited image, especially in preserving background consistency. • We propose SplitFlow, which progressively approximates the target latent through flow decomposition followed by flow aggregation. • We introduce a projection-and-aggregation method that aligns sub-target flows with the target direction, while preserving their semantic diversity and alleviating potential conflicts velocity field that arise during integration. 2 Related Work Diffusion and Rectified Flow. Diffusion models song2021denoising ; rombach2022high synthesize images by gradually reversing a noising process that transforms data into Gaussian noise. Starting from random noise, they iteratively denoise through learned score functions, generating high-quality outputs over many timesteps. Rectified Flow (RF) lipman2023flow ; liu2023flow introduces a more stable and efficient generation process via a straight trajectory in latent space. Text-to-Image Inversion and Editing. Text-guided image editing aims to modify a given image to match a target text prompt. Most diffusion-based editing pipelines rely on first mapping the image back into the model’s latent space, typically in the form of Gaussian noise. DDIM song2021denoising enables approximate inversion via a deterministic trajectory, but suffers from cumulative errors due to its linear approximation. To improve inversion accuracy, optimization-based approaches mokady_null-text_2022 ; wallace2023edict ; hu_latent_2023 have been proposed, though at a high computational cost. On the editing side, early methods achieve localized edits by fine-tuning diffusion models gal2022image ; kumari2023multi or manipulating cross-attention maps hertz_dprompt–prompt_2022 ; tumanyan2023plug . While effective, these methods still operate within the diffusion framework and depend heavily on either inversion or fine-tuning, which are often inefficient for practical use. Recent efforts have explored RF models for editing, which offer more stable and efficient sampling trajectories than diffusion models. RF-Inversion rout_semantic_2024 formulates editing as an optimal control problem to balance editability and fidelity, RF-Solver wang_dtaming_nodate incorporates attention injection to guide editing, and FireFlow deng_fireflow_2024 employs higher-order ODE solvers to improve inversion accuracy. Despite their advantages, these methods still depend on iterative re-noising procedures, making them prone to cumulative error. FTEdit xu_dunveil_2025 reduces errors by performing iterative average at each inversion timestep, which is basically equivalent to increasing the number of sampling steps. Inversion-Free Editing. Unlike traditional inversion-based approaches, which require recovering the noise latent that originally generated the image, inversion-free methods bypass this step and directly optimize in the image or latent space. InfEdit xu_inversion-free_2023 introduces an early inversion-free framework based on the consistency models song2023consistency . FlowEdit kulikov_dflowedit_2024 extends this idea to RF models by directly manipulating image-space velocity differences. However, it lacks directional selectivity and often struggles with global edits. These works highlight that explicitly modeling semantic flow differences enhances editing control and efficiency. Multi-Task and Flow Decomposition. Our method builds upon insights from gradient conflict resolution in multi-task learning yu2020gradient ; navon2022multi ; liu2021conflict , where conflicting objectives are resolved via adaptive re-weighting. Similarly, we propose to semantically decompose the target prompt into multiple sub-flows and adaptively aggregate them for consistent and diverse edits. To our knowledge, our work is the first to incorporate flow decomposition and aggregation into text-based image editing framework. 3 Preliminaries 3.1 Flow Matching and Rectified Flow Let \mathbb{R}^{d} denote the data space, and let x_{0}\in\mathbb{R}^{d} be an initial data point sampled from a source distribution p_{0} . Flow Matching (FM) methods liu2023flow ; lipman2023flow ; albergo_building_2023 aim to learn a time-dependent vector field v_{\theta}(x_{t},t):[0,1]\times\mathbb{R}^{d}\rightarrow\mathbb{R}^{d} , such that the solution to the following ODE transports x_{0}\sim p_{0} to x_{1}\sim p_{1} , where p_{1} denotes the target distribution: \displaystyle~dx_{t}=v_{\theta}(x_{t},t)dt (1) The

Read the complete text