FluSplat: Sparse-View 3D Editing without Test-Time Optimization
Haitao Huang, Shin-Fang Chng, Huangying Zhan, Qingan Yan, Yi Xu · 2026
Read FluSplat: Sparse-View 3D Editing without Test-Time Optimization by Haitao Huang, Shin-Fang Chng, Huangying Zhan, Qingan Yan, Yi Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-20038.txt.
Introduction
Huang and four colleagues present FluSplat, a feed-forward framework for editing 3D scenes from sparse views. Past pipelines alternate 2D diffusion edits with 3D reconstruction at test time, a costly, scene-specific loop prone to cross-view mismatch. FluSplat instead enforces cross-view consistency during training with image-domain regularization and geometric alignment. Edited views then lift into 3D Gaussian Splatting in one forward pass, matching optimization methods on fidelity with far better consistency and much faster inference.
Catalog record
| CREATOR | Haitao Huang, Shin-Fang Chng, Huangying Zhan, Qingan Yan, Yi Xu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40583 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.20038
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FluSplat: Sparse-View 3D Editing without Test-Time Optimization Haitao Huang, Shin-Fang Chng, Huangying Zhan, Qingan Yan, Yi Xu Abstract Recent advances in text-guided image editing and 3D Gaussian Splatting (3DGS) have enabled high-quality 3D scene manipulation. However, existing pipelines rely on iterative edit-and-fit optimization at test time, alternating between 2D diffusion editing and 3D reconstruction. This process is computationally expensive, scene-specific, and prone to cross-view inconsistencies. We propose a feed-forward framework for cross-view consistent 3D scene editing from sparse views. Instead of enforcing consistency through iterative 3D refinement, we introduce a cross-view regularization scheme in the image domain during training. By jointly supervising multi-view edits with geometric alignment constraints, our model produces view-consistent results without per-scene optimization at inference. The edited views are then lifted into 3D via a feedforward 3DGS model, yielding a coherent 3DGS representation in a single forward pass. Experiments demonstrate competitive editing fidelity and substantially improved cross-view consistency compared to optimization-based methods, while reducing inference time by orders of magnitude. 1 Introduction The ability to efficiently edit 3D scenes in a semantically controlled and visually coherent manner is fundamental to immersive media, extended reality, and robotics simulation. Unlike 2D image editing, 3D scene editing must preserve consistency across viewpoints: even small cross view discepancies inevitably amplify under novel-view rendering, breaking spatial realism and immersion. Multi-view coherence is therefore not optional but intrinsic to 3D editing. Recent advances in diffusion and rectified-flow models have enabled high-fidelity text-guided image editing, while 3D scene representations—from Neural Radiance Fields (NeRF) [ 31 , 9 , 17 , 29 , 2 , 15 , 47 ] to 3D Gaussian Splatting (3DGS) [ 23 ] —support scalable reconstruction and real-time novel-view synthesis. Bridging these advances, however, remains challenging. Modern 2D editors operate independently on images without explicit 3D awareness; when applied across views and lifted to 3D, they introduce inconsistencies that amplify under novel viewpoints. Consequently, existing text-guided 3D editing methods incur substantial overhead to enforce coherence. Current 3DGS editing approaches mainly differ in where coherence is enforced. Some rely on iterative edit-and-fit loops at test time [ 44 , 19 ] , while others introduce multi-view coupling within the editor or conditioning [ 11 , 13 , 26 , 10 ] , often requiring per-scene tuning. Supervised fine-tuning [ 55 ] reduces test-time optimization but depends on curated training data. Despite these variations, prior methods still incur scene-specific optimization or radiance field refinement, limiting efficiency in sparse-view or real-time settings. We revisit sparse-view 3D editing from a different perspective. Rather than optimizing geometry iteratively or relying on curated supervision, we focus on resolving cross-view inconsistencies directly in the image domain. Once edits are made consistent across views, geometry can be reconstructed reliably in a feedforward manner. Motivated by this insight, we propose FluSplat, a fully feedforward sparse-view 3D editing framework that operates from only two input views and a text instruction. Our key idea is to decouple editing from reconstruction: we first make the edits cross-view consistent in the image domain, then lift the aligned results into 3D. Concretely, FluSplat consists of two stages: (1) self-supervised cross-view consistent image editing via feature consistency regularization, and (2) pose-free lifting into a canonical 3D Gaussian representation using a feedforward generalizable 3DGS. Crucially, both editing and reconstruction are performed in a single forward pass, eliminating per-scene optimization [ 44 ] and manual hyperparameter tuning [ 11 ] at inference time. To enforce cross-view coherence, we fine-tune a rectified-flow editing backbone with complementary global and local feature alignment objectives. The global diffusion feature loss aligns high-level structural representations across views, while the proposed local editing feature loss constrains region-specific consistency for localized edits. Importantly, this fine-tuning is fully self-supervised, relying solely on cross-view feature agreement. We adopt Flux [ 25 ] for its strong semantic editing capability. Once 2D alignment is achieved, the edited views are lifted into 3D using a pose-free NoPoSplat-style feedforward Gaussian reconstruction network, producing consistent and editable 3D scenes in one pass. Extensive experiments on object-centric (DTU [ 1 ] ,IN2N [ 19 ] ) and large-scale scene datasets (RE10K [ 56 ] ) demonstrate that FluSplat achieves superior 3D semantic consistency under novel viewpoints while reducing editing time by an order of magnitude compared to prior pipelines. Despite being trained on a single dataset, our method generalizes robustly across diverse scene types and camera distributions, highlighting the effectiveness and robustness of cross-view regularized editing as a transferable inductive bias. In summary, our contributions are: • We introduce the first fully feedforward sparse-view 3D editing framework that eliminates per-scene optimization. • We propose a self-supervised cross-view diffusion regularization, including global and local feature alignment, to enforce multi-view editing consistency. • We demonstrate that resolving cross-view inconsistencies in the image domain enables direct 3D lifting, achieving superior 3D semantic fidelity and significantly improved efficiency. 2 Related Work 2D Editing Text-guided diffusion models such as Stable Diffusion [ 37 ] , Imagen [ 39 ] , and DALL-E 2 [ 36 ] dominate high-fidelity image generation and editing, aiming to apply semantic changes while preserving structure and identity. SDEdit [ 30 ] formulates editing as controlled denoising, trading edit strength for fidelity, a principle underlying modern img2img pipelines but highlighting the tension between stronger edits and structural drift. Editing-by-inversion methods [ 33 , 6 ] map images into latent space before re-denoising with modified prompts; null-text inversion [ 33 ] improves reconstruction fidelity. Inversion-free approaches such as InstructPix2Pix [ 4 ] and follow-ups [ 3 ] enable instruction-following editing via synthetic supervision. Subsequent editors—including EmuEdit [ 40 ] , OmniGen [ 49 ] , HiDream-I1 [ 5 ] , and ICEdit [ 54 ] —further refine this paradigm through improved data and architectures. Recent flow and rectified-flow models [ 24 , 38 , 45 ] extend editing to continuous-time formulations. In-context editors such as FLUX.1 Kontext [ 25 ] unify generation and editing via joint image-text conditioning. However, existing 2D methods lack explicit multi-view consistency, which is essential for 3D editing. Building on FLUX.1 Kontext, we introduce consistency-aware regularization to produce view-consistent edits. 3D Editing Text-guided 3D editing integrates 2D diffusion editors with 3D representations such as NeRF [ 31 ] and 3D Gaussian Splatting (3DGS) [ 23 ] . Early text-to-3D methods directly optimized 3D representations under diffusion priors. DreamFusion [ 34 ] , for example, applies score distillation to iteratively update a radiance field so that its renderings match a text-conditioned diffusion model. A widely adopted alternative follows a “2D edit \rightarrow 3D reconcile” pipeline: render views from a 3D scene, edit them with an image-conditioned diffusion model, and optimize the scene to absorb the edits. InstructNeRF [ 19 ] , InstructGS2GS [ 44 ] , and related variants [ 32 , 13 ] alternate between rendering, instruction-guided editing, and scene optimization. Although flexible, this iterative process is computationally expensive and prone to cross-view inconsistencies. To enhance multi-view coherence, DGE [ 11 ] , EditSplat [ 26 ] , and GaussCtrl [ 48 ] explicitly couple edits across viewpoints. However, these approaches still require scene-specific tuning, with hyperparameters tied to edit strength, inversion schedules, masking thresholds, or reference views. TINKER [ 55 ] generates dense multi-view consistent edits via DiT-based diffusion and