GenEraser: Generalizable Video Object Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preserver Journal: TOG
Yuqing Chen, Lin Liu, Haisu Wu, Xiaopeng Zhang, Yaowei Wang, Yujiu Yang, Qi Tian · 2026
Read GenEraser: Generalizable Video Object Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preserver Journal: TOG by Yuqing Chen, Lin Liu, Haisu Wu, Xiaopeng Zhang, Yaowei Wang, Yujiu Yang, Qi Tian (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30045.txt.
Introduction
Yuqing Chen and six colleagues present DualEraser, a system that erases a chosen object from video together with its knock-on effects such as smoke and light. They trace failures to a clash between wiping meaning and preserving background pixels, worsened when one input mode dominates. Their design feeds text and mask cues in balance, then splits the job between a Locator that removes the target and a Preserver that keeps the background true. Tests beat prior methods on standard benchmarks and hold up on messy real-world clips.
Catalog record
| CREATOR | Yuqing Chen, Lin Liu, Haisu Wu, Xiaopeng Zhang, Yaowei Wang, Yujiu Yang, Qi Tian |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38796 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30045
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GenEraser: Generalizable Video Object Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preserver Journal: TOG Yuqing Chen, Lin Liu, Haisu Wu, Xiaopeng Zhang, Yaowei Wang, Yujiu Yang, Qi Tian Abstract . Video object removal frequently struggles to simultaneously eliminate target objects and their associated physical effects (e.g., smoke, reflections, light, and ripples) in out-of-domain scenarios due to complex spatiotemporal ambiguities. While existing methods primarily rely on spatial masks, they often fail to capture weakly correlated effects, and the potential of explicit textual guidance remains underexplored. Furthermore, a fundamental optimization conflict exists in removal models between high-level semantic generalization and precise pixel-level background preservation. To address these challenges, we propose GenEraser, a novel framework for generalized and high-fidelity video object and effect removal. First, we introduce a Multi-Conditional Mixture-of-Experts (MC-MoE) paired with Bipartite Text guidance to fully exploit the multimodal priors of Diffusion Transformers, significantly enhancing the identification of complex effects. Second, a Learnable Deep “CFG” Fusion mechanism (LD-CFG) is developed to adaptively balance the relative dominance of mask and textual conditions across diverse scenarios. Finally, we propose a Decoupled Expert Architecture, comprising a Locator and a Preserver, to mitigate the inherent trade-off between semantic generalization and pixel alignment. Extensive experiments demonstrate that our GenEraser surpasses recent state-of-the-art approaches, achieving significant quantitative improvements (e.g., 2.16 2.16 dB and 1.44 1.44 dB on the ROSE Benchmark and VOR-Eval, respectively) while maintaining exceptionally robust generalization in open-world scenarios. Project Page. Figure 1 . Given the reference video, mask (yellow outline) and Bipartite Text, GenEraser successfully eliminates target objects and effects. Red and yellow text indicate the objects and effects to be removed, respectively. Compared to state-of-the-art methods, GenEraser removes a wider range of physical effects, including smoke, deformations, light, mirrors, shadows, and reflections. 1. Introduction Object removal aims to erase unwanted visual content while preserving scene integrity. This technique is increasingly indispensable across digital content creation, daily media editing ( 10 ; 22 ; 3 ; 15 ; 2 ; 34 ; 36 ) , professional post-production, and cinematography. Existing object removal methods primarily fall into two paradigms: isolated object removal and joint object-and-effect removal. Isolated removal methods predominantly erase the target while neglecting associated physical effects ( 4 ; 27 ; 14 ; 19 ; 20 ; 41 ; 39 ) , frequently introducing physically and visually inconsistent artifacts like lingering shadows or reflections. Motivated by these limitations, recent research increasingly focuses on simultaneously removing objects and their associated physical effects in videos ( 18 ; 25 ; 23 ; 6 ) . Despite these efforts, current approaches remain constrained by limited generalization in diverse real-world scenarios. The primary challenge remains accurately identifying and removing complex physical effects. Existing methods typically employ target object masks, relying on models to implicitly correlate objects with corresponding effects. However, phenomena like light exhibit weaker spatiotemporal correlations with target objects than shadows, rendering purely mask-guided removal insufficient. To overcome the spatiotemporal ambiguity of purely mask-guided methods, explicit semantic guidance is essential. Unlike masks, text can leverage the rich pre-trained text-to-vision priors of modern Multimodal Diffusion Transformers (MMDiTs) ( 28 ; 9 ; 8 ; 16 ; 35 ) to directly capture the visual manifestations of complex effects, thereby enhancing model generalization. Although most video removal models are fine-tuned on MMDiT architectures, the semantic potential of textual guidance remains largely underexplored. Methods like ROSE ( 23 ) , EraserDiT ( 20 ) , OmnimatteZero ( 25 ) , and SVOR ( 13 ) typically use static text prompts. EffectErase ( 6 ) replaces textual object tokens with visual embeddings but neglects semantic tokens corresponding to associated physical effects. Furthermore, Learning Stochastic Bridges ( 21 ) emphasizes object-centric descriptions, while Generative Omnimatte ( 18 ) prioritizes background-centric contexts. Collectively, these approaches fail to fully leverage physical effect text-to-vision priors, restricting generalization across diverse scenarios. To address this, our proposed Multi-Conditional Mixture-of-Experts (MC-MoE) combines visual masks and Bipartite Text conditions (as illustrated in Fig. 2 ) to enhance the identification and removal of complex effects. Figure 2 . Guidance condition dominance varies across scenarios. The picture below defines the Bipartite Text condition. Specifically, the yellow region indicates erasure targets, whereas the blue region describes the scene after removal. Colored words specify target objects and associated physical effects. Row 1 necessitates a text-dominant configuration to effectively eliminate physical effects like ripples. Conversely, Row 2 requires a mask-dominant configuration to prevent erroneously removing non-target individuals. The proposed LD-CFG module effectively balances these modalities across diverse scenarios. In practice, mask and textual guidance exhibit distinct advantages and intrinsic limitations shown in Fig. 2 . Binary masks provide precise spatial constraints for target objects, but they limit the model to physical effects that are strongly spatiotemporally correlated with the targets, failing to capture phenomena like smoke and light in Fig. 1 . Conversely, textual prompts leverage cross-attention mechanisms to directly establish semantic connections between text and associated effects. Nevertheless, textual prompts lack the localized precision required to accurately pinpoint exact erasure regions. Since the relative dominance of these modalities shifts across scenarios, optimizing their balance is essential for enhancing model generalization. Existing research primarily focuses on balancing multiple visual control signals ( 30 ; 29 ) . Although Classifier-Free Guidance (CFG) ( 11 ) provides a standard framework for weighting text against other conditions via guidance scale adjustment, it typically necessitates manual and heuristic-driven tuning. While recent attempts optimize CFG scale selection ( 24 ; 7 ; 17 ) , they remain largely confined to searching within discrete, predefined ranges, failing to achieve truly continuous and scene-adaptive balance. To address this, we propose a Learnable Deep “CFG” Fusion Module to adaptively balance textual and mask cues. This approach achieves effective modality equilibrium and mitigates the training-inference discrepancy inherent in traditional CFG strategies, ultimately yielding consistent performance gains. Furthermore, it can be observed that an inherent optimization trade-off exists during the training of video removal models: a trade-off between semantic generalization and pixel-level reconstruction, as shown in Table 1 and Fig. 3 . In the early training phase, models learn the global semantics to successfully remove target objects and their physical effects. However, as training progresses, they tend to overfit to local pixels to reconstruct the unedited regions. Since these two objectives inherently conflict, it is difficult for a single expert model to excel at both simultaneously. Many existing methods ( 23 ; 6 ; 21 ; 18 ) train a single expert, frequently achieving inflated benchmark metrics via pixel-level alignment. This severely degrades generalization across open-world scenarios. To resolve this, we propose a decoupled expert architecture comprising a Locator and a Preserver, inspired by but fundamentally distinct from the high-and-low noise paradigm in Wan2.2 ( 28 ) . The Locator is trained on multi-source data for fewer optimization steps to ensure robust semantic generalization across scenes, enabling it to accurately locate and eliminate complex physical effects. In contrast, the Preserver is trained on more pixel-perfect datasets for an extended duration to maintain non-edited region fidelity. Their synergy effectively strikes a balance between broad generalization and precise background preservation. Table 1 . Performance evaluation of a single expert model between early and late phases of training stage I on the ROSE Benchmark, VOR-Eval and VOR-Wild.