OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal
Qinming Zhou, Chenxi Sun, Deyang Kong, Junhao He, [0.3em] Xiangheng Tang, Peike Yu, Haotian Wu, Leilei Cao, Linfeng Zhang, [0.8em] Shanghai Jiao Tong University Tsinghua University, [0.2em] Xidian University Tongji University, [0.2em] University of Electronic Science and Technology of China Transsion, [0.5em] Equal contribution. Project Leader. Corresponding Author. [0.5em] https://github.com/Zhouqm-Git/osor · 2026
Read OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal by Qinming Zhou, Chenxi Sun, Deyang Kong, Junhao He, [0.3em] Xiangheng Tang, Peike Yu, Haotian Wu, Leilei Cao, Linfeng Zhang, [0.8em] Shanghai Jiao Tong University Tsinghua University, [0.2em] Xidian University Tongji University, [0.2em] University of Electronic Science and Technology of China Transsion, [0.5em] Equal contribution. Project Leader. Corresponding Author. [0.5em] https://github.com/Zhouqm-Git/osor (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28094.txt.
Introduction
Removing an object from a photo means removing its shadows and reflections too. User masks are often inaccurate, which makes the task harder. Qinming Zhou and eight colleagues present OSOR in 2026, a one-step diffusion inpainting framework for effect-aware object removal. An occupancy-guided discriminator gives precise boundary supervision for stable single-step training. An alpha head predicts proper removal regions from pretrained diffusion knowledge, handling imperfect masks. A verification pipeline filters noisy instruction triplets into effect-aware supervision at scale.
The curated dataset, CORNE, holds 280 thousand verified removal pairs. OSOR surpasses strong multi-step diffusion baselines in perceptual quality. It runs four to thirty times faster than they do. A 1024 by 1024 image processes in under one second on a single A100 GPU. Shadows and reflections are treated as part of the object to remove.
Catalog record
| CREATOR | Qinming Zhou, Chenxi Sun, Deyang Kong, Junhao He, [0.3em] Xiangheng Tang, Peike Yu, Haotian Wu, Leilei Cao, Linfeng Zhang, [0.8em] Shanghai Jiao Tong University Tsinghua University, [0.2em] Xidian University Tongji University, [0.2em] University of Electronic Science and Technology of China Transsion, [0.5em] Equal contribution. Project Leader. Corresponding Author. [0.5em] https://github.com/Zhouqm-Git/osor |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28094
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal Qinming Zhou, Chenxi Sun, Deyang Kong, Junhao He, [0.3em] Xiangheng Tang, Peike Yu, Haotian Wu, Leilei Cao, Linfeng Zhang, [0.8em] Shanghai Jiao Tong University Tsinghua University, [0.2em] Xidian University Tongji University, [0.2em] University of Electronic Science and Technology of China Transsion, [0.5em] Equal contribution. Project Leader. Corresponding Author. [0.5em] https://github.com/Zhouqm-Git/osor Abstract Real-world object removal is challenging due to two key difficulties: the target object’s non-local effects, such as shadows and reflections, which are difficult to model, and the fact that user-provided masks are often inaccurate or incomplete. With billions of parameters and tens of denoising steps, diffusion-based models achieve strong removal performance at the expense of substantial computational cost, limiting their use in interactive applications and on edge devices. To address these challenges, we present OSOR (One-Step Object Removal), which simultaneously achieves efficient, effect-aware, and mask-robust object removal. Concretely, OSOR introduces: (1) an occupancy-guided discriminator for precise boundary supervision, enabling stable single-step diffusion training; (2) an alpha head that leverages knowledge from pretrained diffusion models to predict appropriate removal regions with minimal overhead, thereby handling imperfect masks; and (3) a semantic-anchored verification pipeline (SAVP) that filters noisy instruction-based triplets to produce effect-aware supervision at scale. Using SAVP, we curate CORNE , which contains 280K verified removal pairs, and further annotate AnimeEraseBench and TextEraseBench to evaluate performance on more complex removal tasks. Experiments show that OSOR surpasses strong multi-step diffusion baselines in perceptual quality while achieving 4 × 4\times to 30 × 30\times faster inference. Code and resources are available at https://github.com/Zhouqm-Git/osor . Figure 1: Comparison between OSOR and other methods. OSOR effectively removes object-associated effects, such as shadows, while running 10.6\times faster than ObjectClear. A 1024\times 1024 image can be processed in under one second on a single NVIDIA A100 GPU. The average rank is computed across six benchmarks. K eywords Object removal \cdot Image inpainting \cdot Efficient diffusion 1 Introduction Object removal is a fundamental image editing task that aims to eliminate a target object and its visual effects from a photograph, restoring a natural background in the affected region. Generally speaking, real-world object removal presents three major challenges as follows. (I) Effect-awareness. Removing an object is not simply a matter of erasing the pixels within a specified mask. The target object often leaves behind persistent visual effects in the scene, including cast shadows, reflected appearances, and other environmental interactions. Eliminating these effects requires a strong semantic understanding of the scene geometry and lighting, as the model must infer what the background should look like without the object and its influence. (II) Mask-robustness. In practical usage scenarios, the removal mask is typically provided by the user through interactive selection tools. These user-generated masks are frequently imperfect: they may be too large and cover unrelated content, or too small and fail to encompass the full extent of the object and its effects. This masks robustness issue is critical for deployment in real applications where users expect reasonable results even with careless input. (III) Efficiency. Object removal is often performed on mobile devices in an interactive manner, introducing requirements on extremely low latency. Early approaches to object removal predominantly employed Generative Adversarial Networks (GANs) [ 7 , 28 , 12 , 39 ] . These methods leveraged adversarial learning where ground-truth removal results served as real samples and model outputs as fake samples. While GANs offered computational advantages through single forward passes in lightweight networks, their limited representational capacity constrained generation quality and prevented achieving satisfactory effect-aware and mask-robust results. Recent advances in diffusion models have fundamentally transformed the landscape of image generation and editing tasks. Modern diffusion models leverage hundreds of billions of parameters and dozens of iterative denoising steps to achieve unprecedented generative capabilities. These powerful models have been successfully adapted to image inpainting and object removal tasks [ 9 , 33 , 24 , 29 , 2 ] , demonstrating superior perceptual quality compared to traditional GAN-based approaches. Despite these improvements, diffusion-based methods face a critical bottleneck in computational efficiency. The multi-step denoising process requires substantial computing resources and inference time, making it impractical for deployment on edge devices or interactive applications where latency is critical. Furthermore, even with the powerful priors encoded in pretrained diffusion models, existing approaches still struggle to fully address the challenges of effect-aware and mask-robust removal [ 15 , 49 , 40 , 6 , 38 , 45 ] . This indicates that simply using pretrained diffusion models is insufficient, and targeted training strategies are necessary to unlock their full potential for this specific task. To solve this problem , in this paper, we propose OSOR, a O ne- S tep diffusion model for O bject R emoval that simultaneously achieves three goals: efficiency through single-step inference, effect-aware removal of shadows and reflections, and robustness to imperfect user masks. Our approach introduces three key technical contributions to address the aforementioned challenges. Occupancy-guided discriminator for single-step diffusion. While adversarial learning based step distillation [ 43 , 36 ] has been successfully utilized in image generation, we find that applying these methods directly to object removal leads to unsatisfactory results, particularly producing blurry boundaries around the removed object. This difficulty arises because single-step diffusion lacks the iterative refinement opportunity that allows multi-step methods to gradually correct errors in the generated content [ 49 , 38 , 2 ] . To address this, we design an occupancy-guided discriminator that provides precise boundary supervision by computing fractional occupancy values at multiple scales from the input mask for each patch location. Additionally, we propose formulating object removal as a latent restoration task derived from image restoration principles, where weakly noising the input image reduces training difficulty [ 26 , 20 ] . A lightweight alpha head for imperfect removal mask correction. OSOR introduces an alpha head, which is implemented as a lightweight projection appended to the diffusion backbone. Leveraging the rich semantic knowledge already present in pretrained diffusion models [ 19 , 11 , 47 ] , this component can accurately recover the appropriate mask for removal with minimal additional parameters and computational overhead. Besides, we further propose a two-stage training curriculum: the model first learns the removal task with perfect masks, then adapts to handle imperfect masks to improve robustness. Semantic-anchored verification pipeline enabling effect-aware removal data at scale. Based on existing image editing datasets, this pipeline combines semantic information with pixel-space gradient analysis to verify successful removal and detect the presence of object effects. This allows us to automatically generate substantial amounts of labeled data for training effect-aware removal models. Using this pipeline, we construct CORNE, a high-quality dataset containing 280K verified object removal pairs with effect-aware annotations [ 49 , 45 ] . Furthermore, to address the lack of comprehensive benchmarks for evaluating object removal in specific domains, we construct AnimeEraseBench and TextEraseBench, which evaluate removal capability on anime images and text overlays, respectively. In summary, our contributions are threefold. • We propose OSOR, a single-step object removal model, which introduces an occupancy-guided discriminator, a lightweight alpha head, and a semantic-anchored verification pipeline (SAVP) to achieve efficient, effect-aware, and mask-robust object removal. • Based on SAVP, we curate CORNE, a high-quality and effect-aware object removal training dataset