OpenRR-1k: A Scalable Dataset for Real-World Reflection Removal
Kangning Yang, Ling Ouyang, Huiming Sun, Jie Cai, Lan Fu, Jiaming Ding, Chiu Man Ho, Zibo Meng · 2025
Read OpenRR-1k: A Scalable Dataset for Real-World Reflection Removal by Kangning Yang, Ling Ouyang, Huiming Sun, Jie Cai, Lan Fu, Jiaming Ding, Chiu Man Ho, Zibo Meng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-08299.txt.
Introduction
Reflections in glass can ruin a photo, and software that strips them needs good training pairs: the same scene with and without the glass glare. Kangning Yang and seven co-authors present a new way to gather those pairs in a 2025 paper, plus a dataset built with it. Older collections were small, staged, or poorly aligned between the pair.
Their method collects pairs in the wild in a way that is cheap, scalable, and keeps the two shots lined up pixel for pixel. The result, OpenRR-1k, holds 1,000 transmission-reflection pairs from varied real scenes. The team ran several known removal methods on the set as a benchmark. Training and testing on the wild data made the methods hardier in tough real settings, the authors report, and the dataset is posted for public use.
Catalog record
| CREATOR | Kangning Yang, Ling Ouyang, Huiming Sun, Jie Cai, Lan Fu, Jiaming Ding, Chiu Man Ho, Zibo Meng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-08299
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OpenRR-1k: A Scalable Dataset for Real-World Reflection Removal Kangning Yang, Ling Ouyang, Huiming Sun, Jie Cai, Lan Fu, Jiaming Ding, Chiu Man Ho, Zibo Meng Abstract Reflection removal technology plays a crucial role in photography and computer vision applications. However, existing techniques are hindered by the lack of high-quality in-the-wild datasets. In this paper, we propose a novel paradigm for collecting reflection datasets from a fresh perspective. Our approach is convenient, cost-effective, and scalable, while ensuring that the collected data pairs are of high quality, perfectly aligned, and represent natural and diverse scenarios. Following this paradigm, we collect a Real-world, Diverse, and Pixel-aligned dataset (named OpenRR-1k dataset), which contains 1,000 high-quality transmission-reflection image pairs collected in the wild. Through the analysis of several reflection removal methods and benchmark evaluation experiments on our dataset, we demonstrate its effectiveness in improving robustness in challenging real-world environments. Our dataset is available at https://github.com/caijie0620/OpenRR-1k . † † address: OPPO AI Center 1 Introduction Single image reflection removal (SIRR) is a critical task in image processing, focusing on recovering the true scene behind reflections from reflective surfaces (e.g., transparent glasses). This is crucial in fields such as autonomous driving, medical imaging [ 1 , 2 ] , and augmented reality. Over the years, various techniques have been proposed, ranging from traditional image decomposition methods to more advanced deep learning-based approaches [ 3 , 4 , 5 ] . Figure 1 : Visualization of paired data generation pipeline. Figure 2 : Overview of our OpenRR-1k dataset. Despite significant efforts and progress made in modeling the formation of reflection contamination, the lack of high-quality data has increasingly become a bottleneck, limiting the full potential of deep learning models. Given that a sufficient supply of high-quality data is crucial for the success of data-driven approaches, we propose a novel data collection protocol specifically designed to capture high-quality pairs of transmission and blended images. Specifically, to ensure a diverse and natural set of real-world images, we impose no restrictions on image capture. Researchers are free to recruit individuals to capture images featuring various types of reflection lights, irrespective of their angles, shapes, intensities, materials, or other characteristics. Alternatively, images with reflections can be sourced directly from social media platforms such as Flickr, Instagram, and others. Building on this, to ensure strict alignment between the ground-truth transmission images and the blended images with reflection contamination, we rely on proven and effective tools for reflection removal, instead of directly or indirectly obtaining ground-truth transmission images by removing the glass or using light-absorbing black cloth as done in previous methods [ 4 , 6 , 7 , 8 , 9 , 10 ] . To guarantee the accuracy of the ground truth, we further propose using image editing tools to eliminate any remaining reflection residues. While this step still involves some manual post-processing, it is considerably more practical, cost-effective, and convenient compared to existing methods. Furthermore, this approach can leverage crowdsourcing platforms like Amazon Mechanical Turk to streamline the process and enhance scalability. Following this protocol, we developed a new high-quality dataset, the OpenRR-1k dataset, aimed at advancing research in reflection removal. To evaluate the effectiveness of the OpenRR-1k dataset, we conduct a comprehensive benchmark evaluation and further analyze the limitations of existing methods. The contributions of our work are three-fold: • We proposed a new data collection protocol to collect diverse and well-aligned real-world reflection-transmission image pairs. The proposed protocol is highly scalable, enabling the creation of larger-scale datasets in the future. • We collected the OpenRR-1k dataset, a high-quality collection consisting of 1,000 in-the-wild image pairs. • We conducted a comprehensive benchmark evaluation within the SIRR domain. Additionally, we demonstrated the improvements enabled by our OpenRR-1k dataset when applied to existing reflection removal approaches. 2 Related Work Currently, public datasets supporting SIRR can be divided into two categories: fully-synthetic and semi-synthetic datasets. For fully-synthetic datasets, this technique typically involves selecting two clean images (without reflections) and combining them with different coefficients to create a synthetic image with reflections, which serves as the corresponding blended image. This process is then used to generate a large number of paired blended-transmission data samples [ 3 , 7 , 11 ] . For example, Guo et al. [ 12 ] simply set 0.6 for transmission and 0.4 for reflection images. Fan et al. [ 3 ] assumed that the reflection is relatively blurry compared to the sharper and clearer background layer, and synthesized images by combining the background and reflection layers while avoiding brightness overflow through adaptive subtraction and clipping instead of scaling. They also adjusted the Gaussian blur kernel \sigma to handle a wider range of reflection blurriness, including cases with less blurry reflections. Zhang et al. [ 11 ] focused on ultra-high-definition image synthesis. For semi-synthetic datasets, researchers typically rely on props such as glass and cloth. After capturing the blended images, they create reflection pairs by either removing the glass or blocking the background or reflection light with light-absorbing black velvet cloth [ 4 , 6 , 7 , 8 , 9 , 10 ] . For example, Li et al. [ 4 ] obtained transmitted images by manually removing the glass, while Lei et al. [ 8 , 9 ] focused on the RAW data space and indirectly obtained transmission images through subtraction. More recently, Zhu et al. [ 10 ] proposed a novel data collection pipeline that involves blocking all reflection lights generated by the surrounding environment. Nevertheless, synthetic-based methods, while useful, come with inherent limitations. Fully-synthetic approaches are typically developed based on a range of assumptions about the scene and the underlying physical processes. As a result, their performance is often constrained by the domain gap between synthetic and real-world data. The assumptions made during the creation of synthetic data are often overly simplified, which can lead to suboptimal performance when these methods are applied to real-world images [ 9 ] . On the other hand, manual methods for glass removal, as discussed in [ 10 ] , face challenges such as spatial pixel misalignment. This misalignment arises from refraction caused by the glass, which distorts the captured image. The subtraction method in the RAW data space, which aims to eliminate reflections, may also fail to completely remove the reflective areas, leaving residual artifacts in the transmission images. Even the methods proposed in [ 10 ] , though promising, encounter difficulties when deployed in real-world environments. One significant challenge is the uncontrollable nature of environmental factors [ 13 , 14 ] , such as wind or equipment vibrations, which can lead to misalignment between the transmission image \mathbf{T} and the blended image \mathbf{I} . Additionally, while black cloth is used to block local object light and global ambient light, achieving a perfect blockade is practically difficult, resulting in color discrepancies between \mathbf{T} and \mathbf{I} . Another limitation of current synthetic-based methods is that they rely heavily on pre-defined reflection scenes and content. This not only makes the data collection process time-consuming and labor-intensive but also restricts the diversity of the collected data. Although [ 10 ] proposed dynamic manipulation of reflective content, these reflections are still not entirely natural, as they do not spontaneously occur in real-world settings.