DF3DV-1K: A Large-Scale Dataset and Benchmark for Distractor-Free Novel View Synthesis
Cheng-You Lu, Yi-Shan Hung, Wei-Ling Chi, Hao-Ping Wang ∗, Charlie Li-Ting Tsai, Yu-Cheng Chang, Yu-Lun Liu, Thomas Do, Chin-Teng Lin · 2026
Read DF3DV-1K: A Large-Scale Dataset and Benchmark for Distractor-Free Novel View Synthesis by Cheng-You Lu, Yi-Shan Hung, Wei-Ling Chi, Hao-Ping Wang ∗, Charlie Li-Ting Tsai, Yu-Cheng Chang, Yu-Lun Liu, Thomas Do, Chin-Teng Lin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13416.txt.
Introduction
Lu and eight colleagues introduce DF3DV-1K, a large real-world dataset for distractor-free novel view synthesis. Radiance-field methods render photorealistic new views, but no large dataset offered clean and cluttered images per scene. DF3DV-1K provides 1,048 scenes with clean and cluttered sets, totalling 89,924 casual-capture images across 128 distractor types and 161 scene themes. A curated 41-scene subset benchmarks nine distractor-free methods plus 3D Gaussian Splatting, and a diffusion enhancer fine-tuned on the data gains about 1 dB PSNR on average.
Catalog record
| CREATOR | Cheng-You Lu, Yi-Shan Hung, Wei-Ling Chi, Hao-Ping Wang ∗, Charlie Li-Ting Tsai, Yu-Cheng Chang, Yu-Lun Liu, Thomas Do, Chin-Teng Lin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37374 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.13416
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DF3DV-1K: A Large-Scale Dataset and Benchmark for Distractor-Free Novel View Synthesis Cheng-You Lu, Yi-Shan Hung, Wei-Ling Chi, Hao-Ping Wang ∗, Charlie Li-Ting Tsai, Yu-Cheng Chang, Yu-Lun Liu, Thomas Do, Chin-Teng Lin Abstract Advances in radiance fields have enabled photorealistic novel view synthesis. In several domains, large-scale real-world datasets have been developed to support comprehensive benchmarking and to facilitate progress beyond scene-specific reconstruction. However, for distractor-free radiance fields, a large-scale dataset with clean and cluttered images per scene remains lacking, limiting the development. To address this gap, we introduce DF3DV-1K, a large-scale real-world dataset comprising 1,048 scenes, each providing clean and cluttered image sets for benchmarking. In total, the dataset contains 89,924 images captured using consumer cameras to mimic casual capture, spanning 128 distractor types and 161 scene themes across indoor and outdoor environments. A curated subset of 41 scenes, DF3DV-41, is systematically designed to evaluate the robustness of distractor-free radiance field methods under challenging scenarios. Using DF3DV-1K, we benchmark nine recent distractor-free radiance field methods and 3D Gaussian Splatting, identifying the most robust methods and the most challenging scenarios. Beyond benchmarking, we demonstrate an application of DF3DV-1K by fine-tuning a diffusion-based 2D enhancer to improve radiance field methods, achieving average improvements of 0.96 dB PSNR and 0.057 LPIPS on the held-out set (e.g., DF3DV-41) and the On-the-go dataset. We hope DF3DV-1K facilitates the development of distractor-free vision and promotes progress beyond scene-specific approaches. Figure 1 : Features of the DF3DV-1K dataset and benchmark. (a) DF3DV-1K Dataset. We introduce DF3DV-1K, a large-scale distractor-free dataset comprising 1,048 manually captured indoor and outdoor scenes, with clean and cluttered images per scene spanning 128 distractor types. (b) Distractor-Free Dataset Comparison. * denotes log scale in the normalized radar chart. We compare DF3DV-1K with public datasets [ 65 , 63 ] , showing a larger scale (e.g., \sim 100 \times more scenes), broader scene diversity (e.g., \sim 10 \times more distractor types), and increased difficulty, reflected by higher 3DGS [ 27 ] LPIPS. (c) DF3DV-1K Benchmark. A comprehensive benchmark across nine recent distractor-free radiance field methods [ 64 , 19 , 44 , 50 , 30 , 82 , 79 , 33 ] and 3DGS [ 27 ] reveals varying levels of robustness to distractors. 1 Introduction Radiance fields [ 52 , 27 ] have shown photorealistic novel view synthesis abilities. Figure 2 : Comparison of radiance fields. (a) Distractor-free tasks [ 63 ] use casually captured images within a short period. (b) In-the-wild tasks [ 51 , 24 ] , with large temporal gaps, often target images collected across seasons. (c) Dynamic tasks [ 89 ] target 4D scene synthesis and assume densely captured sequential data. Their variants such as in-the-wild (with large temporal gap) [ 51 , 14 , 92 , 95 , 84 , 11 , 10 , 83 , 30 , 33 , 82 , 3 , 18 , 37 , 80 , 88 , 53 ] and dynamic radiance fields [ 69 , 77 , 7 , 17 , 89 , 86 , 36 , 40 , 90 , 70 , 81 ] have been introduced together with comprehensive benchmarks and large-scale datasets [ 61 , 75 , 100 , 46 , 22 , 93 , 45 , 75 , 49 , 42 , 26 , 6 ] to identify remaining limitations and support further research. Despite recent advances, distractor-free radiance field methods, which aim to synthesize clean novel views from images containing visual distractors commonly observed in short-span casual image capture (see Fig. 2 ), still lack a large-scale, challenging dataset and benchmark with clean and cluttered images per scene (see Table 1 ). Table 1 : Comparison of the 3D datasets. We compare datasets based on the number of scenes, image resolution, capture density, scale of visual changes, camera intrinsic consistency within each scene, availability of clean and cluttered images, and indoor/outdoor coverage. Despite recent progress, distractor-free radiance field research still lacks a large-scale real-world dataset with clean and cluttered images per scene, limiting further development in this area. Dataset Scene Resolution Capture Change Scale Intrinsics Clean Clutter Indoor Outdoor Vanilla DTU [ 22 ] 124 1K sparse — shared ✓ ✗ ✓ ✗ RealEstate10K [ 100 ] 10K 1K dense — shared ✓ ✗ ✓ ✗ ACID [ 46 ] 13K — dense — shared ✓ ✗ ✗ ✓ ScanNet++ [ 93 ] 1K 8K dense — shared ✓ ✗ ✓ ✗ DL3DV-10K [ 45 ] 10K 4K dense — shared ✓ ✗ ✓ ✓ In-the-wild (with large temporal gap) Phototourism [ 24 ] 25 — sparse global multiple ✓ ✓ ✗ ✓ MegaScenes [ 75 ] 430K — sparse global multiple ✗ ✓ ✓ ✓ Dynamic D 2 NeRF [ 89 ] 5 0.5K dense local shared ✓ ✓ ✓ ✗ SEED4D [ 26 ] 10K — dense local shared ✗ ✓ ✗ ✓ Dynamic RealEstate10K [ 12 ] 15K — dense local shared ✗ ✓ ✓ ✗ Distractor-free RobustNeRF [ 65 ] 5 4K sparse local shared ✓ ✓ ✓ ✗ On-the-go [ 63 ] 12 4K sparse local shared ✓ ✓ ✓ ✓ DF3DV-1K (Ours) 1K 4K sparse local shared ✓ ✓ ✓ ✓ This absence leads to two major issues: (1) it becomes difficult to identify the strengths and limitations of recent approaches, and (2) progress from scene-specific methods toward generalizable solutions is hindered. Figure 3 : Number of distractor-free radiance field papers. The first distractor-free radiance field method [ 65 ] , targeting images captured over short time spans, was introduced in 2023 together with a benchmark. The research area rapidly gained attention in 2024 with the release of the On-the-go benchmark [ 63 ] . Although the number of works doubled in 2025, a public, large-scale, challenging dataset and benchmark systematically designed for this area are still lacking. In fact, the first issue can be observed in recent works [ 19 , 33 , 44 , 79 ] . For example, Fig. 10 in [ 44 ] , Fig. 7 in [ 19 ] , and Fig. 4 in [ 33 ] reveal subtle background differences often visible only under zoomed-in views. In other cases (see Fig. 4 in [ 79 ] ), evaluations rely on cross-domain datasets supporting only qualitative analysis. The number of distractor-free radiance field papers targeting casually captured images doubled in 2025 (see Fig. 3 ), yet no systematically designed, large-scale public dataset or benchmark has emerged to keep pace with this rapid growth. Table 2 : Comparison of real-world distractor-free radiance field datasets. We compare datasets based on the number of scenes, indoor and outdoor environments, distractor types, themes, images, and image resolution. DF3DV-1K is a large-scale, diverse real-world dataset, providing clean and cluttered images for each scene. Dataset Scene Indoor Outdoor Distractor Theme Image Resolution Clean Not released yet Entity-NeRF [ 56 ] 3 0 3 >3 3 78 — ✗ UniVerse [ 8 ] 6 — >3 >3 >3 — — ✓ Wild3A [ 37 ] 3 2 1 >3 3 — — ✓ StaticNeRF [ 32 ] 8 8 0 — 2 — — ✓ D-RE10K-iPhone [ 12 ] 50 50 0 >2 4 1.8K — ✓ Public DeGauss [ 79 ] 4