Exploiting Deblurring Networks for Radiance Fields
Haeyun Choi, Heemin Yang, Janghyeok Han, Sunghyun Cho · 2025
Read Exploiting Deblurring Networks for Radiance Fields by Haeyun Choi, Heemin Yang, Janghyeok Han, Sunghyun Cho (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14454.txt.
Introduction
Haeyun Choi, Heemin Yang, Janghyeok Han, and Sunghyun Cho present a 2025 paper on cleaning up blurred photos used to build 3D scene models. Radiance fields render new views of a scene, but blurry training shots spoil the result. Training a field that undoes blur itself is slow and costly.
Their method borrows ready-made deblurring networks and guides them with the scene model, alternating between sharpening the photos and rebuilding the field. The loop gives clean views in far less training time. The approach works with several scene representations, from voxel grids to Gaussian splats. The team also releases a large synthetic data set of blurred scenes, the first of its kind, for training and testing such methods.
Catalog record
| CREATOR | Haeyun Choi, Heemin Yang, Janghyeok Han, Sunghyun Cho |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-14454
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Exploiting Deblurring Networks for Radiance Fields Haeyun Choi, Heemin Yang, Janghyeok Han, Sunghyun Cho Abstract In this paper, we propose DeepDeblurRF, a novel radiance field deblurring approach that can synthesize high-quality novel views from blurred training views with significantly reduced training time. DeepDeblurRF leverages deep neural network (DNN)-based deblurring modules to enjoy their deblurring performance and computational efficiency. To effectively combine DNN-based deblurring and radiance field construction, we propose a novel radiance field (RF)-guided deblurring and an iterative framework that performs RF-guided deblurring and radiance field construction in an alternating manner. Moreover, DeepDeblurRF is compatible with various scene representations, such as voxel grids and 3D Gaussians, expanding its applicability. We also present BlurRF-Synth, the first large-scale synthetic dataset for training radiance field deblurring frameworks. We conduct extensive experiments on both camera motion blur and defocus blur, demonstrating that DeepDeblurRF achieves state-of-the-art novel-view synthesis quality with significantly reduced training time. † † footnotetext: † This work was done at POSTECH. 1 Introduction Figure 1 : Given a set of multi-view blurry images even with non-linear outliers such as saturated pixels and noise, DeepDeblurRF performs high-quality novel-view synthesis with highly efficient training. DeepDeblurRF-P and DeepDeblurRF-G are the results of our framework, where radiance fields are constructed using Plenoxels [ 12 ] and 3D Gaussian Splatting [ 17 ] , respectively. Note that DP-NeRF [ 21 ] was trained with two GPUs due to its memory demands, whereas other models were trained on a single NVIDIA TITAN RTX GPU. Novel-view synthesis has seen significant advancements in recent years, leading to impressive improvements in photo-realistic rendering quality. One key development in this field is the Neural Radiance Field (NeRF) [ 25 ] , which leverages neural networks to generate highly detailed images from novel viewpoints. Building on this, various works have focused on reducing training time and enhancing rendering quality [ 27 , 3 , 15 , 12 ] . More recently, 3D Gaussian Splatting (3DGS) [ 17 ] has emerged, utilizing Gaussians as an explicit 3D representation. This technique enables high-quality scene reconstruction and real-time rendering through a differentiable rasterization method. However, synthesizing sharp novel views from degraded training views remains a significant challenge. Capturing images in real-world conditions often leads to various degradations such as blur and noise. Among them, blur makes it difficult to aggregate accurate 3D information from the training views, resulting in a blurry radiance field. To address blur, several works [ 24 , 39 , 21 , 31 , 22 , 20 , 32 ] have been proposed to reconstruct sharp radiance fields from training views with either camera motion blur or defocus blur. These radiance field deblurring methods jointly optimize blur kernels and the radiance field, and have shown promising results. However, these methods still possess several limitations that hinder their effectiveness. First, existing approaches rely on linear blur models, describing blurred pixels in training views as linear combinations of sharp pixels. In contrast, real-world blurred images often suffer from non-linear outliers such as saturated pixels and noise, and non-linear in-camera processing [ 8 , 35 ] , which can severely degrade the performance of current radiance field deblurring techniques. Second, existing approaches do not utilize priors on sharp images, relying solely on complementary information from different views to model blur kernels and estimate a sharp radiance field. Consequently, they tend to produce radiance fields with residual blur and may completely fail when all input views exhibit similar blur directions [ 24 ] , akin to classical multi-frame deblurring approaches [ 5 , 33 , 7 ] , due to the lack of sharp image priors. Third, existing ray-based methods [ 24 , 39 , 21 , 31 , 22 ] employ multiple ray samples per pixel to depict a blurry image, resulting in a substantial increase in rendering time for a single view from a radiance field, and consequently, a significant computation time for radiance field construction. Apart from the radiance field deblurring methods, image deblurring has been extensively studied for decades [ 6 , 14 , 43 , 30 , 40 ] . Recently, a number of deep neural network (DNN)-based single-image deblurring methods have been proposed [ 28 , 38 , 19 , 42 , 10 , 4 ] . These methods do not rely on linear blur models, but learn image deblurring from large-scale datasets. Thanks to this, they can effectively remove blur from a single image without the need for complementary information from other images, and also handle non-linearities such as saturated pixels [ 34 ] . Moreover, their feed-forward approach allows markedly reduced processing times, unlike classical iterative optimization-based approaches. Given the effectiveness of recent DNN-based deblurring approaches, a promising direction to construct a sharp radiance field from blurry images would be to combine a deblurring network and radiance field construction. However, a naïve combination of a deblurring network and radiance field construction, which performs single-image deblurring to each input blurry image and trains a radiance field using the deblurred images, results in unsatisfactory results as reported by Ma et al . [ 24 ] . This is because of the limited performance of single-image deblurring, which stems from the insufficient information available in a single image. In this paper, we propose DeepDeblurRF , a novel radiance field deblurring framework that enables highly efficient training and high-quality novel-view synthesis from images blurred by motion blur or defocus blur, even in the presence of noise and saturated pixels, as shown in Fig. 1 . Unlike existing radiance field deblurring approaches, our method leverages DNN-based deblurring modules to achieve superior performance and computational efficiency. Additionally, our approach is versatile, capable of handling various 3D representations such as voxel grids [ 12 ] and 3D Gaussians [ 17 ] . However, solely relying on deblurring networks to remove blur from input blurry images may yield unsatisfactory results as discussed above. To effectively combine DNN-based deblurring and radiance field construction, our framework adopts a novel radiance field (RF)-guided deblurring scheme, and an iterative framework that performs RF-guided deblurring and radiance field construction in an alternating manner. Specifically, our framework first deblurs input images, and then trains a radiance field using the deblurred images. Then, at the next iteration, it renders images corresponding to the input views from the trained radiance field. While the deblurred images may have limited qualities with inaccurately restored details, the rendered images provide higher-quality details as they are rendered from aggregated information from multiple deblurred images. Using the rendered images as guidance, our framework then performs RF-guided deblurring to the input blurred images. Thanks to the guidance, we can obtain higher-quality deblurred images, which we use for radiance field construction again. Finally, our framework iterates RF-guided deblurring and radiance field construction to gradually enhance the quality of the radiance field. Training the deblurring modules of our framework requires a large-scale dataset of blurred images paired with ground-truth sharp images for radiance field reconstruction. However, no such datasets are available as existing radiance field deblurring approaches adopt linear blur model-based approaches, which do not require large-scale training datasets [ 24 , 39 , 21 , 22 , 31 , 20 , 32 ] . Consequently, the datasets provided by previous works, such