Frequency-domain Learning with Kernel Prior for Blind Image Deblurring

Jixiang Sun, Fei Lei, Jiawei Zhang, Wenxiu Sun, Yujiu Yang · 2025

Read Frequency-domain Learning with Kernel Prior for Blind Image Deblurring by Jixiang Sun, Fei Lei, Jiawei Zhang, Wenxiu Sun, Yujiu Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-14664.txt.

Introduction

Jixiang Sun and colleagues attacked a stubborn weakness of AI image deblurring in 2025: it fails on photos unlike its training data. Deep networks restore sharp images impressively on familiar datasets, then falter elsewhere, because they lean on dataset-specific patterns. The authors argue the missing ingredient is the blur kernel itself, the mathematical fingerprint of the blur, which does not depend on image content. Traditional algorithms already exploit kernels in the frequency domain.

Their design adds a Frequency Integration Module that fuses kernel information into a frequency-based transformer network for deblurring. Working in the frequency domain mirrors classical deconvolution while keeping deep learning's power. Experiments test whether this hybrid generalizes better to out-of-domain photographs. The broader lesson appeals beyond deblurring: when a classical prior is truly content-independent, building it into the network can free the model from dataset habits.

Catalog record

CREATORJixiang Sun, Fei Lei, Jiawei Zhang, Wenxiu Sun, Yujiu Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-14664

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Frequency-domain Learning with Kernel Prior for Blind Image Deblurring Jixiang Sun, Fei Lei, Jiawei Zhang, Wenxiu Sun, Yujiu Yang Abstract While achieving excellent results on various datasets, many deep learning methods for image deblurring suffer from limited generalization capabilities with out-of-domain data. This limitation is likely caused by their dependence on certain domain-specific datasets. To address this challenge, we argue that it is necessary to introduce the kernel prior into deep learning methods, as the kernel prior remains independent of the image context. For effective fusion of kernel prior information, we adopt a rational implementation method inspired by traditional deblurring algorithms that perform deconvolution in the frequency domain. We propose a module called Frequency Integration Module (FIM) for fusing the kernel prior and combine it with a frequency-based deblurring Transfomer network. Experimental results demonstrate that our method outperforms state-of-the-art methods on multiple blind image deblurring tasks, showcasing robust generalization abilities. Source code will be available soon. 1 Introduction Image deblurring stands as a classic and important problem in the realm of low-level vision. Image deblurring aims to recover a high-quality sharp image from its blurry counterpart. Due to its inherently ill-posed nature, image deblurring has always been presented as a challenging task. The problem format of this task is roughly constructed as \mathbf{y}=\rm Blur(\mathbf{x},\mathbf{k})+\mathbf{n} , where Blur(,) indicates a blurring operation, conventionally modeled as a convolution operation. \mathbf{x} denotes the original sharp image, \mathbf{k} represents the convolution kernel responsible for inducing blurriness, and noise \mathbf{n} is typically attributed to the inherent imperfections of the camera lens, introducing further complexity to the deblurring task. In light of the development of deep neural networks, multiple approaches to image deblurring have been proposed in recent years. Recent methods include convolutional neural networks (CNNs) Schuler et al. 2015 ; Sun et al. 2015 ; Chakrabarti 2016 ; Kaufman and Fattal 2020 , and attention-based solutions Shen et al. 2019 ; Purohit and Rajagopalan 2020 . Despite that they have achieved considerable results, these methods usually fail to generate satisfying results when meeting out-of-domain data. Specifically, they suffer from severe performance drop with pretrained weights on other datasets. In contrast, some traditional deblurring methods Krishnan and Fergus 2009 ; Kruse et al. 2017 ; Ren et al. 2017 solve the problem in a closed-form way, suitable for any image content and dataset distribution. This is partly because non-deep learning methods are able to utilize the information of blur kernel for image deblurring, which is independent of image content. In this case, we suggest that bringing blur kernel prior information into deblurring networks may help with its deblurring abilities, especially on out-of-domain data. The first step is to make an estimation of the blur kernel in advance. Early approaches to solving this problem usually seek to estimate a uniform blur kernel Schuler et al. 2015 ; Ren et al. 2020 , based on the assumption that motion blur is spatially invariant. These methods show their shortcomings when encountered with real-world blurry images, which usually consist of multiple objects and complex structures, greatly enlarging the variety of motion in a single image. Subsequent works seek to estimate non-uniform blur kernels, for the purpose of processing real-world images. A number of recent works Carbajal et al. 2023 ; Li et al. 2022 have combined kernel features with deep neural networks, achieving remarkable performance on both synthetic and real-world deblurring tasks. The methods mentioned above have leveraged kernel information in a variety of ways, including direct deconvolution, and learning an adaptive module based on direct channel multiplication and concatenation. However, these incorporation approaches are either restrained to ideal assumptions of image composition or suffering from its rigidness. Motivated by the inherent property of Fourier Transform and deconvolution theorem, we propose a novel way of incorporating blur kernel prior, called F requency I ntegration M odule (FIM). Given two functions, one can obtain the result of their convolution by calculating the Hadamard product of their corresponding Fourier transforms, this is because convolution in the spatial domain equals point-wise multiplication in the frequency domain. Since a blurry image is obtained by convolution operation between a sharp image and its matching blur kernels, the blur process can be expressed as multiplication in the frequency domain. Based on the assumption, we propose the kernel-assisted deblurring module FIM. In order to optimize the integration of the proposed module with the network, we adopt an end-to-end Transformer-based deblurring network architecture based on frequency domain as the backbone of our work Kong et al. 2023 . Due to the fact that the backbone has an inherent asymmetric structure, we explore different structures of our module, along with different ways of implementing it. Ablation experimental results show that with a residual connection inside the block, and both encoder and decoder insertion, the proposed FIM block can best enhance the network’s abilities in image deblurring. Compared with traditional end-to-end deblurring networks, the innovation of blur kernel prior brings in extra crucial information about the degradation of an image. An advantage of blur kernels is that they are irrelevant to the content of the image. In this way, the learned network will not only be able to reconstruct sharp images based on domain-specific image information, but will also take into account the domain-unrelated blur kernel information. Therefore, we argue that kernel-based deblurring networks may achieve better performance on out-of-domain data. Experimental results prove our assumption, demonstrating that our proposed method helps with enhancing the blur removal process, achieving state-of-the-art on multiple image deblurring missions, both on in-domain data and out-of-domain data. Our main contribution can be summarized as follows: • We develop a novel way of utilizing blur kernel prior by fusing frequency domain information to enhance image deblurring, and conduct experiments to show the effect of kernel prior on image deblurring tasks. • We tackle the problem of out-of-domain data distribution by introducing an explicit blur kernel prior. Experiments on out-of-domain benchmark datasets show the effectiveness of our proposed module. • We explore different structures and implementation strategies for our network, and also perform experiments on a non-blind version of our method. Extensive experimental results on benchmark datasets demonstrate that our proposed multi-scale implementation method is capable of improving the performance of deblurring networks, outperforming state-of-the-art methods on this task. 2 Related Work 2.1 Kernel-based Deblurring Since a blurry image can be obtained by a sharp image with blur kernels and a blurring operation, it is common to utilize the kernel information to assist the deblurring process. The information on the kernel is either known or unknown, depending on the task. Early kernel-based deblurring methods are usually based on the assumption that the information of blur kernels is given. This kind of task is known as non-blind deblurring. Some non-deep-learning methods use natural image priors, such as global image prior Krishnan and Fergus 2009 and local image prior Zoran and Weiss 2011 . To solve the problem of undesired ringing artifacts in traditional methods, Xu et al. Xu et al. 2014 and Ren et al. Ren et al. 2018 combine spatial deconvolution with deep neural networks. With the development of photography, the need for blind image deblurring has greatly increased. A number of blind deblurring methods have been

Read the complete text