A low-complexity method for efficient depth-guided image deblurring
Ziyao Yi, Diego Valsesia, Tiziano Bianchi, and Enrico Magli · 2026
Read A low-complexity method for efficient depth-guided image deblurring by Ziyao Yi, Diego Valsesia, Tiziano Bianchi, and Enrico Magli (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03924.txt.
Introduction
Ziyao Yi and three co-authors design a lightweight neural network that sharpens blurred photos using depth maps from mobile lidar sensors. Deblurring is ill-posed and hard, and the best deep models have grown so complex that only powerful servers can run them. Phones, however, increasingly carry lidar, and depth information genuinely helps separate foreground blur from background detail.
Their model uses the wavelet transform to split structural detail and cut spatial redundancy, and it conditions its features efficiently on the depth signal. The result matched recent state-of-the-art quality while cutting computational complexity by up to two orders of magnitude. That efficiency gap decides whether advanced deblurring ships on everyday phones or stays a server demo, especially for users whose only camera is a handset.
Catalog record
| CREATOR | Ziyao Yi, Diego Valsesia, Tiziano Bianchi, and Enrico Magli |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-03924
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A low-complexity method for efficient depth-guided image deblurring Ziyao Yi, Diego Valsesia, Tiziano Bianchi, and Enrico Magli Abstract Image deblurring is a challenging problem in imaging due to its highly ill-posed nature. Deep learning models have shown great success in tackling this problem but the quest for the best image quality has brought their computational complexity up, making them impractical on anything but powerful servers. Meanwhile, recent works have shown that mobile Lidars can provide complementary information in the form of depth maps that enhance deblurring quality. In this paper, we introduce a novel low-complexity neural network for depth-guided image deblurring. We show that the use of the wavelet transform to separate structural details and reduce spatial redundancy as well as efficient feature conditioning on the depth information are essential ingredients in developing a low-complexity model. Experimental results show competitive image quality against recent state-of-the-art models while reducing complexity by up to two orders of magnitude. I Introduction In recent years, mobile devices such as smartphones and tablets have become the prime tools for capturing pictures, with the ability to capture and display high-quality images already becoming a measurement of the equipment’s quality. Learning-based image processing algorithms such as deblurring [ 1 , 2 ] , denoising [ 3 , 4 ] , and image super-resolution [ 5 , 6 ] , are being increasingly used to meet the demand of customers for image quality. However, current literature on the topic is mostly focused on achieving the highest image quality, with little attention to computational complexity, particularly for deployment on resource-constrained edge devices. While some efficient approaches have been proposed to address these challenges [ 7 , 8 , 9 ] , their performance is often limited by the inability of lightweight models to extract enough meaningful information from a single data modality. As mobile technology continues to advance, newer devices are being integrated with multimodal imaging platforms, which combine multiple kinds of imaging devices. In particular, Lidar sensors are widely equipped in mobile devices such as Apple’s iPhone [ 10 ] . These sensors provide depth information by sending a grid of light pulses and measure the return time to estimate the distance at multiple points. Since such depth data is sourced from an active instrument, it can offer complementary spatial and structural information that is not affected by motion blur and can be valuable for the image deblurring task, as recently shown in [ 11 ] . While [ 11 ] showed the effectiveness of mobile Lidar depth maps for regularization of image deblurring, and introduced some key ingredients towards efficient models, namely efficient adapters and continual learning techniques, the overall computational complexity of the presented models remained high for edge devices. In this paper we design a low-complexity model, called EDIBNet (Efficient Depth-guide Image Debluring network), for depth-guided deblurring that can be run efficiently on edge devices thanks to a reduction of up to two orders of magnitude in FLOPs, runtime and memory requirements, while maintaining an image quality close to that of state-of-the-art models. Our solution relies on the discrete wavelet transform (DWT) to provide a scale-space decomposition into sub-bands composed of low- (LL) and high-frequency (LH, HL, HH) components. This representation allows us to significantly reduce both runtime and computational cost since deblurring operations can be limited to the first-level decimated LL sub-band, skipping high-frequency details in the other sub-bands that have minimal impact on the dublurring performance. This is integrated into a lightweight neural network with an encoder-decoder architecture. Additionally, real-world depth information, acquired from mobile LiDAR, is fed into the network through efficient lightweight adapter modules that effectively fuse spatial features from both modalities. This design allows the network to benefit from geometric priors while remaining computationally practical for edge deployment. To summarize, our contributions are as follows: • We design a compact encoder-decoder architecture tailored for edge deployment, which seamlessly integrates real-world depth information from mobile LiDAR via a lightweight adapter. This fusion enhances structure-aware restoration while maintaining low computational overhead. • We employ the discrete wavelet transform to decompose images into sub-bands, enabling efficient representation and computation while preserving both global structures and local details. • Our model processes a high-resolution frame in only 0.2 seconds on an NVIDIA Jetson Orin Nano edge device, showing a reduction of two orders of magnitude with respect to state-of-the-art models while providing competitive image quality. II Background and Related Work II-A Image deblurring Deblurring is a classic ill-posed inverse problem, whose aim is to reconstruct a sharp image from blurred observations. Mathematically, the observed image \mathbf{y} is expressed as the convolution of the original image \mathbf{x} with a blur kernel \mathbf{k} : \displaystyle\mathbf{y}=\mathbf{k}\circledast\mathbf{x}. (1) where \circledast denotes convolution. With the rise of deep learning, learning-based approaches have achieved great success thanks to their ability to learn complex priors directly from training data. A common paradigm is supervised learning, which relies on paired blurred and sharp images during training to optimize deep models. [ 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 3 ] . For example, Zhang et al. [ 12 ] proposed a network consisting of three CNNs and an RNN for deconvolution. DeblurGAN [ 13 ] and DeblurGAN-v2 [ 14 ] introduced adversarial training for image deblurring. Recent methods such as MRLPFNet [ 15 ] and MSSNet [ 16 ] adopt multi-scale architectures to jointly capture fine details and global structures. With the success of Transformers in natural language processing [ 20 ] and computer vision [ 21 ] , they have also been increasingly applied to deblurring. IPT [ 17 ] was among the first to use standard Transformer blocks trained on large-scale datasets. Uformer [ 18 ] introduced a U-shaped Transformer architecture for efficient image restoration, while Stripformer [ 22 ] used intra- and inter-strip tokens to enhance feature representation. Restormer [ 19 ] demonstrated that long-range dependencies can be captured effectively with improved computational efficiency. Meanwhile, NAFNet [ 3 ] showed that simplified network designs with gating mechanisms can achieve competitive performance without relying on costly self-attention modules. In addition to focusing only on blurry images, some works have studied the use of information from other domains such as segmentation maps [ 23 , 24 ] , optical flow [ 25 ] , and event-camera data [ 26 ] to better regularize the reconstruction process and improve image quality. A small number of works have also explored using depth information to improve deblurring performance. [ 27 ] proposed a hierarchical depth estimation based on region trees to progressively generate credible blur kernel estimates. Li et al. [ 28 ] first extract the depth map and adopt a depth refinement network to restore the edges and structures in the depth map. Apart from these, Yi [ 11 ] demonstrates that utilizing true depth information generated from mobile Lidar can also significantly boost the effectiveness of deblurring algorithms. II-B Efficient deblurring A few works have recently studied more efficient deblurring models. Hu et al [ 29 ] proposed PyNAS, which adopts gradient-based search strategies and innovatively searches the patch and scale hierarchy, achieving 58 fps for 720p images on Titan XP GPU. Ruan