Physics-Informed Image Restoration via Progressive PDE Integration

Shamika Likhite*, Santiago López-Tapia, Aggelos K. Katsaggelos · 2025

Read Physics-Informed Image Restoration via Progressive PDE Integration by Shamika Likhite*, Santiago López-Tapia, Aggelos K. Katsaggelos (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06244.txt.

Introduction

Shamika Likhite, Santiago López-Tapia, and Aggelos Katsaggelos improve motion deblurring by teaching the network some physics. Motion blur smears images along the direction of movement, and ordinary networks struggle to link distant parts of a smear. Their training framework weaves partial differential equation dynamics into existing restoration designs.

Advection-diffusion equations guide how features evolve inside the network, mirroring the directional flow of real blur. The added physics layer costs only about one percent more computation at run time. Across four well-known restoration designs and standard benchmarks, image quality scores rose consistently, which supports physics-guided design as a practical route for image restoration.

Catalog record

CREATORShamika Likhite*, Santiago López-Tapia, Aggelos K. Katsaggelos
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-06244

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Physics-Informed Image Restoration via Progressive PDE Integration Shamika Likhite*, Santiago López-Tapia, Aggelos K. Katsaggelos Abstract Motion blur, caused by relative movement between camera and scene during exposure, significantly degrades image quality and impairs downstream computer vision tasks such as object detection, tracking, and recognition in dynamic environments. While deep learning-based motion deblurring methods have achieved remarkable progress, existing approaches face fundamental challenges in capturing the long-range spatial dependencies inherent in motion blur patterns. Traditional convolutional methods rely on limited receptive fields and require extremely deep networks to model global spatial relationships, while transformer-based approaches with self-attention mechanisms can model global context but introduce additional architectural complexity. These limitations motivate the need for alternative approaches that incorporate physical priors to guide feature evolution during restoration. In this paper, we propose a novel motion deblurring framework that integrates physics-informed partial differential equation (PDE) dynamics into state-of-the-art restoration architectures through a progressive training strategy. By leveraging advection-diffusion equations to model feature evolution, our approach naturally captures the directional flow characteristics of motion blur while enabling principled global spatial modeling. The advection component directs information flow along image structures to preserve edges and textures, while the diffusion component provides adaptive smoothing to reduce artifacts during the restoration process. Our PDE-enhanced deblurring models achieve superior restoration quality with minimal overhead, adding only approximately 1% to inference GMACs (0.6 to 2.4 GMACs depending on the base architecture) while providing consistent improvements in perceptual quality across multiple state-of-the-art architectures. Comprehensive experiments on standard motion deblurring datasets (GoPro, RealBlur-R, and RealBlur-J) demonstrate that our physics-informed approach improves PSNR and SSIM significantly across four diverse architectures, including FFTformer, NAFNet, Restormer, and Stripformer. These results validate that incorporating mathematical physics principles through PDE-based global layers can enhance deep learning-based image restoration, establishing a promising direction for physics-informed neural network design in computer vision applications. 1 INTRODUCTION Motion blur significantly degrades image quality and reduces accuracy in subsequent computer vision tasks such as object classification, scene understanding, and activity recognition. For instance, analyzing high-speed photography for motion capture or automated analysis is crucial in sports analytics and surveillance applications. Such dynamic imaging scenarios inherently involve rapid subject movements and camera operations, introducing substantial motion blur that severely compromises the accuracy of object detection, feature extraction, and recognition systems. Similarly, mobile photography and handheld camera systems frequently encounter motion blur due to camera shake, subject movement, or inadequate stabilization, resulting in degraded image quality that significantly impacts downstream computer vision applications in real-world scenarios. A fundamental challenge in image deblurring is effectively capturing long-range spatial dependencies in motion blur patterns. Traditional convolutional approaches rely on limited receptive fields and require very deep networks to model global spatial relationships, while recent transformer-based methods achieve global modeling through self-attention mechanisms but with additional architectural complexity. Current state-of-the-art image restoration methods typically employ data-driven optimization without explicitly incorporating physical priors about the blur formation and restoration process. This motivates exploring physics-informed approaches that can guide feature evolution through mathematical constraints while maintaining restoration quality. Inspired by the work "Condensing CNNs with Partial Differential Equations," [ 19 ] , we propose a novel methodology that incorporates PDE-informed principles into image restoration networks. Unlike traditional approaches that rely solely on data-driven optimization, our method leverages the mathematical foundations of differential equations to model feature evolution during the restoration process. Specifically, we introduce PDE-based global layers that capture the directional flow characteristics inherent in motion blur patterns through advection-diffusion dynamics. To address the gradient stability challenges that arise when integrating iterative PDE solvers into deep networks, we develop a progressive training strategy that gradually increases the number of PDE iterations while correspondingly reducing the temporal step size to maintain constant total integration time. This progressive approach enables stable convergence while allowing the network to benefit from finer temporal discretization as training progresses. By incorporating mathematical priors that model blur formation as a physical process, we achieve improved restoration quality across multiple state-of-the-art architectures with minimal additional computational overhead. In this paper, our main contributions are: 1. We propose the incorporation of a Neural Network layer inspired by the advection-diffusion PDE into deep learning image restoration models through a progressive training strategy. This allows feature evolution to be guided by advection–diffusion dynamics, enabling more effective restoration while preserving global spatial interactions. 2. We show that incorporating our training method into existing architectures leads to substantial improvements in motion deblurring, enhancing perceptual quality and downstream vision task performance without significantly increasing computational complexity. Fig. 1: High-level architecture of the image restoration network. The network follows a U-Net style encoder-decoder structure, where the input degraded image y is progressively downsampled through encoder blocks (Encoder Block 1 to N) via max pooling operations. At the bottleneck, global layers process the latent representation at the coarsest scale. The decoder path progressively upsamples the features through decoder blocks (Decoder Block N to 1) using upward convolutions to reconstruct the restored image x*. Skip connections between corresponding encoder and decoder blocks preserve spatial information across scales. The global layers at the bottleneck serve as the primary location for integrating physics-informed processing. 2 Related Work 2-A Evolution of Image Deblurring Methods Image deblurring has evolved significantly from early traditional approaches to sophisticated deep learning methods that leverage advanced architectural designs. Traditional deconvolution-based methods [1,2] rely on mathematical models of the blur process, often assuming uniform blur kernels and struggling with complex, spatially-varying motion patterns. These approaches suffer from computational inefficiency and suboptimal restoration quality due to their reliance on hand-crafted priors and simplified blur models. Modern image deblurring methods can be broadly categorized into single-image and multi-scale approaches. Single-image methods [3,4] process individual blurred images directly, focusing on learning effective representations for blur removal. Multi-scale methods [5,6] exploit hierarchical feature representations at different resolutions, enabling better handling of large blur kernels and complex motion patterns but often at the cost of increased computational overhead. The advent of deep learning has revolutionized image restoration tasks. Convolutional Neural Networks (CNNs) have been extensively employed for image deblurring, with architectures ranging from simple encoder-decoder networks to complex multi-scale designs [7,8]. Recent works have explored attention mechanisms [9] and transformer architectures [10] to better model long-range spatial dependencies crucial for effective blur removal. NAFNet [11] introduced a novel approach by simplifying network architectures while maintaining competitive performance, demonstrating that carefully designed simple blocks can be highly effective for image restoration tasks. This work highlighted the importance of architectural efficiency and inspired subsequent research into lightweight yet powerful restoration models, reinforcing the principle that architectural simplicity can coexist with high performance in image deblurring applications. 2-B Advanced Architectures and Spatial Modeling Effective spatial feature modeling remains a fundamental challenge in image restoration. Traditional CNN-based methods [13,14] rely on local convolutions with limited receptive fields, requiring deep networks to capture long-range spatial dependencies necessary for handling large blur kernels. Dilated convolutions [15,16] offer an alternative by expanding receptive fields without increasing computational cost, but they can introduce artifacts and struggle with irregular blur patterns. Vision transformers have gained significant attention for their ability to model long-range dependencies effectively [22,23]. In image processing, transformers have been applied to capture global spatial relationships, often outperforming CNN-based approaches on various restoration tasks [24,25]. However, the

Read the complete text