UHD Image Dehazing via anDehazeFormer with Atmospheric-aware KV Cache

Pu Wang, Pengwen Dai, Chen Wu, Yeying Jin, Dianjie Lu, Guijuan Zhang, Youshan Zhang, Zhuoran Zheng · 2025

Read UHD Image Dehazing via anDehazeFormer with Atmospheric-aware KV Cache by Pu Wang, Pengwen Dai, Chen Wu, Yeying Jin, Dianjie Lu, Guijuan Zhang, Youshan Zhang, Zhuoran Zheng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14010.txt.

Introduction

Pu Wang and co-authors published a research paper in 2025 on a fast transformer system that clears haze from ultra-high-definition photos. Giant images make dehazing slow and memory-hungry. Their design adds two ideas: a self-scaling normalization borrowed from a recent language model line, and a memory cache that knows the physics of haze.

The cache keeps or drops features based on how haze forms in air, which favors the parts that matter. Training settled about five times faster while using less memory. The system restores fifty big frames per second on a top gaming card and matches leading quality scores. A heat-map tool shows which pixels drove each fix.

Catalog record

CREATORPu Wang, Pengwen Dai, Chen Wu, Yeying Jin, Dianjie Lu, Guijuan Zhang, Youshan Zhang, Zhuoran Zheng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-14010

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

UHD Image Dehazing via anDehazeFormer with Atmospheric-aware KV Cache Pu Wang, Pengwen Dai, Chen Wu, Yeying Jin, Dianjie Lu, Guijuan Zhang, Youshan Zhang, Zhuoran Zheng Abstract In this paper, we propose an efficient visual transformer framework for ultra-high-definition (UHD) image dehazing that addresses the key challenges of slow training speed and high memory consumption for existing methods. Our approach introduces two key innovations: 1) an a daptive n ormalization mechanism inspired by the nGPT architecture that enables ultra-fast and stable training with a network with a restricted range of parameter expressions; and 2) we devise an atmospheric scattering-aware KV caching mechanism that dynamically optimizes feature preservation based on the physical haze formation model. The proposed architecture improves the training convergence speed by 5 × \times while reducing memory overhead, enabling real-time processing of 50 high-resolution images per second on an RTX4090 GPU. Experimental results show that our approach maintains state-of-the-art dehazing quality while significantly improving computational efficiency for 4K/8K image restoration tasks. Furthermore, we provide a new dehazing image interpretable method with the help of an integrated gradient attribution map. Our code can be found here: https://anonymous.4open.science/r/anDehazeFormer-632E/README.md . 1 Introduction The exponential growth of ultra-high-definition (UHD) imaging techniques, ranging from 4K medical endoscopes to 8K satellite sensors, has significantly transformed visual data acquisition across various industries. While these techniques can capture unprecedented levels of detail, their operational environments frequently introduce atmospheric distortions [ 28 , 38 ] in natural environments. Traditional dehazing methods encounter a critical efficiency paradox: physics-based approaches [ 30 , 26 ] struggle to address the complexities associated with real-world scattering phenomena. In contrast, deep learning methods [ 10 , 33 , 21 ] require substantial computational resources for UHD processing, typically necessitating 80GB of GPU memory for handling a 4K image. Current solutions try to strike a balance between quality and efficiency by processing images in patches [ 12 ] or by downsampling the resolution [ 25 ] . However, these approaches come with two major drawbacks: 1) Localized processing messes up the overall atmospheric consistency, leading to noticeable seams in sky areas; 2) The major challenge is to create a UHD dehazing algorithm that maintains the perception of the spatial environment while preserving the regression accuracy at different scale resolutions on low computational resources. To address these challenges, we introduce anDehazeFormer, an efficient vision Transformer method that revolutionizes UHD image dehazing by integrating adaptive normalization and physics-aware cache mechanisms. Specifically, our method leverages two key innovations to overcome the limitations of conventional methods. i) Adaptive Normalization for stable and rapid training: We are inspired by the idea of normalizing all parameters of a neural network proposed by nGPT, but the difference is that we are adaptive on each network block. As shown in Fig. 1 , by leveraging the physical parameters learned by the atmosphere-aware network to adaptively bound the normalized range of each network block parameter, our approach improves the training speed by a 5 \times compared to the standard Transformer architecture. In addition, this design has a large learning space compared to nGPT’s method to ensure that the model can efficiently reconstruct haze features without violating the stability of training, which can be accelerated by deploying it on any mainstream GPU hardware. ii) Atmospheric Scattering-Aware KV Caching: Motivated by the atmospheric scattering model [ 19 , 15 ] , we develop a key-value (KV) caching mechanism that dynamically optimizes feature retention based on haze density. Unlike static attention mechanisms, this approach prioritizes features correlated with atmospheric scattering coefficients, thereby optimizing memory reuse during inference. This strategy minimizes redundant computations while preserving critical scene details and prioritizing relevant contextual information in hazy regions. In addition, we propose anDehazeFormer, a method dedicated to image deinterpretability. Figure 1 : Improvement of our model over the SOTA approaches in 8KDehaze [ 6 ] . The circle size is proportional to the number of model parameters. Our primary contributions are summarized as follows: • We proposed a physically guided adaptive normalization mechanism. By dynamically calibrating the feature distribution with atmospheric parameters, the training speed is increased by five times while limiting the model complexity. • For the first time, we integrated the physical prior of the haze into the KV caching process. Different from traditional caching mechanisms, which mainly depend on data statistical characteristics, this approach dynamically identifies the haze concentration distribution in images through a physical model and selectively retains key features related to haze removal. • To improve the interpretability of haze removal models, we develop a visual attribution method that identifies and quantifies how specific regions or features contribute to model performance. Extensive experimental results demonstrate that our methods are best performers on publicly available benchmarks. 2 Related work Single Image Dehazing. Single image dehazing has evolved from physics-based approaches to data-driven deep learning. Early methods like the Dark Channel Prior (DCP) [ 16 ] estimated scene transmission using statistical priors but faced challenges in sky regions and high computation. Subsequent work, such as the Color Attenuation Prior (CAP) [ 13 ] , linked depth to color saturation and brightness, yet remained constrained by manual priors [ 29 ] . Deep learning revolutionized the field. DehazeNet [ 4 ] pioneered CNN-based transmission estimation, while AOD-Net [ 22 ] embedded atmospheric scattering models into end-to-end networks. Recent progress in image dehazing has seen attention-based approaches like FFA-Net [ 9 ] and GridDehazeNet [ 24 ] alongside unsupervised CycleGAN-based frameworks [ 39 ] , with Wang et al.’s two-stage architecture achieving superior PSNR/SSIM through multi-scale attention and dark channel prior-guided haze component disentanglement [ 35 ] . Learning-based UHD image restoration has received some attention in recent years. While deep learning excels in conventional image restoration [ 5 , 11 , 34 ] , direct application to UHD (4K/8K) faces scalability challenges: dense pixels can lead to excessive GPU memory consumption and even cause overflow errors on high end GPUs. For transformer based UHD images restoration, two main methods are currently adopted. One approach is to segment the image into small pieces, but there is a boundary error [ 36 ] , as well as downsampling upsampling [ 33 ] . This reduces the computational load, but it may lose high-frequency details. Neither of them can integrate multi resolution information. It is worth noting that Li et al. [ 23 ] utilized frequency-domain similarity to restore low-light UHD images in the frequency domain, but faces computational bottlenecks for real time applications. Zheng et al. [ 42 ] enabled real time 4K dehazing (125 fps) through low-resolution affine grid prediction and guided upsampling. In addition, to address the low resource 4K dehaze demand of mobile and IoT devices and lack of dataset, [ 41 ] proposed GAN simulation 4K haze map and construction of 4K-haze dataset. Despite progress, unresolved challenges persist, particularly the inefficiency in processing UHD images. It is necessary to study lightweight architectures and collaborative design of algorithms and hardware to accelerate. The Key-Value (KV) cache mechanism. The KV caching mechanism was originally designed to accelerate autoregressive generation in Transformers by reusing historical attention states, faces critical scalability challenges in UHD image processing due to excessive memory consumption and inefficient dynamic feature management. Early approaches like

Read the complete text