Exploiting Diffusion Prior for Real-World Image Dehazing with Unpaired Training
Yunwei Lan, Zhigao Cui, Chang Liu, Jialun Peng, Nian Wang, Xin Luo, Dong Liu · 2025
Read Exploiting Diffusion Prior for Real-World Image Dehazing with Unpaired Training by Yunwei Lan, Zhigao Cui, Chang Liu, Jialun Peng, Nian Wang, Xin Luo, Dong Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15017.txt.
Introduction
Yunwei Lan and co-authors clear haze from real photos using a diffusion model's imagination, trained without matched pairs in this 2025 paper. Real haze is messy, and collecting the same scene with and without it is near impossible. Unpaired methods learn from separate piles of hazy and clear shots, but they generalize poorly across scenes.
Their framework slips diffusion models into a cycle-consistent setup as the translators both ways, borrowing their strong sense of what hazy and clear images look like. Physical knowledge about scattering is folded in as extra guidance. The cleanup also runs through text as well as pixels, squeezing more from the model's representations. On several real-world sets the method beat its rivals. The authors release the code for a problem every outdoor camera shares.
Catalog record
| CREATOR | Yunwei Lan, Zhigao Cui, Chang Liu, Jialun Peng, Nian Wang, Xin Luo, Dong Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-15017
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Exploiting Diffusion Prior for Real-World Image Dehazing with Unpaired Training Yunwei Lan, Zhigao Cui, Chang Liu, Jialun Peng, Nian Wang, Xin Luo, Dong Liu Abstract Unpaired training has been verified as one of the most effective paradigms for real scene dehazing by learning from unpaired real-world hazy and clear images. Although numerous studies have been proposed, current methods demonstrate limited generalization for various real scenes due to limited feature representation and insufficient use of real-world prior. Inspired by the strong generative capabilities of diffusion models in producing both hazy and clear images, we exploit diffusion prior for real-world image dehazing, and propose an unpaired framework named Diff-Dehazer. Specifically, we leverage diffusion prior as bijective mapping learners within the CycleGAN, a classic unpaired learning framework. Considering that physical priors contain pivotal statistics information of real-world data, we further excavate real-world knowledge by integrating physical priors into our framework. Furthermore, we introduce a new perspective for adequately leveraging the representation ability of diffusion models by removing degradation in image and text modalities, so as to improve the dehazing effect. Extensive experiments on multiple real-world datasets demonstrate the superior performance of our method. Our code https://github.com/ywxjm/Diff-Dehazer. Introduction Under hazy conditions, the quality of images is severely degraded. Such degradation significantly affects the visual appeal of images, and causes information loss, further restricting their performance in other downstream tasks, e.g., object detection ( Huang, Le, and Jaw 2020 ) . Therefore, image dehazing, which aims to restore clear images from hazy ones, has been extensively studied in the past decade. Following conventional studies, we normally formulate the hazy image with the Atmospheric Scattering Model (ASM), which can be written as: I=Jt+A(1-t), (1) where I represents the hazy image and J refers to its corresponding clear image. A and t denote the atmospheric light and transmission map, where both of them are usually unknown. Following the formulation in Eq. ( 1 ), early dehazing methods ( He, Sun, and Tang 2010 ; Meng et al. 2013 ) try to estimate A and t with hand-crafted physical priors, and restore hazy images into clear ones by reversing the ASM. Even so, these methods normally obtain over-saturated results, since hand-crafted physical priors are not universally compatible with all scenes. With the advancement of deep learning, prevailing methods ( Zheng et al. 2023 ; Song et al. 2023 ; Qiu et al. 2023 ) aim to design neural networks to model physical parameters, or directly restore images in an end-to-end manner, as illustrated in Fig. 1 (a). These methods primarily utilize synthetic paired data for training since obtaining real-world hazy and clear image pairs is virtually impossible. Although improved performance is observed, such paired training paradigm often fails to generalize to real-world dehazing scenarios, due to the ill-presenting performance of trained networks that lack real-world information from hazy images. Figure 1: (a) Previous dehazing methods with paired training. (b) Previous CycleGAN-based dehazing methods with unpaired training. (c) Existing stable diffusion-based dehazing methods with paired training. (d) Our stable diffusion-based dehazing method with unpaired training. To tackle the bottleneck of paired training, recent studies ( Zhao et al. 2021 ; Yang et al. 2022 ) consider the paradigm of unpaired training for image dehazing, so as to discover available information from real-world hazy images and model the particular mapping between real-world hazy and clear images. The key problem of unpaired training is how to impose a structure-consistent constraint between hazy and dehazed images, so that the influence of misaligned information caused by unpaired real clear images can be suppressed. CycleGAN ( Zhu et al. 2017 ) offers a classic solution by leveraging a framework to maintain the consistency between the mapped domain and the original one. Such paradigm, as shown in Fig. 1 (b), is latter adopted by several studies, e.g., CycleDehaze ( Engin, Genç, and Kemal Ekenel 2018 ) , D4 ( Yang et al. 2022 ) , and ODCR ( Wang et al. 2024 ) , along with promising real-world dehazing performance. However, these methods struggle to achieve effective representation by a limited number of training images, resulting in sub-optimal performance. Inspired by the strong representation capabilities of diffusion models, some methods ( Liu et al. 2024c ; Lin et al. 2024 ) retort to the pre-training and fine-tuning mode, which leverages diffusion prior to improve the dehazing effect, as illustrated in Fig. 1 (c). Nevertheless, these methods still have limitations in several real-world scenarios due to their reliance on synthetic paired training data that fails to simulate real scenes. To address the aforementioned problems, we propose an effective paradigm for real-world image dehazing, namely Diff-Dehazer. As shown in Fig. 1 (d), we improve image dehazing with both diffusion prior and the unpaired training paradigm. We argue that simply inheriting the unpaired training framework will exhibit sub-optimal dehazing performance without accounting for the physical properties of real-world hazy scenes. Consequently, we conduct a comprehensive investigation on the physical background of image dehazing and integrate physical priors into our framework. Furthermore, We observe that text description can improve the resulting image by offering enriched high-level semantics, which has validated its effectiveness in previous studies. Therefore, we adopt a multi-modal paradigm, incorporating text and image to improve the dehazing effect. Particularly, our contributions are four-fold: 1) We adopt a pre-trained stable diffusion as the foundation of our CycleGAN framework, so as to leverage its strong representation ability in modeling real-world data. 2) We boost the generalization ability of image dehazing with physical priors, whose potentials are greatly neglected in previous studies, and propose Physics-Aware Guidance (PAG) in our framework. 3) We utilize the enriched high-level semantics stored in text modality, and propose Text-Aware Guidance (TAG) to bootstrap textual guidance for image dehazing. 4) To facilitate further studies in this topic, we construct an unpaired real-world dataset, consisting of 6,519 hazy images and 11,293 clear images. Extensive experiments on existing benchmark datasets illustrate the superior performance of our method compared to state-of-the-art methods. Related Works Image Dehazing Early dehazing methods extract physical priors from the statistical properties of natural images, and then restore hazy images into clear ones via the ASM. For example, DCP ( He, Sun, and Tang 2010 ) proposes the dark channel prior to estimate the transmission map and atmospheric light. BCCR ( Meng et al. 2013 ) explores inherent boundary constraint and L1-norm-based contextual regularization to optimize the transmission map. Nevertheless, these methods are heuristic for real-world image dehazing. They usually lead to over-enhanced results, since hand-crafted priors fail to fit the complexity and diversity of real-world haze. With the development of deep learning, latter studies concentrate on designing networks for image dehazing. For instance, C2PNet ( Zheng et al. 2023 ) customizes a circular learning strategy for image dehazing. Some methods ( Guo et al. 2022 ; Song et al. 2023 ; Qiu et al. 2023 ) perform image dehazing based on the Transformer ( Vaswani et al. 2017 ) architecture. Even so, all the aforementioned methods still struggle to handle several dehazing cases, especially the ones under real-world scenarios, due to their reliance on synthetic paired data. To address these limitations, RefineDNet ( Zhao et al. 2021 ) designs a weakly supervised two-stage dehazing