Channel Consistency Prior and Self-Reconstruction Strategy Based Unsupervised Image Deraining
Guanglu Dong 1 Tianheng Zheng 1 Yuanzhouhan Cao 2 Linbo Qing 1 Chao Ren 1 1 Sichuan University, Chengdu, China 2 Beijing Jiaotong University, Beijing, China {dongguanglu, zhengtianheng}@stu.scu.edu.cn, [email protected] {qing_lb, chaoren}@scu.edu.cn · 2025
Read Channel Consistency Prior and Self-Reconstruction Strategy Based Unsupervised Image Deraining by Guanglu Dong 1 Tianheng Zheng 1 Yuanzhouhan Cao 2 Linbo Qing 1 Chao Ren 1 1 Sichuan University, Chengdu, China 2 Beijing Jiaotong University, Beijing, China {dongguanglu, zhengtianheng}@stu.scu.edu.cn, [email protected] {qing_lb, chaoren}@scu.edu.cn (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-18703.txt.
Introduction
Guanglu Dong, Tianheng Zheng, Yuanzhouhan Cao, Linbo Qing, and Chao Ren remove rain from photos without paired training data, in work from 2025. Paired clean and rainy photos are hard to gather for real scenes. Models trained on made up pairs often fail when real rain looks different from the training set.
Their framework builds high quality fake pairs from unpaired photos during training. A channel consistency loss keeps background detail while moving rain streaks across images. A self reconstruction step cuts stray content transfer from the generator network. Tests on synthetic and real datasets beat other unsupervised methods on cleaning scores. The method also held up better on new scenes than rivals.
Catalog record
| CREATOR | Guanglu Dong 1 Tianheng Zheng 1 Yuanzhouhan Cao 2 Linbo Qing 1 Chao Ren 1 1 Sichuan University, Chengdu, China 2 Beijing Jiaotong University, Beijing, China {dongguanglu, zhengtianheng}@stu.scu.edu.cn, [email protected] {qing_lb, chaoren}@scu.edu.cn |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-18703
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Channel Consistency Prior and Self-Reconstruction Strategy Based Unsupervised Image Deraining Guanglu Dong 1 Tianheng Zheng 1 Yuanzhouhan Cao 2 Linbo Qing 1 Chao Ren 1 1 Sichuan University, Chengdu, China 2 Beijing Jiaotong University, Beijing, China {dongguanglu, zhengtianheng}@stu.scu.edu.cn, [email protected] {qing_lb, chaoren}@scu.edu.cn Abstract Recently, deep image deraining models based on paired datasets have made a series of remarkable progress. However, they cannot be well applied in real-world applications due to the difficulty of obtaining real paired datasets and the poor generalization performance. In this paper, we propose a novel C hannel Consistency Prior and S elf-Reconstruction Strategy Based U nsupervised Image D eraining framework, CSUD , to tackle the aforementioned challenges. During training with unpaired data, CSUD is capable of generating high-quality pseudo clean and rainy image pairs which are used to enhance the performance of deraining network. Specifically, to preserve more image background details while transferring rain streaks from rainy images to the unpaired clean images, we propose a novel Channel Consistency Loss (CCLoss) by introducing the Channel Consistency Prior (CCP) of rain streaks into training process, thereby ensuring that the generated pseudo rainy images closely resemble the real ones. Furthermore, we propose a novel Self-Reconstruction (SR) strategy to alleviate the redundant information transfer problem of the generator, further improving the deraining performance and the generalization capability of our method. Extensive experiments on multiple synthetic and real-world datasets demonstrate that the deraining performance of CSUD surpasses other state-of-the-art unsupervised methods and CSUD exhibits superior generalization capability. Code is available at https://github.com/GuangluDong0728/CSUD . 1 Introduction Image deraining is an important task in low-level computer vision Liu et al. 2023a ; Ren et al. 2022 ; Fu et al. 2017a ; He et al. 2010 ; Zamir et al. 2022 ; Potlapalli et al. 2023 . It aims to reconstruct a clean image from its rainy version, which has a profound impact on subsequent high-level tasks such as object detection, recognition, and semantic segmentation Liu et al. 2020 ; Ren et al. 2016 ; Wojna et al. 2019 ; Liu et al. 2023b . To mitigate the negative impact of rain, numerous deep learning based supervised image deraining methods Fu et al. 2017a ; Fu et al. 2017b ; Zhang and Patel 2018 ; Hu et al. 2019 ; Li et al. 2018 ; Ren et al. 2019 ; Yi et al. 2021 ; Wang et al. 2019 ; Jiang et al. 2020 ; Lin et al. 2022 have been proposed and they achieve remarkable progress on synthetic datasets. However, the performance of these methods is largely constrained by the difficulty of capturing a large number of high-quality paired datasets when applied to real-world scenarios. Additionally, attempting to directly apply supervised models trained on synthetic datasets to real-world scenarios is also difficult because of the huge domain gap between synthetic and real-world rain Ye et al. 2021 and the overfitting issue of supervised methods Gu et al. 2023 . Figure 1 : Deraining results on the real rainy images captured by ourselves in real-world scenarios. Compared with the supervised method Restormer Zamir et al. 2022 and the unsupervised method DerainCycleGAN Wei et al. 2021 , our CSUD exhibits extremely strong generalization capability in the real world and achieves the best visual results. Compared to supervised methods, unsupervised deep learning methods Jin et al. 2019 ; Wei et al. 2021 ; Chen et al. 2022b ; Ye et al. 2022 ; Xu et al. 2022 for image deraining tasks generally achieve end-to-end image deraining without paired clean-rainy images during training. This allows unsupervised methods to effectively handle complex real-world scenarios, especially when data collection costs are high. However, due to the high difficulty and challenges of unsupervised deraining methods in training process and the lack of prior knowledge Wei et al. 2021 , there is still very little relevant research in this field. Additionally, the deraining performance of existing unsupervised methods always lags far behind that of supervised methods, and they face the same generalization issues as supervised methods. As shown in Fig. 1 , even the SOTA supervised and unsupervised deraining models Zamir et al. 2022 ; Wei et al. 2021 encounter substantial generalization issues and struggle to achieve satisfactory results when dealing with rainy images captured in real world, and sometimes they even fail to remove any rain streaks due to the more complex rain distributions in real world. Based on the above analysis, how to design an effective unsupervised deraining framework to avoid the need for real paired data and how to improve the generalization performance of deraining methods have become key research issues. In this paper, we propose a novel channel consistency prior and self-reconstruction strategy based unsupervised image deraining framework which only needs unpaired data to train the network and can be easily generalized to real-world scenarios. We first conduct detailed analysis of the channel consistency prior (CCP) of rain streaks, and then propose a novel channel consistency loss to constrain the generator to synthesize high-quality pseudo rainy images. In addition, we utilize the proposed self-reconstruction (SR) strategy to further improve the performance of the generator and enhance the generalization capability of the derainer. As shown in Figure 1 , our CSUD achieves the most promising performance on the real-world captured images compared to both supervised and unsupervised deraining methods. The main contributions of this work are summarized below: • We propose a novel channel consistency prior and self-reconstruction strategy based unsupervised image deraining framework which is able to generate high-quality pseudo paired data for training. This framework can effectively address the issues of insufficient paired data in real world and significantly improve the generalization capability of the network. • We propose a novel channel consistency loss (CCLoss) according to the channel consistency prior (CCP) of rain streaks to enhance the performance of the generator, preserving more background details while generating pseudo rainy images. To the best of our knowledge, we are the first to incorporate CCP into the training process of unsupervised deraining framework. • We propose a self-reconstruction (SR) strategy to solve the redundant information transfer problem of the generator. SR strategy can facilitate the accuracy of rain streaks transfer in the generator and enhance the deraining performance and the generalization capability of the derainer without altering the existing network structure. • Extensive experiments on numerous benchmark datasets demonstrate that our proposed unsupervised framework can effectively tackle the deraining tasks on both synthetic and real-world rainy images with extremely superior generalization capability in real-world scenarios. 2 Related Works Figure 2 : Framework of the proposed CSUD. The red arrows represent the baseline, purple arrows represent the 3 extra constraints, green arrows represent the self-reconstruction (SR) strategy, and blue arrows represent the CCLoss. The 4 input arrows of RIEM represent 4 separate runs of the generator, each time guided by a different image. Both RIEM and CFEM receive only 1 input image at a time. 2.1 Deep Learning Based Single Image Deraining Supervised Single Image Deraining. Recently, with the development of deep learning, numerous excellent single image deraining Fu et al. 2017b ; Fu et al. 2017a ; Zhang and Patel 2018 ; Chen et al. 2023 ; Jiang et al. 2020 ; Chen et al. 2024