Towards Scale-Aware Low-Light Enhancement via Structure-Guided Transformer Design
Wei Dong *, Yan Min *, Han Zhou †, Jun Chen, * Equal Contribution, † Corresponding Author · 2025
Read Towards Scale-Aware Low-Light Enhancement via Structure-Guided Transformer Design by Wei Dong *, Yan Min *, Han Zhou †, Jun Chen, * Equal Contribution, † Corresponding Author (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-14075.txt.
Introduction
Wei Dong and co-authors build a tool in a 2025 paper to brighten photos taken in near dark. Most past tools map dark to bright in one leap, or lean on sense cues read from the spoiled photo itself. In deep dark, those cues are too weak to trust.
Their build draws its guide from edges, which stay true when light fails. A mixed frame that joins local filters with broad focus blocks works at more than one scale at once. The guide steers each stage of the brightening. Photo and camera teams gain shots that hold their shape when light is scarce.
Catalog record
| CREATOR | Wei Dong *, Yan Min *, Han Zhou †, Jun Chen, * Equal Contribution, † Corresponding Author |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-14075
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Scale-Aware Low-Light Enhancement via Structure-Guided Transformer Design Wei Dong *, Yan Min *, Han Zhou †, Jun Chen, * Equal Contribution, † Corresponding Author Abstract Current Low-light Image Enhancement (LLIE) techniques predominantly rely on either direct Low-Light (LL) to Normal-Light (NL) mappings or guidance from semantic features or illumination maps. Nonetheless, the intrinsic ill-posedness of LLIE and the difficulty in retrieving robust semantics from heavily corrupted images hinder their effectiveness in extremely low-light environments. To tackle this challenge, we present SG-LLIE , a new multi-scale CNN-Transformer hybrid framework guided by structure priors. Different from employing pre-trained models for the extraction of semantics or illumination maps, we choose to extract robust structure priors based on illumination-invariant edge detectors. Moreover, we develop a CNN-Transformer Hybrid Structure-Guided Feature Extractor (HSGFE) module at each scale with in the UNet encoder-decoder architecture. Besides the CNN blocks which excels in multi-scale feature extraction and fusion, we introduce a Structure-Guided Transformer Block (SGTB) in each HSGFE that incorporates structural priors to modulate the enhancement process. Extensive experiments show that our method achieves state-of-the-art performance on several LLIE benchmarks in both quantitative metrics and visual quality. Our solution ranks second in the NTIRE 2025 Low-Light Enhancement Challenge. Code is released at https://github.com/minyan8/imagine . Figure 1 : Our enhanced results on NTIRE 2025 Low Light Enhancement Challenge . Our method secures the best PSNR , achieves the second-best overall performance, and effectively enhance low light inputs without over-exposed artifacts. 1 Introduction Low Light Image Enhancement (LLIE) is an important task in computer vision. Normally captured images in dark environments often suffer from poor visibility, low contrast, and significant noise due to limited lighting conditions. These issues not only lead to the degradation of image qualities, but also hinder the performance of high-level vision tasks such as object segmentation, recognition, and tracking [ 13 , 27 , 59 ] . Therefore, extensive research has been conducted to enhance low-light images and make them appear as if captured under better lighting conditions. Most popular traditional methods for LLIE can be categorized into two types. One is histogram equalization-based methods [ 1 , 31 ] , which adopt a straightforward strategy to perform gray-level remapping to enhance images with low visibility and contrast. However, these methods tends to introduce artifacts into the enhanced outputs. For example, in certain regions with uniform pixel values, the remapping process may produce excessively high or low pixel intensities, resulting in undesirably extremely bright or dark areas. Retinex-based approaches [ 19 , 56 , 25 , 50 , 37 ] represent another popular class of traditional methods for LLIE. According to Retinex theory [ 35 ] , a color image can be decomposed into two components: reflectance and illumination. Thus, the estimated illumination is essentially utilized as a physical prior to guide the enhancement process of the reflectance component. However, this strategy assumes that the reflectance is noise-free, which is not realistic in practical scenarios. Moreover, inaccurate illumination priors can lead to visual distortions and color inconsistencies. Figure 2 : The enhancement results of Retinexformer [ 6 ] (pre-trained on LOL-v2-real dataset [ 63 ] ) for real-world data. Recently, many deep learning models [ 26 , 23 , 8 , 10 , 61 , 60 , 6 , 72 ] based on Convolutional Neural Network (CNN) and Transformers have been introduced for LLIE. However, end-to-end CNN methods often come with limited transparency and lacks solid theoretical backing, which can occasionally lead to unexpected or inconsistent results. While Transformer-based models excel at modeling non-local dependencies, directly applying Transformers [ 18 ] to LLIE does not necessarily yield satisfactory results. Therefore, dedicated architectural designs are essential. To this end, Retinexformer [ 6 ] proposes to introduce the illumination prior into Transformers to guide the reflectance enhancement process and ultimately produce impressive well-lit images, which demonstrates the significant potential of employing physical priors in deep learning models. However, we observe that the illumination prior utilized in Retinexformer is also learned from low light inputs via a lightweight neural network and there are no ground truth of illumination component to supervise such learning. Therefore, Retinexformer often struggles to generalize well in real-world scenarios and tends to produce unnatural color intensity and contrast, as presented in Fig. 2 , which motivates us to explore and integrate other more robust physical priors into deep learning models for LLIE. In this paper, we propose SG-LLIE , a scale-aware CNN-Transformer framework for LLIE with the G uidance of S tructure priors. Overall, our method follows a UNet encoder–decoder architecture, and we develop the Hybrid Structure-Guided Feature Extractor (HSGFE) module at each level. Within each HSGFE module, we first employ illumination-invariant edge detectors [ 21 ] to extract stable structure priors, and then we introduce the Structure-Guided Transformer Block (SGTB) to incorporate structural priors into the restoration process. Besides, the CNN-based Dilated Residual Dense Block (DRDB) and Semantic-Aligned Scale-Aware Module (SAM) proposed in [ 65 ] are employed for multi-scale feature fusion. To summarize, we highlight three key contributions of this work: • We introduce SG-LLIE , a multi-scale CNN-Transformer hybrid framework guided by structure priors. • We first extract robust structure priors from low light images and then integrate these priors into our customized Transformer via structure-guided cross-attention, providing more effective guidance for LLIE. • Our model shows solid performance in both quantitative metrics and visual results, taking the lead in the NTIRE 2025 Low-Light Image Enhancement Challenge and staying competitive with other top solutions. 2 Related Work Figure 3 : The overall framework of SG-LLIE . We develop our method based on ESDNet [ 65 ] and adopt a similar UNet architecture. At each level of the encoder and decoder, our customized Hybrid Structure-Guided Feature Extractor (HSGFE) module is employed. Within each HSGFE, besides the Dilated Residual Dense Block (DRDB) and Semantic-Aligned Scale-Aware Module (SAM) proposed in ESDNet [ 65 ] , we first extract structure priors based on color-invariant edge detectors [ 36 ] and then develop the Structure-Guided Transformer Block (SGTB) to integrate these priors as guidance. With the integration of structure priors and our designed CNN-Transformer hybrid network, our method effectively improve the visibility and contrast with good noise suppression for diverse low light images. Methods in LLIE Histogram Equalization (HE) [ 1 , 31 ] and gamma correction [ 28 , 51 ] are widely used in traditional techniques. These methods perform well under relatively uniform lighting conditions. However, their effectiveness often degrades in real-world scenarios, where illumination in LL images is typically dynamic and diverse. CNN-based models [ 26 , 23 , 8 , 10 , 61 , 70 , 3 ] has fundamentally altered the paradigm of image restoration and enhancement. LLNet [ 46 ] is the first to propose an autoencoder network, which enhances LL images without oversaturating the bright regions. Retinex theory are also widely applied in the deep learning-based methods. Yang et al. [ 64 ] introduces SGM-Net to combine priors and data-driven learning for LLIE, and effectively suppresses noise and improve contrast. However, due to the limitations of CNNs, these methods struggle to capture non-local information in images. Transformers in Image Restoration Vision Transformers (ViTs) [ 18 ] are widely adopted in