TSCnet: A Text-driven Semantic-level Controllable Framework for Customized Low-Light Image Enhancement
Miao Zhang a*, Jun Yin a*, Pengyu Zeng a, Yiqing Shen b, Shuai Lu a †, Xueqian Wang a · 2025
Read TSCnet: A Text-driven Semantic-level Controllable Framework for Customized Low-Light Image Enhancement by Miao Zhang a*, Jun Yin a*, Pengyu Zeng a, Yiqing Shen b, Shuai Lu a †, Xueqian Wang a (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08168.txt.
Introduction
Miao Zhang and co-authors present a 2025 framework that brightens dark photos under the control of plain text prompts. Most tools map a dark photo to one fixed bright version. That leaves no room for personal taste in how bright each part should be. Their system reads a prompt with a large language model to find the objects named. A reasoning step then marks those objects in the image. A control module sets how much brighter each marked part should get.
A final step blends the changes into a natural-looking result using a diffusion model. Tests on standard data sets showed better visibility and color balance than rivals. Fine detail rose without the fake marks that such tools can leave. The system also handled open-world scenes beyond its training set. The authors frame text control as the way to make photo repair personal.
Catalog record
| CREATOR | Miao Zhang a*, Jun Yin a*, Pengyu Zeng a, Yiqing Shen b, Shuai Lu a †, Xueqian Wang a |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-08168
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TSCnet: A Text-driven Semantic-level Controllable Framework for Customized Low-Light Image Enhancement Miao Zhang a*, Jun Yin a*, Pengyu Zeng a, Yiqing Shen b, Shuai Lu a †, Xueqian Wang a Abstract Deep learning-based image enhancement methods show significant advantages in reducing noise and improving visibility in low-light conditions. These methods are typically based on one-to-one mapping, where the model learns a direct transformation from low light to specific enhanced images. Therefore, these methods are inflexible as they do not allow highly personalized mapping, even though an individual’s lighting preferences are inherently personalized. To overcome these limitations, we propose a new light enhancement task and a new framework that provides customized lighting control through prompt-driven, semantic-level, and quantitative brightness adjustments. The framework begins by leveraging a Large Language Model (LLM) to understand natural language prompts, enabling it to identify target objects for brightness adjustments. To localize these target objects, the Retinex-based Reasoning Segment (RRS) module generates precise target localization masks using reflection images. Subsequently, the Text-based Brightness Controllable (TBC) module adjusts brightness levels based on the generated illumination map. Finally, an Adaptive Contextual Compensation (ACC) module integrates multi-modal inputs and controls a conditional diffusion model to adjust the lighting, ensuring seamless and precise enhancements accurately. Experimental results on benchmark datasets demonstrate our framework’s superior performance at increasing visibility, maintaining natural color balance, and amplifying fine details without creating artifacts. Furthermore, its robust generalization capabilities enable complex semantic-level lighting adjustments in diverse open-world environments through natural language interactions. Project page is https://miaorain.github.io/lowlight09.github.io/ 1 Introduction Many real-world applications require the use of low-light image enhancement (LLIE), including surveillance, traffic monitoring, and driving at night. The LLIE is capable of producing clear images even in dim lighting conditions, allowing users to identify potential hazards as well as important information more easily [ 1 ] . As illustrated in Figure 1 , low-light images can be enhanced in two ways: global-level enhancement and regional-level enhancement, which can also be referred to as task a and task b, respectively. Figure 1: An overview of low-light enhancement tasks. The figure below illustrates three levels of low-light image enhancement tasks: (a) Global-level Enhancement, which involves uniform brightness adjustment across the entire image; (b) Regional-level enhancement, which includes selective enhancement of certain portions of an image, such as the background or the object of interest; (c) Text-driven Semantic Enhancement, in which natural language prompts are used to adjust the brightness of targeted regions or the entire image, guided by semantic understandings. Researchers have proposed various methods for global-level enhancement, including curve adjustment and histogram leveling, to optimize pixel distribution and produce sharper, more highlighted images [ 2 , 3 ] . The problem with these methods is that they fail to capture the inherent pattern of pixel values, which causes color distortion and loss of detail in enhanced images. With the development of deep learning (DL), a significant amount of DL models have been proposed and adapted to [ 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 ] . Based on the Retinex theory, Li et al. [ 12 ] presented LightenNet, a convolutional neural network designed to enhance low-light images. However, it is noted that LightenNet, may amplify noise in real scenes. Additionally, gamma correction is an effective technique to enhance pixel intensity in dark areas and adjust contrast in low-light images [ 13 ] . Although the DL as mentioned above methods can enhance brightness, they mainly focus on global brightness adjustments. Nonetheless, when lighting conditions are complex and light requirements vary from person to person, a greater degree of regional lighting adjustment is necessary. To achieve regional-level enhancement, previous research started to incorporate semantic information into low-light enhancement tasks [ 14 , 15 ] . For the first time, ReCoRo [ 14 ] investigates this scenario by incorporating domain-specific augmentations into an enhancement model. While their enhancements are specifically designed for portrait images, their refinement may be required to accommodate masks of other image types. In addition, a conditional diffusion model is used by Yin /textit[et al.] [ 15 ] to enhance the brightness of specific regions of an image to any desired level through iterative refinement. Generally, global-level light enhancement methods employ a one-to-one mapping approach, limiting their flexibility for fine-tuning based on individual preferences. Nevertheless, regional-level light enhancement algorithms can adjust brightness at the semantic level, but this control still heavily depends on manually annotated masks [ 14 , 15 ] , limiting both flexibility and scalability. Moreover, people tend to prefer using natural language over manual clicking for light control. Therefore, we propose a new text-driven semantic-level light enhancement task, referred to as the c task in Figure 1 , with the primary objective of enabling semantic-level, quantitative brightness adjustments through natural language control, allowing users to "Adjust the Light as You Say" . The primary contributions of this work are outlined as follows. 1. We first propose an new task, the Text-driven Semantic-level Light Enhancement task. Subsequently, we introduce a novel method, TSCnet, which utilizes a large language model to decompose language instructions into two distinct tasks: target localization and brightness enhancement.In order to accomplish this objective, we propose two modules. First, the Retinex-based Reasoning Segment (RRS) module generates mask images without manual annotation. Second, Text-based Brightness Controllable (TBC) module introduces illumination images to guide local lighting adjustments, ensuring the consistency of locally. 2. In order to integrate lighting information seamlessly with target objects, we also introduce the Adaptive Contextual Compensation (ACC) Module, which employs cross-attention mechanisms and channel adaptation to integrate lighting information seamlessly with target objects. Furthermore, ACC improves overall enhancement processes by efficiently coordinating additional data. 3. Comprehensive experiments were conducted on several benchmark datasets to demonstrate our method’s superiority over existing state-of-the-arts. We showed our method’s generalization capability and ability to perform personalized lighting adjustments using natural language. Additionally, to confirm the effectiveness of our proposed architecture, we performed an ablation study. 2 Related Work Deep learning techniques used for Low-Light Image Enhancement (LLIE) can be primarily divided into two categories: global-level enhancement [ 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 ] and regional-level enhancement [ 14 , 15 , 24 ] . 2.1 Global-level Low-light image enhancement In the realm of global-level enhancement, a number of architectures have emerged within LLIE which are specifically designed for low-light environments, such as noise reduction and detail preservation. For instance, in the DMPH-Net architecture [ 16 ] , a multi-scale pyramid structure is integrated with attention mechanisms to enhance low-light images while simultaneously minimizing noise. In particular, EnlightenGAN [ 25 ] and LEGAN [ 26 ] stand out as models that utilize generative adversarial networks (GANs) to map low-light images to their improved versions. Due to their ability to handle typical low-light artifacts and noise, these architectures have shown exceptional performance in enhancing image quality. Furthermore, by incorporating targeted loss functions and innovative training methodologies, the performance of LLIE models has been improved. As an example, [ 21 ] introduced a deep learning technique inspired by the Retinex theory that improves images by learning how to map illumination onto itself, while integrating a superresolution process