Frequency-Decomposed INR for NIR-Assisted Low-Light RGB Image Denoising
Ligen Shi, Zengyu Pang, Chang Liu, Shuchen Sun, Jun Qiu · 2026
Read Frequency-Decomposed INR for NIR-Assisted Low-Light RGB Image Denoising by Ligen Shi, Zengyu Pang, Chang Liu, Shuchen Sun, Jun Qiu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16800.txt.
Introduction
Shi and colleagues propose FD-INR, a NIR-aided method fixing low-light images via hidden neural representation. Low-frequency RGB signals prove more steady while NIR signals match more strongly. A dual-branch framework uses RGB to guide luminance and color, and NIR data to constrain texture details. A doubt-based weighting loss evens tone tasks, avoiding distortion and flaws from rigid spatial fusion. Experiments show FD-INR fixes brightness match and beats existing methods at any-size rebuild.
Catalog record
| CREATOR | Ligen Shi, Zengyu Pang, Chang Liu, Shuchen Sun, Jun Qiu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34248 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.16800
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Frequency-Decomposed INR for NIR-Assisted Low-Light RGB Image Denoising Ligen Shi, Zengyu Pang, Chang Liu, Shuchen Sun, Jun Qiu Abstract Addressing the issues of severe noise and high-frequency structural degradation in visible images under low-light conditions, this paper proposes a Near-Infrared (NIR) aided low-light image restoration method based on Frequency-Decoupled Implicit Neural Representation (FD-INR). Based on the statistical prior of RGB-NIR cross-modal frequency correlations — specifically that low-frequency RGB signals are more reliable, whereas high-frequency NIR signals exhibit higher correlation — we explicitly decompose images into distinct frequency components via multi-scale wavelet transforms and construct a dual-branch implicit neural representation framework. Within this framework, we design a cross-modal differentiated frequency supervision mechanism, leveraging low-light RGB to guide the reconstruction of low-frequency luminance and color, and utilizing high-SNR NIR signals to constrain the generation of high-frequency texture details, thereby achieving complementary advantages in the frequency domain. Furthermore, an uncertainty-based adaptive weighting loss function is introduced to automatically balance the contributions of different frequency tasks, solving the problems of color distortion and artifacts caused by rigid fusion in the spatial domain common in traditional methods. Experimental results demonstrate that FD-INR not only effectively restores image luminance consistency and structural details but also, benefitting from its implicit continuous representation, outperforms existing methods in arbitrary-resolution reconstruction tasks, significantly enhancing the reliability of low-light perception. 1 Introduction With the rapid advancement of Unmanned Aerial Vehicle (UAV) technology, autonomous perception in all-weather environments has become a focal point in both academia and industry. However, UAVs often encounter severe lighting challenges when operating at dawn, dusk, in forest shadows, or at night. Due to strict constraints on payload weight and power consumption, these platforms typically use small-scale imaging sensors, resulting in insufficient photon counts under low-light conditions ( 35 ; 20 ; 3 ) . Consequently, captured RGB images are heavily degraded by quantum and electronic noise, which masks high-frequency textures and causes color bias and contrast degradation. This decline in low-level visual quality weakens the robustness of UAVs in downstream tasks such as scene understanding, object detection, and 3D reconstruction ( 41 ; 19 ) . To overcome the physical limits of single-modal visible light sensors, Near-Infrared (NIR) assisted imaging has emerged as a promising solution ( 40 ; 32 ; 33 ) . Due to its longer wavelength, NIR signals exhibit higher penetration and quantum efficiency in low light, providing structural representations with superior signal-to-noise ratios (SNR). However, cross-modal fusion between RGB and NIR is challenging due to physical inconsistencies in their imaging mechanisms. First, varying material reflectances across spectral bands lead to distinct spatial luminance distributions (e.g., vegetation vs. fabric). Second, RGB images exhibit frequency-selective degradation in low light: while low-frequency components (global contours) remain relatively reliable, high-frequency components (local textures) are often dominated by noise. Existing research primarily involves single-modal enhancement (e.g., Retinex-based methods or deep CNNs), which often faces a trade-off between noise suppression and detail preservation, frequently resulting in over-smoothing or artifacts ( 34 ; 43 ) . Current multi-modal fusion strategies generally follow two directions. The first category performs direct fusion in the spatial domain ( 21 ; 39 ; 29 ) . These methods rely on neural network fitting but often neglect inconsistent spatial dependencies and non-linear luminance differences between modalities ( 23 ) , leading to color shifts and artifacts. The second category employs decomposition or attention mechanisms to enhance shared features while suppressing inconsistent ones ( 40 ; 14 ; denger2020deep ) . While this reduces interference, it often discards modality-specific information—such as high-frequency NIR textures or unique RGB color data—yielding suboptimal results. Furthermore, most existing spatial or decomposition methods rely on discrete, grid-based representations and lack quantitative modeling of frequency reliability. This discrete sampling limits the model’s ability to adaptively handle varying noise levels and constrains fine-grained representation at continuous resolutions. To address these limitations, we propose FD-INR, an Implicit Neural Representation framework based on explicit frequency decomposition for RGB-NIR collaborative reconstruction. Unlike previous discrete modeling approaches, we represent the image field as an implicit continuous function, providing a coordinate-aware unified feature space. Our approach is motivated by the observation of cross-field frequency correlations: RGB low-frequencies correlate strongly with the ground truth, while NIR high-frequencies characterize scene structures more accurately than noise-polluted RGB. Based on this prior, we utilize Discrete Wavelet Transform (DWT) to construct a dual-branch implicit learning mechanism: 1. Low-frequency Consistency Branch : Uses the low-light RGB image as the primary supervision to ensure the reconstructed image maintains natural color and global luminance. 2. High-frequency Structure Enhancement Branch : Extracts reliable gradient information from the NIR image to compensate for and reconstruct the RGB high-frequency details masked by noise. Additionally, to adaptively balance the contributions of different frequency components under varying noise levels, we introduce a weighted loss function based on uncertainty learning. By modeling homoscedastic uncertainty as learnable parameters, FD-INR dynamically adjusts the weights of each frequency branch during training. We further employ the Muon optimizer to improve the convergence efficiency of the INR in high-dimensional coordinate mapping, maximizing detail recovery while maintaining color fidelity. The primary contributions of this work are as follows: • We propose FD-INR, an implicit neural representation method based on wavelet decoupling. This method integrates the physical prior of ”RGB-constrained low frequencies and NIR-enhanced high frequencies” into a continuous function space. Through explicit frequency partitioning, it addresses modal conflict and feature aliasing inherent in traditional spatial fusion, enabling high-quality RGB-NIR reconstruction at arbitrary resolutions. • We design an adaptive weight allocation mechanism based on homoscedastic uncertainty and incorporate an orthogonal optimizer (Muon) to enhance the learning efficiency of the continuous representation, achieving a balance between color preservation and detail restoration. • Extensive experiments demonstrate that FD-INR achieves state-of-the-art (SOTA) performance on multiple low-light benchmarks and exhibits strong generalization in real-world extreme low-light scenarios, significantly improving the robustness of downstream tasks such as object detection. 2 Related Work This section reviews related research from three perspectives. First, we discuss single-modal low-light enhancement and its limitations in high-frequency restoration. Second, we analyze NIR-assisted enhancement methods and the challenges posed by modal inconsistency. Finally, we summarize progress in Implicit Neural Representations (INR) and articulate how our proposed frequency decoupling and continuous representation address the bottlenecks of existing fusion methods. 2.1 Low-Light Image Restoration Early low-light enhancement research primarily followed the physics-driven Retinex Theory ( 17 ; 16 ) , which achieves brightness enhancement by modeling illumination and reflectance. Representative works include multi-scale Retinex (MSR) ( 13 ) and the optimization-constrained LIME ( 8 ) . However, these methods often struggle to distinguish noise amplified by high gains from genuine reflective details when processing images with extremely low signal-to-noise ratios (SNR). With the rise of deep learning, data-driven methods have become dominant. Early works such as LLNet ( 22 ) demonstrated the potential of autoencoders in denoising, while See-in-the-Dark (SID) ( 3 ) bypassed the limitations of traditional ISPs by directly processing RAW data. To reduce reliance on paired data, Zero-DCE ( 7 ) and EnlightenGAN ( 11 ) introduced unsupervised curve mapping and adversarial generative networks, respectively. Subsequently, researchers explored complex architectures, such as Transformer-based Restormer ( 42 ) and multi-scale diffusion models ( 10 ) , to improve restoration quality in