IAF-Net: Illumination-Adaptive Fusion for Low-Light Urban Road Segmentation

Bingtao Wang, Daojie Peng, Fulong Ma, Jun Ma, Liang Zhang · 2026

Read IAF-Net: Illumination-Adaptive Fusion for Low-Light Urban Road Segmentation by Bingtao Wang, Daojie Peng, Fulong Ma, Jun Ma, Liang Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30939.txt.

Introduction

Wang and colleagues improve night road segmentation for self-driving cars, when standard methods fade badly. Many fusion methods let weak night camera features bleed into the fused view, ignoring how light changes sensor trust. Their IAF-Net adjusts camera and geometric fusion weights with illumination, and adds a brightness-tuned decoder to pick low-light features. They build two new test sets, night driving scenes and simulated varied weather, and report state-of-the-art night results.

Catalog record

CREATORBingtao Wang, Daojie Peng, Fulong Ma, Jun Ma, Liang Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29964
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30939

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

IAF-Net: Illumination-Adaptive Fusion for Low-Light Urban Road Segmentation Bingtao Wang, Daojie Peng, Fulong Ma, Jun Ma, Liang Zhang Abstract Semantic road segmentation is important for autonomous driving, but existing methods suffer severe performance degradation under low-light conditions. Many existing multi-modal fusion methods do not explicitly adapt to illumination-dependent changes in modality reliability, which can propagate degraded RGB features into the fused representation at night. We propose IAF-Net (Illumination-Adaptive Fusion Network), an end-to-end framework with illumination-adaptive fusion for robust road segmentation across different lighting conditions. It dynamically adjusts fusion weights of RGB and geometric features via the core Illumination-Adaptive Fusion (IAF) module, and enhances low-light feature selection with a brightness-modulated attention decoder. We also construct two dedicated datasets: nuScenes Nighttime Road Segmentation (nuScenes-NRS) and CARLA Multi-Weather Road Segmentation (CARLA-MWRS). Experiments on nuScenes-NRS show state-of-the-art overall performance among the compared methods, while CARLA-MWRS further validates robustness across adverse weather conditions. Ablation studies on a 40% training subset further highlight the importance of the IAF module, which provides the largest individual gain of 0.70% in MaxF. Fig. 1: Overall architecture of the proposed IAF-Net. The network takes RGB images and depth maps as inputs, and processes them through four core modules: LLEM for low-light enhancement and brightness estimation, R-SNE for robust surface normal feature extraction, IAF for illumination-adaptive multi-scale feature fusion, and NAA for nighttime-aware attention decoding. An auxiliary EdgeHead is adopted to enhance boundary prediction. I Introduction Robust perception under diverse illumination and weather conditions is a key requirement for autonomous driving systems. As a core component of the autonomous driving perception system, semantic road segmentation aims to identify the drivable free space from the scene, providing essential information for path planning, obstacle avoidance, and vehicle control. Current research on road segmentation spans single-modal methods [ 25 , 20 ] , multi-modal fusion approaches [ 7 , 5 , 21 , 24 ] , and recent extensions to self-supervised label generation [ 18 ] . However, existing methods still suffer severe performance degradation under low-light and nighttime conditions. The key limitation is not the absence of nighttime perception studies, but the insufficient modeling of illumination-dependent modality reliability in RGB-normal road segmentation, despite the well-documented difficulty of low-light visual perception [ 9 ] . This limitation is related to the broader challenge of adverse-condition perception, where nighttime illumination, rain, and fog change the data distribution of segmentation models [ 36 ] . The main challenges of nighttime road segmentation stem from complex and dynamic illumination conditions. First, heterogeneous light sources, such as street lamps, vehicle headlights, building lights, and traffic signals, cause severe spatial variation of illumination. Second, low-light RGB images suffer from low brightness, reduced contrast, and sensor noise, which corrupt the texture and color features used by traditional segmentation methods [ 9 , 10 ] . Third, many existing multi-modal fusion methods do not explicitly account for illumination-dependent modality reliability [ 33 , 15 ] , which may propagate degraded RGB noise into the fused features at night. To address these challenges, we propose IAF-Net, an illumination-adaptive multi-modal fusion network designed specifically for robust low-light urban road segmentation. The key insight of our work is to use global brightness as a scene-level estimate of RGB reliability rather than as a complete description of local illumination. Local degradation is further handled by low-light enhancement and nighttime-aware attention decoding. Specifically, our network first estimates the global brightness of the scene while enhancing the low-light RGB image. Based on this brightness signal, the network dynamically adjusts the fusion weights of RGB texture features and illumination-invariant geometric features extracted from depth maps. In this way, the network can automatically rely more on geometric features in extremely dark scenes where RGB features are unreliable, and leverage more texture information in well-lit scenes where RGB features are informative. Our main contributions are summarized as follows: • We propose IAF-Net, an end-to-end framework for low-light road segmentation that integrates illumination awareness into the perception pipeline and adapts to varying lighting conditions. • We design the Illumination-Adaptive Fusion (IAF) module, which leverages the global brightness signal to dynamically adjust the fusion weights of multi-modal features, effectively suppressing noise propagation from degraded RGB features in nighttime scenes. • We propose the Nighttime-aware Attention Decoder (NAA), which introduces a brightness-modulated attention sharpening mechanism to enhance feature selection under low-light conditions, improving the discriminability of features in dark environments. • We construct two dedicated datasets for low-light road segmentation: nuScenes-NRS and CARLA-MWRS, covering real-world nighttime and synthetic multi-weather conditions. • Experiments on nuScenes-NRS show state-of-the-art overall performance among the compared methods, while CARLA-MWRS validates robustness across adverse weather conditions and ablation studies quantify the contribution of each module. II Related Works In this section, we review the literature from three perspectives that are most relevant to this work: road segmentation for autonomous driving, low-light and nighttime road scene understanding, and multi-modal fusion for road parsing. II-A Semantic Segmentation for Autonomous Driving Semantic segmentation has been extensively studied for autonomous driving. Representative CNN-based models, such as DeepLabv3+ [ 4 ] and PSPNet [ 35 ] , established strong baselines for scene parsing, while more recent architectures, including SegFormer [ 31 ] , PIDNet [ 32 ] , and DDRNet [ 23 ] , further improved the trade-off between accuracy and efficiency in driving scenes. These methods provide effective segmentation backbones, but they are largely developed and evaluated under well-lit conditions. When illumination becomes poor, the reliability of RGB appearance cues decreases substantially, which limits the robustness of conventional road parsing pipelines. II-B Low-Light and Nighttime Scene Understanding Low-light scene understanding has been studied from both image enhancement and direct nighttime perception perspectives. Classical enhancement methods, such as Retinex-based modeling [ 13 ] , and learning-based approaches, including KinD [ 34 ] , LLNet [ 17 ] , and Zero-DCE [ 10 ] , can improve image visibility in dark scenes. However, these methods are mainly optimized for restoration quality rather than segmentation-oriented feature reliability, and the enhanced appearance does not always translate into more stable road parsing. Beyond enhancement, recent studies have directly addressed nighttime semantic segmentation. Wei et al. [ 28 ] improved nighttime parsing through illumination disentanglement, while other methods explored thermal assistance, day-to-night adaptation, cross-domain distillation, and event-based sensing [ 26 , 14 ] . Representative examples include DANNet [ 29 ] , cross-domain correlation distillation [ 8 ] , CMDA [ 30 ] , and event-based road segmentation with asynchronous likelihood attention [ 1 ] . These studies confirm the difficulty of nighttime perception, but they either remain strongly coupled to appearance restoration or domain transfer in RGB space, or require additional sensing and adaptation pipelines. As a result, they do not directly address how the reliability of complementary modalities should be regulated as illumination changes. II-C Multi-Modal Fusion for Robust Perception Multi-modal fusion has become an effective direction for robust perception because complementary modalities can compensate for the weakness of RGB observations under adverse conditions. In general semantic segmentation, methods such as CMX [ 33 ] and CAFuser [ 2 ] show that cross-modal interaction and condition-aware fusion can improve robustness in RGB-X perception. For road segmentation, geometric cues have drawn increasing attention because surface normals derived from

Read the complete text