EPOFusion: Exposure-aware Progressive Optimization Method for Infrared and Visible Image Fusion

Zhiwei Wang, Yayu Zheng, Defeng He, Li Zhao, Xiaoqin Zhang, Yuxing Li, Edmund Y. Lam · 2026

Read EPOFusion: Exposure-aware Progressive Optimization Method for Infrared and Visible Image Fusion by Zhiwei Wang, Yayu Zheng, Defeng He, Li Zhao, Xiaoqin Zhang, Yuxing Li, Edmund Y. Lam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16130.txt.

Introduction

Wang and co-authors fuse infrared and visible images with glare in mind. Daylight and headlight glare wash out visible camera detail. Their EPOFusion frame spots regions that need infrared rescue. A spatial guide module marks the overexposed zones. A region-aware loss then strengthens true infrared structure there. An iterative head refines features across many scales. Normal zones keep their visible look through the fusion. A new IVOE dataset trains and tests the method. Scores beat the glare-focused baseline by 10.7 percent on QAB/F.

Catalog record

CREATORZhiwei Wang, Yayu Zheng, Defeng He, Li Zhao, Xiaoqin Zhang, Yuxing Li, Edmund Y. Lam
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54318
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.16130

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EPOFusion: Exposure-aware Progressive Optimization Method for Infrared and Visible Image Fusion Zhiwei Wang, Yayu Zheng, Defeng He, Li Zhao, Xiaoqin Zhang, Yuxing Li, Edmund Y. Lam Abstract Overexposure frequently occurs in practical scenarios, causing the loss of critical visual information. However, existing infrared and visible fusion methods still exhibit unsatisfactory performance in highly bright regions. To address this, we propose EPOFusion, an exposure-aware fusion model. Specifically, a guidance module is introduced to facilitate the encoder in extracting fine-grained infrared features from overexposed regions. Meanwhile, an iterative decoder incorporating a multi-scale context fusion module is designed to progressively enhance the fused image, ensuring consistent details and superior visual quality. Finally, an adaptive loss function dynamically constrains the fusion process, enabling an effective balance between the modalities under varying exposure conditions. To achieve better exposure awareness, we construct the first infrared–visible overexposure (IVOE) dataset with high quality infrared guided annotations for overexposed regions. Extensive experiments show that EPOFusion outperforms existing methods. It maintains infrared cues in overexposed regions while achieving visually faithful fusion in non-overexposed areas, thereby enhancing both visual fidelity and downstream task performance. Code, fusion results and IVOE dataset will be made available at https://github.com/warren-wzw/EPOFusion.git . I Introduction Infrared and visible Image fusion plays a key role in applications such as intelligent surveillance [ 16 , 7 ] and autonomous driving [ 30 , 15 ] . In scenarios with normal illumination, visible images provide rich textural details that complement the thermal targets in infrared images. However, realistic environments frequently present severe overexposure challenges, such as strong daylight or intense glare during night driving. Overexposure introduces specific obstacles that render standard fusion paradigms ineffective. Specifically, visible sensors suffer from pixel saturation, where high-intensity regions contain no valid gradients or texture [ 34 ] . Existing approaches often lack robustness when handling high-exposure regions. Certain methods tend to be dominated by saturated visible intensity, resulting in the complete loss of thermal details. Conversely, some methods designed to maximize the preservation of infrared information often inadvertently amplify sensor noise, thus degrading image clarity. Therefore, effective fusion of visible and infrared images while preserving critical infrared information under extreme exposure conditions remains a significant challenge. In general, existing infrared and visible image fusion methods can be categorized into three groups based on the source of fusion objectives: generative prior-based [ 20 , 13 ] , downstream task-driven methods [ 14 , 15 ] and handcrafted loss-guided [ 34 , 2 ] . Generative prior-based methods are typically represented by Generative Adversarial Networks (GAN) [ 3 ] based approaches, which use adversarial training between a generator and a discriminator [ 20 , 13 ] . This adversarial mechanism enables the model to implicitly learn the probability distribution of the source images, generating fused results with natural visual characteristics. To better exploit semantic information, task-driven methods jointly optimize fusion and high-level vision tasks, enabling semantic features to be effectively incorporated into the fusion process [ 14 , 15 , 36 ] . Handcrafted loss-guided methods constrain the network optimization process via carefully designed loss functions, thereby achieving an overall fusion of infrared and visible information. Their main advantage lies in their simplicity and computational efficiency [ 38 , 23 ] . Fig. 1: (I) Generative prior-based framework. (II) Downstream task-guided approache. (III–IV) Handcrafted loss-guided strategies: (III) texture-dominated optimization and (IV) intensity-dominated optimization. Existing approaches struggle to effectively handle high-exposure regions. As shown in Fig. 1 , generative prior-based approaches often introduce background noise and global degradation, as their generators prioritize global fidelity over semantic constraints. Conversely, although task-driven methods preserve salient structures, they often fail to distinguish informative features, and thus introduce redundant infrared information, thereby degrading visual quality. Similarly, handcrafted loss-based methods fail to reveal details in high-exposure regions, as fixed loss functions cannot effectively capture the semantic complementarity between modalities. Consequently, achieving robust fusion under extreme lighting remains a significant challenge. To address this, we propose EPOFusion, a fusion framework that utilizes iterative strategies to achieve progressive optimization. It uses a guidance module to steer the model attention toward infrared information in overexposed regions, thereby markedly recovering thermal details in these challenging areas. Inspired by the stepwise optimization in DDPM [ 5 ] , an iterative fusion module is designed based on the denoising diffusion mechanism, enabling features to progressively reinforce critical information over multiple iterations. Furthermore, we constructed an adaptive fusion loss to dynamically guide the model in optimizing the overall fusion results, effectively preserving infrared details in high-exposure regions. Considering that existing public datasets contain few overexposed samples and lack corresponding annotations, we constructed a synthetic overexposure dataset, termed IVOE. Furthermore, we utilized the Segment Anything Model (SAM) [ 9 ] to assist in annotation, and selected image pairs from existing datasets for real-world evaluation. As shown in Fig. 1 , the fusion results of our method clearly preserve the structure of the roof and maintain the intensity of the color, the sky appearing to be free of infrared noise. In addition, in night scenes, vehicle in overexposed areas remain clearly visible. The main contributions are summarized as follows: • We propose EPOFusion, a region-guided, exposure-aware iterative framework that excels at preserving infrared details in overexposed regions. • We designed a multi-scale context fusion module and an adaptive dynamic loss function that work together to guide the model toward detailed targets and enhance its robustness under extreme lighting conditions. • We constructed the IVOE dataset with precise annotations of the details in the overexposed regions. Additionally, we also curated a test set of real-world overexposed pairs. • Extensive experiments show that our model outperforms existing methods, producing clearer details in high-exposure regions and significantly enhancing the accuracy of downstream segmentation and detection tasks. The remainder of this paper is organized as follows: Section II overviews the related work. Section III analyzes fusion challenges under overexposure and presents EPOFusion and the IVOE dataset. Section IV shows the experimental results and analysis, demonstrating the advantages of our method. Section V concludes the paper. II Related Works II-A Gnerative prior-based Image Fusion Generative prior-based image fusion methods leverage the powerful distribution modeling capabilities of deep generative models to reconstruct high-quality fused images. Existing methods in this category are broadly categorized into GAN-based [ 20 , 19 , 21 ] and Denoising Diffusion Probabilistic Model (DDPM)-based [ 32 , 39 , 11 ] . Generative adversarial framework have been widely adopted for image fusion due to their strong capability to generate high-quality and realistic images [ 3 ] . FusionGAN [ 20 ] pioneered the approach by formulating fusion as a generator–adversarial discriminator problem. Subsequent works like GANMcC [ 21 ] enhanced visual fidelity by employing multi-class estimation and incorporating fidelity losses [ 19 ] to optimize fusion outcomes. Unlike GAN, which suffers from training instability and mode collapse, DDPM [ 5 ] achieves stable target distribution convergence through a multi-step iterative process. Dif-Fusion [ 32 ] first introduced diffusion model, generating high-color-fidelity, three-channel fused images by constructing the multi-channel input distribution in a latent space. DDFM [ 39 ] regards fusion as a conditional generation task, decomposing it into unconditional generation and likelihood rectification based on a hierarchical Bayesian model to achieve high-quality fusion

Read the complete text