W-DUALMINE: Reliability-Weighted Dual-Expert Fusion With Residual Correlation Preservation for Medical Image Fusion
Md. Jahidul Islam · 2026
Read W-DUALMINE: Reliability-Weighted Dual-Expert Fusion With Residual Correlation Preservation for Medical Image Fusion by Md. Jahidul Islam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08920.txt.
Introduction
Md. Jahidul Islam builds a tool to merge health scans of more than one type into one clear view. One scan may show bones well. The next may show soft tissue well. A merged view can guide a doctor more than each scan on its own. Past merge tools trade off: they keep broad match high, but lose fine local form.
His tool is called W-DUALMINE. It uses two expert paths, one for each type of scan fact. Each path is weighed by how much trust its input earns. The merge also keeps the link stats of the source scans safe. A reader in health scans gets a merge plan that aims for both broad truth and fine form.
Catalog record
| CREATOR | Md. Jahidul Islam |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-08920
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
W-DUALMINE: Reliability-Weighted Dual-Expert Fusion With Residual Correlation Preservation for Medical Image Fusion Md. Jahidul Islam Abstract Medical image fusion integrates complementary information from multiple imaging modalities to improve clinical interpretation. However, existing deep learning–based methods, including recent spatial-frequency frameworks such as AdaFuse 3 and ASFE-Fusion 4 , often suffer from a fundamental trade-off between global statistical similarity—measured by correlation coefficient (CC) and mutual information (MI)—and local structural fidelity. This paper proposes W-DUALMINE , a reliability-weighted dual-expert fusion framework designed to explicitly resolve this trade-off through architectural constraints and a theoretically grounded loss design. The proposed method introduces dense reliability maps for adaptive modality weighting, a dual-expert fusion strategy combining a global-context spatial expert and a wavelet-domain frequency expert, and a soft gradient-based arbitration mechanism. Furthermore, we employ a residual-to-average fusion paradigm that guarantees the preservation of global correlation while enhancing local details. Extensive experiments on CT-MRI, PET-MRI, and SPECT-MRI datasets demonstrate that W-DUALMINE consistently outperforms AdaFuse and ASFE-Fusion in CC and MI metrics while maintaining competitive entropy, PSNR, and feature mutual information. 1 Introduction Multi-modal medical imaging is indispensable in modern clinical diagnosis, surgical navigation, and radiotherapy planning. Different imaging modalities offer complementary information: structural modalities, such as Computed Tomography (CT) and Magnetic Resonance Imaging (MRI), provide high-resolution anatomical details of bones and soft tissues, respectively. In contrast, functional modalities, such as Positron Emission Tomography (PET) and Single-Photon Emission Computed Tomography (SPECT), visualize metabolic and physiological activities but often lack spatial resolution 7 , 1 . Medical image fusion aims to integrate these complementary characteristics into a single, comprehensive image, enabling physicians to make more accurate decisions without mentally aligning multiple scans. Traditionally, image fusion methods relied on multi-scale transforms (MST), including Laplacian pyramids 1 and discrete wavelet transforms (DWT) 7 . These methods decompose source images into different frequency bands and fuse them using handcrafted rules (e.g., max-selection). While MST-based approaches are computationally efficient and explainable, their reliance on fixed basis functions and manual fusion rules limits their adaptability to complex intensity variations and often introduces noise or artifacts. In recent years, deep learning has revolutionized image fusion by automatically learning feature representations. Early Convolutional Neural Network (CNN) approaches, such as DenseFuse 8 and IFCNN 13 , utilized auto-encoder architectures to extract deep features and reconstruct fused images. More advanced frameworks, such as U2Fusion 11 , introduced unsupervised learning to mitigate the lack of ground truth. However, these methods primarily focus on pixel-level reconstruction losses or perceptual similarity, which can inadvertently lead to contrast reduction and a loss of global statistical consistency with the source images. To address detail preservation, recent state-of-the-art methods like AdaFuse 3 and ASFE-Fusion 4 have introduced spatial-frequency decomposition mechanisms. By employing specialized "experts" or attention modules for different frequency bands, these methods significantly enhance local texture details. However, a fundamental trade-off remains: while these methods excel at sharpening edges (high-frequency), they often struggle to maintain the global intensity distribution and linear correlation (low-frequency) of the source modalities. This results in fused images that look sharp but have lower Mutual Information (MI) and Correlation Coefficient (CC), potentially distorting the original clinical signal intensities. To resolve this trade-off, W-DUALMINE , a reliability-weighted dual-expert fusion framework is proposed. Unlike previous approaches, W-DUALMINE embeds correlation preservation directly into the architecture via a residual-to-average fusion paradigm. By treating the fusion task as learning the residual details to add to a statistically stable average base, our method theoretically guarantees high global correlation while using a dual-branch expert system (Spatial and Wavelet) to capture fine-grained details. The main contributions of this work are summarized as follows: 1. A Reliability-Weighted Fusion Strategy is proposed that introduces dense reliability maps to adaptively suppress artifacts and noise from unreliable source regions before fusion occurs. 2. A Dual-Expert Architecture is designed that combines a Global Context Spatial Expert for semantic consistency and a Wavelet Frequency Expert for high-frequency edge preservation. 3. A Soft Gradient Mixer (SGM) is introduced, a dynamic arbitration mechanism that weighs the contribution of spatial and frequency experts based on local edge strength. 4. A Residual-to-Average Fusion Paradigm is implemented supported by a theoretically grounded loss function, which ensures the fused image maintains maximum Mutual Information (MI) and Correlation Coefficient (CC) with source inputs, surpassing state-of-the-art methods. 2 Related Work 2.1 Classical Multi-Scale Image Fusion Early approaches to medical image fusion were predominantly based on Multi-Scale Transforms (MST). Pioneering methods such as the Laplacian Pyramid 1 and Discrete Wavelet Transform (DWT) 7 decompose source images into low-frequency (base) and high-frequency (detail) sub-bands. Fusion is then performed using handcrafted rules, such as "choose-max" for high frequencies to preserve edges and "weighted-average" for low frequencies to maintain energy. While these methods offer mathematical interpretability and computational efficiency, they suffer from two critical limitations: (1) Poor adaptivity , as fixed basis functions cannot flexibly represent complex biomedical structures, and (2) Noise sensitivity , where simple max-selection rules often amplify background noise in low-contrast functional images. 2.2 Deep Learning-Based Fusion The advent of deep learning revolutionized fusion by introducing data-driven feature extraction. Convolutional Neural Networks (CNNs) have been widely adopted to learn fusion mappings automatically. 1. Auto-Encoder Frameworks: Methods like DenseFuse 8 and IFCNN 13 utilize pre-trained encoders to extract deep features and reconstruct the fused image. While effective at preserving structural information, these methods often rely on pixel-level reconstruction losses, which tend to smooth out high-frequency textures. 2. Unsupervised Models: Approaches such as U2Fusion 11 apply unsupervised learning to estimate fusion weights without ground truth. However, they frequently struggle with "modality bias," where the network over-fits to the modality with stronger gradients (usually CT/MRI). Common to most CNN-based methods is the neglect of global statistical consistency, often resulting in low Correlation Coefficient (CC) relative to source inputs. 2.3 Spatial-Frequency and Attention-Based Fusion Recent research has attempted to bridge the gap between MST and Deep Learning by incorporating frequency domain knowledge into neural networks. 1. AdaFuse 3 : This method introduces a spatial-frequential cross-attention mechanism to dynamically weigh features based on their frequency response. 2. ASFE-Fusion 4 : This framework employs distinct "experts" for spatial and frequency domains to handle anatomical and functional information separately. **It is important to note that both AdaFuse and ASFE-Fusion have demonstrated superior performance over all preceding state-of-the-art methods (including U2Fusion 11 , SDNet 12 , and IFCNN 13 ) across multiple clinical benchmarks.** However, despite their success, a fundamental trade-off remains: while they excel at sharpening local edges, the rigid separation of experts often leads to semantic inconsistency and a reduction in global Mutual Information (MI). The proposed W-DUALMINE addresses this specific gap by integrating a residual-to-average fusion paradigm that theoretically guarantees high correlation while leveraging dual experts for detail enhancement. 3 Proposed Method 3.1 Overview Given two pre-registered source images, denoted as I_{1}\in\mathbb{R}^{H\times W} and I_{2}\in\mathbb{R}^{H\times W} , the goal of W-DUALMINE is to generate a fused image I_{f} that preserves the salient structural details from both modalities while maintaining global statistical consistency. The framework consists of four key components: (1) Siamese Multi-Scale Encoders, (2) Reliability-Weighted Feature Modeling, (3) Dual-Expert Fusion (Spatial and Frequency), and (4) a Residual-to-Average Decoder. 3.2 Multi-Scale Encoders Each input image is processed by a weight-sharing encoder to extract hierarchical features. The encoder consists of