MHMamba: Multi-Head Mamba for 3D Brain Tumor Segmentation

Hanjun Tao, Hua Wang, Fan Zhang · 2026

Read MHMamba: Multi-Head Mamba for 3D Brain Tumor Segmentation by Hanjun Tao, Hua Wang, Fan Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16464.txt.

Introduction

Tao, Wang, and Zhang propose Multi-Head Mamba, a U-shaped state-space model for 3D brain tumor segmentation. Brain tumors vary greatly in shape and multimodal contrast, making manual slice-by-slice drawing slow. The method splits the channel axis into state-space heads joined with skip links, improving long-range representation and multimodal training stability at linear complexity. A channel-space calibration module aligns statistics and boosts lesion response, while adaptive fusion at skip connections links global semantics to local details, improving boundary consistency.

Catalog record

CREATORHanjun Tao, Hua Wang, Fan Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35109
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16464

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MHMamba: Multi-Head Mamba for 3D Brain Tumor Segmentation Hanjun Tao, Hua Wang, Fan Zhang Abstract Brain tumors exhibit high heterogeneity in morphology and multimodal contrast, making manual slice-by-slice de lineation time-consuming and experience-dependent, thus necessitating efficient and stable automated segmentation methods. To address the limitations of CNNs in modeling long-range dependencies, and the heavy computational and memory overhead and inter-block contextual in coherence of Transformers in 3D MRI, this paper proposes Multi-Head Mamba (MHMamba). This method combines a U-shaped architecture with a multi-head state-space model (Mamba), splitting the channel dimension into parallel SSM heads and aggregating them with residuals. This enhances long-range representation and improves the stability of multimodal training while maintaining linear complexity. To further align statistics and enhance lesion response, we designed a channel-space calibration module for multi-head outputs and introduced an adaptive fusion mechanism at skip connections to dynamically connect global semantics with local details, thereby improving boundary consistency and the detection of small-volume lesions. We conducted experiments and ablations on BraTS2021 and BraTS2023. The results showed that MHMamba achieved stable and significant improvements in overall accuracy, boundary smoothness, and sensitivity to tumor core and small-volume enhancement areas, while preserving the linear-complexity advantage of Mamba-based modeling, thus verifying the effectiveness and versatility of the method. 1 Introduction Brain tumors, due to their inherent complexity and high variability among patients, are among the deadliest cancers 26 . They are typically classified as high-grade or low-grade, composed of different tumor subregions, including enhancing tumors, necrotic cores, and surrounding edema 23 . Magnetic resonance imaging (MRI) is the preferred clinical approach for diagnosing and analyzing brain tumors, and accurate automated segmentation is crucial for developing individualized treatment plans such as radiotherapy planning, preoperative assessment, and efficacy monitoring 19 . However, manually delineating each slice on MRI sequences is time-consuming, labor-intensive, and highly dependent on clinical experience and subjective thresholds, further highlighting the urgent need for efficient and accurate automated segmentation technology. In recent years, CNNs and Transformers have each had their advantages in medical image segmentation. CNNs rely on local inductive biases, providing strong boundary and texture modeling, but their expansion of the receptive field largely depends on layer stacking and downsampling, resulting in insufficient long-range dependence and a tendency to damage details in small lesions 29 . While Transformers can establish global relationships, they incur computational and memory costs that increase quadratically with the number of tokens (T), making them insufficient even at the {128^{3}} patch scale of 3D MRI and more difficult to generalize stably with small datasets 30 . To reduce complexity, windowing/block attention is a common method, but the fixed or semi-fixed interaction radius has limited adaptability to scale changes and deformations. The Trans-CNN hybrid paradigm attempts to strike a balance between efficiency and context capture 4 . However, it remains limited by multiple factors in multimodal 3D brain tumor scenarios. First, the inconsistent expression domains of convolution and attention in sampling mechanisms and normalization (BN/IN vs. LN) easily lead to feature statistical mismatch and weaken fusion stability. Second, increasing resolution and token number to balance details and context results in a significant increase in memory, bandwidth, and latency. Finally, the superposition of windowed attention and sliding window inference easily causes cross-window context incoherence and makes the predicted probability field unsmooth, thus weakening boundary consistency. Recently, state-space models (SSMs) have been used to model long sequences with linear complexity, offering both speed and scalability 9 . However, for 3D MRI with its varied morphology and significant modal differences, simple sequential SSMs often suffer from unstable training convergence, insufficient global-local representation capabilities, and inadequate information fusion at skip connections; these issues are particularly pronounced in the detailed characterization of ring enhancement, the boundary between necrosis and living tissue, and small-volume ectopic tumors (ETs). To overcome these challenges, this paper proposes MHMamba for brain tumor segmentation, combining a U-shaped structure with the Mamba algorithm to model global features of the entire volume at different scales. To enhance long-range dependency modeling capabilities while maintaining linear complexity and improving training stability and adaptability under multimodal conditions, a multi-head Mamba module is designed. Subsequently, a Channel Spatial Calibration (CSCA) module is further designed to reweight the output in terms of channel and spatial dimensions, unifying feature scales and highlighting lesion-related features, thus making the multi-head Mamba output more stable and usable. Furthermore, an Adaptive Gated Fusion (AGF) module is designed at skip connections to dynamically fuse multi-scale features through a learnable adaptive fusion mechanism, balancing details and semantics, and improving boundary consistency and small lesion recognition rate. Systematic experiments and ablation tests were conducted on BraTS2021 2 and BraTS2023 14 . The results show that the proposed MHMamba significantly improves overall segmentation accuracy, boundary consistency, and sensitivity to small lesions while maintaining high efficiency, validating the effectiveness and versatility of the method. The contributions of this paper are as follows: • This paper proposes a multi-head Mamba for 3D MRI of brain tumors. It decomposes channels into parallel SSM heads and aggregates them using residuals, enhancing long-range modeling capabilities while maintaining linear complexity, improving training stability under multimodal conditions, and better adapting to multimodal information. • To improve the long-range dependency modeling capability and output stability of the multi-head Mamba, this paper introduces a channel space calibration module and an adaptive gated fusion module. The CSCA module calibrates the channel-space of the multi-head Mamba to align feature statistics and scale, while the AGF module adaptively fuses multi-scale features at skip connections to better connect global semantics and local details. • Experimental results on the BraTS2021 and BraTS2023 brain tumor segmentation tasks show that MHMamba achieves stable improvements in overall segmentation accuracy, boundary consistency, and sensitivity to small lesion detection, especially in tumor core region and boundary prediction, exhibiting higher robustness and accuracy. 2 Related works Brain tumor segmentation methods based on CNN. In the field of medical image segmentation, FCN 46 transforms the classification network into a structure that can output segmentation maps, providing a starting point for end-to-end training; U-Net 29 first proposed a symmetrical encoder-decoder U-shaped structure and compensated for the information loss caused by downsampling through skip connections, and quickly became the basic framework for medical segmentation. In response to the special needs of brain tumor tasks, V-Net 24 first introduced three-dimensional convolution into medical image segmentation, utilizing the spatial continuity of volume data and stabilizing training through residual connections; 3D U-Net 28 fully utilizes the spatial continuity between slices on this basis and has been widely used in brain tumor segmentation tasks. In order to enhance the spatial consistency of brain tumor segmentation, DenseCRF 8 is used as a post-processing method in the inference stage to apply boundary constraints, making the segmentation results more consistent with anatomical features; Attention U-Net 25 introduces attention gating on the decoding side to alleviate the confusion between organ and tumor boundaries. Although these improvements have boosted CNN performance, they still fail to overcome the limitation of local receptive fields in modeling long-range spatial dependencies, and continuous down-sampling weakens edge and detail information. Even with auto-dynamic convolution and location-aware attention 31 , the effective receptive field remains essentially restricted by local convolution operations. Figure 1 : (a) shows the overall structure of

Read the complete text