MambaVesselNet++: A Hybrid CNN-Mamba Architecture for Medical Image Segmentation DOI: XXXXXXX.XXXXXXX Journal: JACM Volume: 37 4 111 8 CCS: Computing methodologies Image segmentation

Qing Xu, Yanming Chen, Yue Li, Ziyu Liu, Zhenye Lou, Yixuan Zhang, Huizhong Zheng, Xiangjian He · 2025

Read MambaVesselNet++: A Hybrid CNN-Mamba Architecture for Medical Image Segmentation DOI: XXXXXXX.XXXXXXX Journal: JACM Volume: 37 4 111 8 CCS: Computing methodologies Image segmentation by Qing Xu, Yanming Chen, Yue Li, Ziyu Liu, Zhenye Lou, Yixuan Zhang, Huizhong Zheng, Xiangjian He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-19931.txt.

Introduction

Qing Xu and co-authors outline vessels in medical scans with a hybrid network that marries two architectures, in a 2025 paper. Classic U-shaped networks see only local detail, while transformers grasp the whole image at heavy computing cost. Their design, MambaVesselNet++, pairs convolutions for texture with a state-space model called Mamba that tracks long-range links at linear cost.

A two-focus decoder then merges local and global streams to draw the final masks. Across two-dimensional, three-dimensional, and instance-level tasks, the system beat convolution, transformer, and Mamba rivals, the authors report. They present it as a practical step for computer-aided diagnosis where fine vessels decide the answer.

Catalog record

CREATORQing Xu, Yanming Chen, Yue Li, Ziyu Liu, Zhenye Lou, Yixuan Zhang, Huizhong Zheng, Xiangjian He
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-19931

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MambaVesselNet++: A Hybrid CNN-Mamba Architecture for Medical Image Segmentation DOI: XXXXXXX.XXXXXXX Journal: JACM Volume: 37 4 111 8 CCS: Computing methodologies Image segmentation Qing Xu, Yanming Chen, Yue Li, Ziyu Liu, Zhenye Lou, Yixuan Zhang, Huizhong Zheng, Xiangjian He Abstract . Medical image segmentation plays an important role in computer-aided diagnosis. Traditional convolution-based U-shape segmentation architectures are usually limited by the local receptive field. Existing vision transformers have been widely applied to diverse medical segmentation frameworks due to their superior capabilities of capturing global contexts. Despite the advantage, the real-world application of vision transformers is challenged by their non-linear self-attention mechanism, requiring huge computational costs. To address this issue, the selective state space model (SSM) Mamba has gained recognition for its adeptness in modeling long-range dependencies in sequential data, particularly noted for its efficient memory costs. In this paper, we propose MambaVesselNet++, a Hybrid CNN-Mamba framework for medical image segmentation. Our MambaVesselNet++ is comprised of a hybrid image encoder (Hi-Encoder) and a bifocal fusion decoder (BF-Decoder). In Hi-Encoder, we first devise the texture-aware layer to capture low-level semantic features by leveraging convolutions. Then, we utilize Mamba to effectively model long-range dependencies with linear complexity. The Bi-Decoder adopts skip connections to combine local and global information of the Hi-Encoder for the accurate generation of segmentation masks. Extensive experiments demonstrate that MambaVesselNet++ outperforms current convolution-based, transformer-based, and Mamba-based state-of-the-arts across diverse medical 2D, 3D, and instance segmentation tasks. The code is available at https://github.com/CC0117/MambaVesselNet . 1. Introduction In the field of digital healthcare, medical image segmentation stands as a cornerstone for delineating disease regions, grading diseases, and planning treatment ( Azad et al. 2024 ; Chen et al. 2025 ) . Despite its significance, this poses substantial difficulties across different imaging modalities, e.g., the complex 3D nature of the vascular structures, discrete nuclei distribution, and low-contrast tumor region boundaries. Traditionally, such segmentation tasks are heavily relied on by medical experts, leading to time-consuming and labor-intensive procedures ( Chen et al. 2021a ; Chen et al. 2022b ) . In this challenging background, automatic segmentation methods are expected to accelerate evaluation time and improve diagnostic efficiency. In the field of deep learning, convolutional neural network (CNN), especially those with U-shape encoder-decoder structures ( Huang et al. 2020 ; Xiao et al. 2020 ; Isensee et al. 2021 ; Xu and Duan 2021 ) , have set new benchmarks in various segmentation tasks. In the classic U-Net ( Ronneberger et al. 2015 ) architecture, the encoder is used to capture global context by progressively reducing the feature dimensions, while the decoder then enlarges these features back to the original input size for precise pixel or voxel-level segmentation. While CNN-based models ( Ibtehaz and Kihara 2023 ; Li et al. 2024b ; Xu et al. 2023 ) excel in representation learning, their ability to capture whole-volume context is constrained by their localized receptive fields due to the limited kernel size ( Hu et al. 2019 ) . Moreover, CNN-based approaches face significant computational inefficiency when processing high-resolution 3D medical volumes, as the convolution operations scale poorly with increasing spatial dimensions. Additionally, these models struggle to model long-range spatial dependencies that are crucial for understanding complex anatomical structures, particularly in scenarios where pathological regions may be spatially distant but functionally related. The inherent limitation in capturing global context that spans across different anatomical regions further restricts their effectiveness in comprehensive medical image analysis. As shown in Fig. 1 , CNN-based methods can only extract the feature maps from limited receptive fields, but due to the special topology structure of a human cerebrovascular structure, some global dependencies between vessels may be ignored. Figure 1. Illustration of local features versus global dependencies in medical vessel segmentation. Blue boxes highlight local feature regions that capture fine-grained vessel details, which are essential for precise boundary delineation. Yellow dots and connecting arrows illustrate long-range spatial relationships between distant vessel segments, enabling the model to understand vessel continuity and overall vascular topology across the entire image. This figure demonstrates the complementary roles of local feature extraction and global dependency modeling using a representative MRA brain scan. Vision transformer (ViT) ( Dosovitskiy et al. 2020 ) , with its self-attention mechanism for global information extraction, gains attention in the realm of 3D medical imaging because of its ability to model long-range dependencies and grasp the global context. Specifically, transformers represent images through a sequence of 1D patch embeddings and mechanisms to learn the relationships among tokens. This enables modeling effective long-range dependencies. Many studies ( Chen et al. 2024b ; Lin et al. 2022 ; Cao et al. 2022 ; Chen et al. 2024c ; Li et al. 2024a ) have demonstrated its superior performance in diverse medical image segmentation tasks. However, the quadratic complexity of non-linear Softmax function in the self-attention mechanism is not efficient in long-sequence imaging computations. Beyond computational complexity, transformer-based approaches face several critical limitations in medical image segmentation. The patch-based tokenization process inherently loses fine-grained spatial details that are essential for precise boundary delineation in medical structures. Furthermore, transformers struggle with multi-scale feature representation, which is particularly challenging when dealing with medical images that contain structures of vastly different sizes, from fine capillaries to major vessels. The substantial memory requirements of transformer models when processing high-resolution 3D medical volumes often necessitate aggressive downsampling or patch-wise processing, potentially compromising the model’s ability to maintain spatial coherence across the entire volume. For example, the typically high-resolution 3D volumes produced by the magnetic resonance angiography (MRA) scans result in lengthy 1D sequences, imposing significant computational demands. To address the limitations of the self-attention mechanism while retaining the advantages of long-sequence modeling, the selective state space model Mamba ( Gu and Dao 2023 ) has been proposed to effectively model long-range dependencies with linear complexity through a novel selection mechanism that enhances the training and inference efficiency. In the field of computer vision, existing pure SSM-based frameworks ( Ma et al. 2024a ; Ruan and Xiang 2024 ; Liu et al. 2024b ; Xing et al. 2024 ; Wang et al. 2024 ) have revealed significant potential for medical image segmentation and demonstrated lower computation costs compared to ViT-based models ( Chen et al. 2024b ; He et al. 2023 ; Chen et al. 2021b ; Lou et al. 2025 ; Xu et al. 2025a ) . While beneficial, they are difficult to capture local texture information, resulting in performance degradation of segmenting small targets. Therefore, the ideal Mamba-based architectures in medical image segmentation should be able to extract and handle local and global contexts simultaneously. In our ACM MM Asia 2024 conference paper ( Chen et al. 2024a ) , we propose a Hybrid CNN-Mamba architecture that first utilizes Mamba for segmenting 3D cerebrovascular structures, called MambaVesselNet. It contains the hybrid image encoder (Hi-Encoder) that leverages texture-aware layers and vision Mamba blocks to capture low-level semantic features and effectively model long-range dependencies with linear complexity, respectively. After that, MambaVesselNet utilizes the bifocal fusion decoder (BF-Decoder) to comprehensively fuse low-level local texture information and global features by applying skip connection structures for precise segmentation decoding. The main contributions of MambaVesselNet are summarized as follows. • We propose MambaVesselNet which explores the integration

Read the complete text