MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
Yovin Yahathugoda, Davide Prezzi, Piyalitt Ittichaiwong, Vicky Goh, Sebastien Ourselin, Michela Antonelli · 2025
Read MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation by Yovin Yahathugoda, Davide Prezzi, Piyalitt Ittichaiwong, Vicky Goh, Sebastien Ourselin, Michela Antonelli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-17529.txt.
Introduction
Men with low or medium risk prostate cancer can often choose active surveillance, regular checks instead of immediate treatment, but tracking the gland across many scans is slow manual work. Yovin Yahathugoda and six co-authors build a system that outlines the prostate and its zones in each new MRI scan by leaning on the previous scan and its outline. Expert labels for these repeated scans are scarce, which limits ordinary training.
Their network, MambaX-Net, merges the new scan with the earlier outline through a cross attention module built for long range patterns, and a shape module that encodes the gland anatomy. A self training step uses outlines guessed by an existing tool, avoiding the need for expert labels. On a surveillance data set, it beat leading U-Net and transformer models.
Catalog record
| CREATOR | Yovin Yahathugoda, Davide Prezzi, Piyalitt Ittichaiwong, Vicky Goh, Sebastien Ourselin, Michela Antonelli |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-17529
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation Yovin Yahathugoda, Davide Prezzi, Piyalitt Ittichaiwong, Vicky Goh, Sebastien Ourselin, Michela Antonelli Abstract Active Surveillance (AS) is a treatment option for managing low and intermediate-risk prostate cancer (PCa), aiming to avoid overtreatment while monitoring disease progression through serial MRI and clinical follow-up. Accurate prostate segmentation is an important preliminary step for automating this process, enabling automated detection and diagnosis of PCa. However, existing deep-learning segmentation models are often trained on single-time-point and expertly annotated datasets, making them unsuitable for longitudinal AS analysis, where multiple time points and a scarcity of expert labels hinder their effective fine-tuning. To address these challenges, we propose MambaX-Net, a novel semi-supervised, dual-scan 3D segmentation architecture that computes the segmentation for time point t by leveraging the MRI and the corresponding segmentation mask from the previous time point. We introduce two new components: (i) a Mamba-enhanced Cross-Attention Module, which integrates the Mamba block into cross attention to efficiently capture temporal evolution and long-range spatial dependencies, and (ii) a Shape Extractor Module that encodes the previous segmentation mask into a latent anatomical representation for refined zone delination. Moreover, we introduce a semi-supervised self-training strategy that leverages pseudo-labels generated from a pre-trained nnU-Net, enabling effective learning without expert annotations. MambaX-Net was evaluated on a longitudinal AS dataset, and results showed that it significantly outperforms state-of-the-art U-Net and Transformer-based models, achieving superior prostate zone segmentation even when trained on limited and noisy data. K eywords Active Surveillance \cdot Deep Learning \cdot Prostate Cancer \cdot Prostate MRI \cdot Segmentation 1 Introduction Prostate cancer (PCa) is one of the most prevalent cancers among men in Western countries [ 1 ] . The majority of patients diagnosed with PCa present with low-intermediate-risk disease (International Society of Urological Pathology, ISUP grade 1 and 2), localised to the prostate [ 2 ] . Active surveillance (AS) is a treatment option for low-intermediate-risk PCa, which limits unnecessary treatments and their adverse effects [ 3 ] while monitoring disease progression. Current AS protocols require regular clinical examinations, serum prostate-specific antigen (PSA) testing, repeated Magnetic Resonance Imaging (MRI) and biopsy to confirm progression [ 2 ] . Although MRI has emerged as an important non-invasive tool for selecting and monitoring patients in AS [ 4 ] , its interpretation requires substantial expertise and remains time-intensive, particularly for complex AS cases [ 5 ] , making Artificial Intelligence (AI) a promising approach to automate and streamline prostate MRI analysis, improving diagnostic efficiency [ 6 ] . A critical pre-requisite for AI-driven prostate MRI analysis is accurate segmentation of the whole prostate (WP) as well as its sub-regions, particularly the peripheral (PZ) and transition (TZ) zones, with the different zones having distinct pathogenetic features of PCa [ 7 ] . Accurate WP segmentation is essential for estimating prostate volume, a key requirement for calculating PSA density (PSAd), which helps distinguish elevated PSA caused by PCa from benign prostatic hyperplasia [ 5 ] , while PZ and TZ segmentations are crucial priors for automated lesion detection [ 8 ] . Prostate zone segmentation approaches typically are based on either Convolutional Neural Networks (CNNs) or Transformers. While the CNN-based nnU-Net [ 9 ] remains state-of-the-art (SOTA) and a powerful baseline [ 10 , 11 ] , Transformer-based models such as SwinUNETR [ 12 ] are increasingly explored for their ability to capture long-range global context. Yet, Transformers often struggle to preserve fine-grained details and typically require large training datasets to surpass CNNs [ 13 ] . Yan et al. [ 13 ] reported that their hybrid CNN-ViT model, CCT-UNet, outperformed U-Net and SwinUNETR, though its Transformer backbone relied on a large training dataset. Huang et al. [ 14 ] showed that the U-Net was superior to a ViT in learning effectively from a small labelled dataset under semi-supervised settings. The findings suggest that while attention mechanisms may enhance CNNs, simple integration is insufficient; for example, a Global–Local Channel and Spatial Attention-enhanced U-Net [ 15 ] was outperformed by our standard nnU-Net baseline on the ProstateX dataset, suggesting that more advanced approaches are required to improve upon highly-optimised architectures. These results underscore the need for novel architectures that can overcome the limitations of both CNNs and Transformers. Recently, the Mamba architecture [ 16 ] has gained popularity in medical imaging. Unlike Transformers that rely on a computationally intensive self-attention mechanism scaling quadratically with sequence length, Mamba scales linearly, offering significant advantages over Transformers, especially for 3D modalities like MRI. At its core, Mamba blocks use a selection mechanism that makes its parameters input-dependent to allow content-based reasoning. This allows the model to dynamically decide which information to keep and which to forget, effectively compressing relevant context into a fixed-size state and capturing long-range spatial dependencies. The selection mechanism in Mamba is enhanced by a hardware-aware algorithm that uses the parallel scan to run the recurrent computation in parallel on GPUs, combining the efficiency of recurrent models with the content-aware reasoning of Transformers. Recent works have integrated Mamba into hybrid architectures, including SegMamba [ 17 ] , MUNet [ 18 ] , and MambaBTS [ 19 ] , which combine the powerful local feature extraction of CNNs with Mamba’s efficient global context modelling, leading to superior performance in medical image segmentation. While Mamba-based architectures have achieved competitive performance in 3D segmentation tasks, they, like other SOTA prostate segmentation models, are exclusively designed for single-timepoint data [ 20 ] , and have not been extended to longitudinal analysis, which is crucial in the context of AS. Single-timepoint models are inherently limited for longitudinal monitoring as they treat each scan in isolation, failing to leverage the rich temporal information available across patients’ imaging history and to capture the underlying anatomical changes. In other domains, such as brain imaging, SOTA longitudinal segmentation approaches typically rely on registering scans across different time points [ 21 , 22 ] . However, these methods are often unreliable, as they are prone to registration errors, especially for prostate segmentation, where substantial non-rigid deformation over time makes registration challenging. In our prior work, we introduced the Dual-Scan Model (DSM) [ 23 ] , which was the first attempt to incorporate longitudinal information for prostate MRI segmentation by jointly processing two subsequent time points. However, DSM relied on pure cross-attention combined with SimAM blocks [ 24 ] , which is effective for local spatial suppression but cannot effectively capture long-range dependencies, and often produces irregular segmentations at the prostate apex. In addition to architectural design, model performance also depends on the availability of expertly annotated datasets, which are particularly limited in AS due to the time-consuming task of labelling multiple time-points per patient [ 25 , 26 ] . Pre-training on public datasets followed by fine-tuning on the target domain dataset is a promising strategy [ 27 , 28 , 29 ] , but fine-tuning on the target domain dataset is still dependent on the availability of expert annotations, which can be scarce for longitudinal datasets. To address both the lack of longitudinal modelling and the scarcity of expert-annotated longitudinal data, we introduce MambaX-Net, a novel 3D segmentation model designed specifically for longitudinal data, together with a self-training framework that leverages pseudo-labels to