MAUP: Training-free Multi-center Adaptive Uncertainty-aware Prompting for Cross-domain Few-shot Medical Image Segmentation

Yazhou Zhu, Haofeng Zhang (🖂) · 2025

Read MAUP: Training-free Multi-center Adaptive Uncertainty-aware Prompting for Cross-domain Few-shot Medical Image Segmentation by Yazhou Zhu, Haofeng Zhang (🖂) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03511.txt.

Introduction

Yazhou Zhu and Haofeng Zhang adapt a large vision model to medical image segmentation with no extra training. Their 2025 paper tackles few-shot segmentation across domains, where labels are scarce and images come from new sources. Past models need heavy training on other medical sets, which hurts ease of use. Their method prompts the Segment Anything Model instead.

The prompting plan has three parts. Cluster-based prompts cover the image area broadly. An uncertainty step aims prompts at hard regions. A third step adjusts prompts to the target's complexity. A pre-trained feature encoder feeds the process. On three medical data sets, the training-free method matched or beat trained rivals. Code is shared in public for reuse.

Catalog record

CREATORYazhou Zhu, Haofeng Zhang (🖂)
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-03511

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MAUP: Training-free Multi-center Adaptive Uncertainty-aware Prompting for Cross-domain Few-shot Medical Image Segmentation Yazhou Zhu, Haofeng Zhang (🖂) Abstract Cross-domain Few-shot Medical Image Segmentation (CD-FSMIS) is a potential solution for segmenting medical images with limited annotation using knowledge from other domains. The significant performance of current CD-FSMIS models relies on the heavily training procedure over other source medical domains, which degrades the universality and ease of model deployment. With the development of large visual models of natural images, we propose a training-free CD-FSMIS model that introduces the Multi-center Adaptive Uncertainty-aware Prompting (MAUP) strategy for adapting the foundation model Segment Anything Model (SAM), which is trained with natural images, into the CD-FSMIS task. To be specific, MAUP consists of three key innovations: (1) K-means clustering based multi-center prompts generation for comprehensive spatial coverage, (2) uncertainty-aware prompts selection that focuses on the challenging regions, and (3) adaptive prompt optimization that can dynamically adjust according to the target region complexity. With the pre-trained DINOv2 feature encoder, MAUP achieves precise segmentation results across three medical datasets without any additional training compared with several conventional CD-FSMIS models and training-free FSMIS model. The source code is available at: https://github.com/YazhouZhu19/MAUP . 1 Introduction Medical Image Segmentation (MIS) has become a foundational technique in modern healthcare, disease diagnosis and treatment planning [ 2 , 27 ] . Traditional deep learning based MIS models fundamentally relay on the extensive annotated data which is both costly and time-consuming to acquire in medical imaging, especially in rare disease scans [ 25 , 17 ] . Besides, this problem is also compounded by the heterogeneity of medical scans, encompassing diverse modalities (e.g., MRI, CT and X-Ray) and anatomical structures, which leads to the hard of intra-class generalization in semantic segmentation [ 8 , 24 ] . Accordingly, Few-shot Medical Image Segmentation (FSMIS) is proposed to address these limitations, enhancing the model capability of segmenting with limited annotated images [ 30 , 20 , 26 ] . However, FSMIS still requires a large number of labeled samples in the same domain for model training [ 6 , 18 ] , even if the target class for testing differs, e.g., both training and testing must be performed on CT images. To solve this problem, some researchers have tried to implement model training using labeled samples from other medical domains and transfer them to the target medical domain [ 28 , 23 ] , e.g., training on CT and applying the model to MR images, which is called Cross-domain FSMIS (CD-FSMIS). Despite the effectiveness of these CD-FSMIS methods [ 3 , 4 , 19 ] , there are still two problems: (1) They require a large amount of precisely annotated images in the medical domains, which are also usually scarce and need to be annotated by professional doctors; (2) A lot of model training for each application is still necessary. Recently, the Segment Anything Model (SAM) [ 10 , 7 ] has created the possibilities for training-free segmentation model with appropriate prompting strategy [ 22 ] , yet its direct application to CD-FSMIS still faces several critical challenges: (1) Prompts (e.g., point prompts) need to capture the complete structure of complex medical objects; (2) Lack of boundary awareness leads to the segmentation ambiguity, especially in some low-contrast medical images, and (3) Traditional fixed prompting strategy always fails to adapt to varying anatomical complexities. In order to address these limitations, we introduce a novel training-free few-shot medical image segmentation model with M ulti-center A daptive U ncertainty-aware P rompting ( MAUP ) strategy for the SAM model. To be specific, the MAUP strategy employs the point prompts and it consists of four components: (1) A multi-center prompting strategy that employs K-means clustering on high-similarity regions to make sure the spatial diversity in point prompts, leading to the comprehensive coverage of complex anatomical structures; (2) Leveraging the morphology based periphery similarity maps to generate negative prompts, enhancing boundary delineation accuracy in low-contrast regions; (3) An uncertainty-aware prompt selection approach which identifies and focuses on challenging regions with analyzing variance value across similarity maps; and (4) An adaptive point prompts quantity determination method that dynamically adjusts the number of point prompts based on target complexity. Besides, MAUP employs the DINOv2 [ 14 ] as the feature encoder in few-shot segmentation algorithm, enabling the both of discriminative and generalizable capability of core features without requirement of model training. And the synergy of proposed four components make MAUP effectively handle diverse medical imaging scenarios while maintaining the high segmentation accuracy. Our method achieves the precise segmentation results in three medical image datasets including the abdominal datasets Abd-MRI [ 9 ] and Abd-CT [ 11 ] , and the cardiac dataset Card-MRI [ 31 ] . In conclusion, the key contributions of our model can be summarized as follows: (1) We introduce a training-free model which addresses the limitations of existing cross-domain few-shot medical image segmentation approaches via designed innovative prompting strategy. (2) We propose a prompting strategy MAUP which considers the spatial diversity, boundary awareness, uncertainty guidance and adaptive point prompts quantity adjustment for enhancing the segmentation accuracy. (3) The proposed model achieves state-of-the-art performance on three medical imaging datasets widely used in research. Figure 1: Overview of our proposed training-free CD-FSMIS model MAUP . 2 Methodology 2.1 Overall Architecture The proposed MAUP strategy introduces a training-free approach for CD-FSMIS via leveraging the foundational model Segment Anything Model (SAM). Given the query image \mathbf{I}_{q} and a selected support image \mathbf{I}_{s} with corresponding support mask \mathbf{M}_{s} , our goal is to segment the target organs in \mathbf{I}_{q} without any model training. The procedure begins with extracting discriminative features \mathbf{F}_{s} and \mathbf{F}_{q} from both query image \mathbf{I}_{q} and support image \mathbf{I}_{s} using the pre-trained DINOv2 encoder. These features are then employed to calculate similarity maps that guide the prompting strategy MAUP, which can dynamically create the optimal point prompts for SAM model. As illustrated in Fig. 1 , our method consists of three main steps: (1) feature extraction and similarity computation, (2) MAUP prompting strategy, and (3) final mask prediction. 2.2 Feature Extraction and Similarity Map Computation We employ the frozen DINOv2 encoder [ 14 ] which is pre-trained as feature extractor to obtain discriminative representations from both support and query images considering its robust and generalizable extraction capability. For each image, the features are first extracted through: \mathbf{F}_{s}=\operatorname{E}(\mathbf{I}_{s}),\mathbf{F}_{q}=\operatorname{E}(\mathbf{I}_{q}) , where \operatorname{E}(\cdot) denotes the DINOv2 encoder. As shown in Fig. 2 , for subsequent multi-center positive prompting strategy, we employ the Region Prototype Generation (RPG) module used in RPT [ 29 ] to calculate multiple regional prototypes through the subdivisions in the foreground of the support image. Specifically, given a support image \mathbf{I}_{s} and corresponding foreground mask \mathbf{M}_{s} , the foreground region of this image is obtained with calculating their production. Then, the Voronoi-based partition method [ 1 ] is employed to divide foreground into N_{f} regions and forms a set of regional masks \left\{\mathbf{V}_{n}\right\}^{N_{f}}_{n=1} , where N_{f} is set as 30 according to the experiments. After that, a set of regional prototypes \hat{\mathcal{P}}_{s}=\left\{\hat{\mathbf{p}}_{n}\right\}^{N_{f}}_{n=1},\hat{\mathbf{p}}_{n}\in\mathbb{R}^{1\times C} are generated with use of Masked Average Pooling (MAP). Formally, \hat{\mathbf{p}}_{n}=\operatorname{MAP}(\mathbf{F}_{s},\mathbf{V}_{n})=\frac{1}{\left|\mathbf{V}_{n}\right|}\sum_{i=1}^{HW}\mathbf{F}_{s,i}\mathbf{V}_{n,i}, (1) where \mathbf{F}_{s}\in\mathbb{R}^{C\times H\times W} denotes the support feature extracted by DINOv2 encoder. With these regional prototypes,

Read the complete text