MAPLE: Multi-scale Attribute-enhanced Prompt Learning for Few-shot Whole Slide Image Classification

Junjie Zhou 1,2 , Wei Shao 1,2 , Yagao Yue 1,2 , Wei Mu 3 , Peng Wan 1,2 , Qi Zhu 1,2 , Daoqiang Zhang 1,2 1 The College of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics 2 The Key Laboratory of Brain-Machine Intelligence Technology, Ministry of Education 3 The School of · 2025

Read MAPLE: Multi-scale Attribute-enhanced Prompt Learning for Few-shot Whole Slide Image Classification by Junjie Zhou 1,2 , Wei Shao 1,2 , Yagao Yue 1,2 , Wei Mu 3 , Peng Wan 1,2 , Qi Zhu 1,2 , Daoqiang Zhang 1,2 1 The College of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics 2 The Key Laboratory of Brain-Machine Intelligence Technology, Ministry of Education 3 The School of (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-25863.txt.

Introduction

Junjie Zhou and co-authors teach vision-language models to read whole-slide pathology images from a few examples, in this 2025 paper. Standard prompt methods speak only at slide level, missing the small structures, nuclei and glands, that decide a diagnosis. Their MAPLE framework drafts prompts at two levels: entity prompts written by a language model for each structure type, and slide prompts for the whole picture.

An attention module builds entity features and matches them to their described traits, while a graph step lets entities inform each other across scales. Entity and slide verdicts merge for the final call. Three cancer cohorts confirmed the gains.

Catalog record

CREATORJunjie Zhou 1,2 , Wei Shao 1,2 , Yagao Yue 1,2 , Wei Mu 3 , Peng Wan 1,2 , Qi Zhu 1,2 , Daoqiang Zhang 1,2 1 The College of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics 2 The Key Laboratory of Brain-Machine Intelligence Technology, Ministry of Education 3 The School of
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-25863

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MAPLE: Multi-scale Attribute-enhanced Prompt Learning for Few-shot Whole Slide Image Classification Junjie Zhou 1,2 , Wei Shao 1,2 , Yagao Yue 1,2 , Wei Mu 3 , Peng Wan 1,2 , Qi Zhu 1,2 , Daoqiang Zhang 1,2 1 The College of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics 2 The Key Laboratory of Brain-Machine Intelligence Technology, Ministry of Education 3 The School of Engneering Medicine, Beihang University [email protected], [email protected], [email protected] Abstract Prompt learning has emerged as a promising paradigm for adapting pre-trained vision-language models (VLMs) to few-shot whole slide image (WSI) classification by aligning visual features with textual representations, thereby reducing annotation cost and enhancing model generalization. Nevertheless, existing methods typically rely on slide-level prompts and fail to capture the subtype-specific phenotypic variations of histological entities ( e.g., nuclei, glands) that are critical for cancer diagnosis. To address this gap, we propose Multi-scale Attribute-enhanced Prompt Learning ( MAPLE ), a hierarchical framework for few-shot WSI classification that jointly integrates multi-scale visual semantics and performs prediction at both the entity and slide levels. Specifically, we first leverage large language models (LLMs) to generate entity-level prompts that can help identify multi-scale histological entities and their phenotypic attributes, as well as slide-level prompts to capture global visual descriptions. Then, an entity-guided cross-attention module is proposed to generate entity-level features, followed by aligning with their corresponding subtype-specific attributes for fine-grained entity-level prediction. To enrich entity representations, we further develop a cross-scale entity graph learning module that can update these representations by capturing their semantic correlations within and across scales. The refined representations are then aggregated into a slide-level representation and aligned with the corresponding prompts for slide-level prediction. Finally, we combine both entity-level and slide-level outputs to produce the final prediction results. Results on three cancer cohorts confirm the effectiveness of our approach in addressing few-shot pathology diagnosis tasks. Codes will be available at https://github.com/JJ-ZHOU-Code/MAPLE . 1 Introduction Whole slide images (WSIs) have become the clinical gold standard for cancer diagnosis, offering gigapixel-resolution views of tissue architecture and cellular morphology [ 5 , 6 ] . However, their huge size ( e.g., 150,000 \times 150,000 pixels) and hierarchical structure render dense annotation of individual patches impractical. To overcome this challenge, multiple instance learning (MIL) has emerged as an effective way for weakly supervised WSI analysis [ 18 , 32 , 23 , 39 , 9 ] , where each WSI is divided into thousands of patches, encoded via a pre-trained feature extractor, and aggregated into a slide-level representation for classification [ 17 ] . Beyond weak supervision, WSI classification faces another critical challenge: the scarcity of the labeled images [ 26 , 31 ] . This limitation stems from factors such as privacy constraints, the difficulty of acquiring expert-labeled slides, and the low prevalence of certain cancer subtypes [ 12 , 37 , 16 , 36 ] . Consequently, few-shot learning has become an attractive paradigm for developing robust classifiers on limited labeled data. Figure 1 : Comparison of MAPLE with existing slide-level alignment methods for the classification of lung adenocarcinoma (LUAD) and lung squamous cell carcinoma (LUSC). (a) Existing methods align slide-level features with corresponding prompts for classification. (b) Our proposed MAPLE introduces additional entity-level features and incorporates subtype-specific phenotypic attributes for more interpretable and precise alignment. For simplicity, only the single-scale data stream of MAPLE is visualized. Recent progress in vision–language models (VLMs), such as CLIP [ 30 ] , offers a promising path for few-shot learning by aligning image and text representations in a shared embedding space. Building upon VLMs, prompt learning techniques [ 44 , 43 , 25 , 21 , 4 ] adapt textual inputs using a small number of labeled examples, enabling effective transfer to new tasks without fine-tuning the vision backbone. However, applying these methods for WSI classification remains non-trivial. Unlike natural images, WSIs are extremely large and are typically divided into thousands of instances, making it difficult to construct a unified visual representation suitable for prompt alignment [ 29 , 10 ] . At the same time, designing prompts that accurately reflect the complex tissue morphology and subtype-specific patterns within a WSI is also challenging. Simple prompts like “a WSI of [CLASS]” often fail to capture the localized, fine-grained attributes that are crucial for cancer diagnosis [ 34 ] . These limitations highlight a central question: how can we bridge the gap between fine-grained instance-level visual details and semantically rich prompts for effective few-shot WSI classification? Recently, several methods have attempted to work on it. For instance, TOP [ 29 ] introduces instance-level phenotypic prompts to guide patch aggregation into slide-level features, while ViLa-MIL [ 34 ] leverages learnable visual prototypes to guide the fusion process of patch features and considers dual-scale visual descriptive text prompt to boost the performance. However, these approaches generally focus solely on slide-level feature alignment after the aggregation of instance-level representations, and fail to capture the subtype-specific phenotypic variations of histological entities ( e.g., nuclei, cytoplasm, glands) that are critical for cancer diagnosis. For instance, nucleoli are typically small and inconspicuous in lung adenocarcinoma (LUAD) but appear large and prominent in lung squamous cell carcinoma (LUSC). Furthermore, different resolution levels in WSIs naturally correspond to different scales of histological entities, where low magnification reveals tissue architecture and organization patterns, while high magnification exposes cellular details and nuclear morphology. Ignoring such fine-grained, multi-scale entity variations limits the model’s ability to capture discriminative patterns and reduces interpretability for cancer diagnosis. To this end, we propose Multi-scale Attribute-enhanced Prompt Learning ( MAPLE ), a hierarchical framework designed for few-shot WSI classification by the combination of entity-level and slide-level predictions. Different from the previous slide-level alignment methods [ 29 , 34 , 10 , 11 ] , MAPLE additionally considers that the diagnostic information among different cancer subtypes is also reflected by the phenotypic attributes of histological entities across different scales, as illustrated in Fig. 1 . Specifically, we begin by leveraging large language models (LLMs) to construct two types of prompts: entity-level prompts that identify multi-scale histological entities and their distinctive phenotypic characteristics, and slide-level prompts that capture comprehensive global visual patterns. After employing language-guided instance selection strategy to identify discriminative tumor-related patches from WSIs, we subsequently introduce an entity-guided cross-attention module to extract entity-level features, which are then aligned with their respective subtype-specific attributes to enable entity-level predictions. To enrich entity representations, we further develop a cross-scale entity graph learning module that can update these representations by capturing their semantic correlations within and across scales. The refined entity representations are aggregated to construct a slide-level representation, which is then aligned with the corresponding prompts to enable slide-level prediction. Finally, we combine both entity-level and slide-level outputs to produce the final prediction results. We conduct experiments on three cancer cohorts derived from the cancer genome atlas (TCGA), and the experimental results indicate the advantage of MAPLE on few-shot pathology diagnosis tasks. 2 Related Work 2.1 Multiple Instance Learning for WSI Classification Due to the gigapixel size of WSIs and the infeasibility of dense patch-level annotation, MIL based methods [ 3 , 28 , 33 , 13 , 32 ] have become the prevailing approaches for WSI analysis. In the MIL framework, each

Read the complete text