Benchmarking Pathology Foundation Models for Spatial Domain Understanding

Bokai Zhao 1,2,3,4,* {}^{\text{1,2,3,4,*}}, Yiyang Zhang 2,3,* {}^{\text{2,3,*}}, Yuanchi Zhu 2,3,5,* {}^{\text{2,3,5,*}}, Hanqing Chao 4 {}^{\text{4}}, Long Bai 4 {}^{\text{4}}, Tai Ma 4 {}^{\text{4}}, Minfeng Xu 4 {}^{\text{4}}, Ming Song 1,2,3 {}^{\text{1,2,3}}, and Tianzi Jiang 1,2,3,5 {}^{\text{1,2,3,5}} 🖂 · 2026

Read Benchmarking Pathology Foundation Models for Spatial Domain Understanding by Bokai Zhao 1,2,3,4,* {}^{\text{1,2,3,4,*}}, Yiyang Zhang 2,3,* {}^{\text{2,3,*}}, Yuanchi Zhu 2,3,5,* {}^{\text{2,3,5,*}}, Hanqing Chao 4 {}^{\text{4}}, Long Bai 4 {}^{\text{4}}, Tai Ma 4 {}^{\text{4}}, Minfeng Xu 4 {}^{\text{4}}, Ming Song 1,2,3 {}^{\text{1,2,3}}, and Tianzi Jiang 1,2,3,5 {}^{\text{1,2,3,5}} 🖂 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25764.txt.

Introduction

Zhao and colleagues present SpaPath-Bench, a benchmark diagnosing what tissue model codes encode about tissue space. Current benchmarks judge models by clinical endpoints, revealing little about whether embeddings distinguish tissue regions or capture spatial relationships. SpaPath-Bench turns spatial domain identification on paired slide and transcriptomics data into a diagnostic task. It curates 42 paired slides and tests 19 encoders with seven methods. Across 83,000 runs, it finds different pretraining approaches capture distinct aspects of tissue spatial architecture. It offers guidance for building spatially aware tissue models.

Catalog record

CREATORBokai Zhao 1,2,3,4,* {}^{\text{1,2,3,4,*}}, Yiyang Zhang 2,3,* {}^{\text{2,3,*}}, Yuanchi Zhu 2,3,5,* {}^{\text{2,3,5,*}}, Hanqing Chao 4 {}^{\text{4}}, Long Bai 4 {}^{\text{4}}, Tai Ma 4 {}^{\text{4}}, Minfeng Xu 4 {}^{\text{4}}, Ming Song 1,2,3 {}^{\text{1,2,3}}, and Tianzi Jiang 1,2,3,5 {}^{\text{1,2,3,5}} 🖂
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20490
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25764

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Benchmarking Pathology Foundation Models for Spatial Domain Understanding Bokai Zhao 1,2,3,4,* {}^{\text{1,2,3,4,*}}, Yiyang Zhang 2,3,* {}^{\text{2,3,*}}, Yuanchi Zhu 2,3,5,* {}^{\text{2,3,5,*}}, Hanqing Chao 4 {}^{\text{4}}, Long Bai 4 {}^{\text{4}}, Tai Ma 4 {}^{\text{4}}, Minfeng Xu 4 {}^{\text{4}}, Ming Song 1,2,3 {}^{\text{1,2,3}}, and Tianzi Jiang 1,2,3,5 {}^{\text{1,2,3,5}} 🖂 Abstract Pathology foundation models (PFMs) have emerged as a core approach for learning transferable representations from whole slide images (WSIs), and they are typically benchmarked through downstream clinical endpoints. While such task level evaluations are indispensable, they offer limited insight into what the representations themselves encode, particularly whether PFM embeddings can distinguish meaningful tissue regions and capture their spatial relationships. We present SpaPath-Bench, a representation level benchmark designed to diagnose spatial representation capability in PFMs. SpaPath-Bench formulates spatial domain identification (SDI) on paired whole slide image and spatial transcriptomics (ST) data as a diagnostic task. It curates 42 public paired WSI and ST slides, enables large scale evaluation across 19 encoders and seven SDI methods, and measures partition quality using three complementary criteria: unsupervised spatial coherence, transcriptomics referenced agreement, and expert referenced agreement. Across 83K runs, SpaPath-Bench reveals that different pretraining paradigms capture distinct aspects of tissue spatial architecture, and it provides practical guidance for building the next generation of spatially aware computational pathology models. Code and data pipelines are publicly available at https://bokai-zhao.github.io/SpaPath-benchboard/ . 1 Introduction Computational pathology develops algorithms that interpret whole-slide images (WSIs) to support diagnosis, prognosis, and biomarker discovery at scale. Beyond recognizing cellular morphology, many diagnostic and prognostic cues arise from how multiple tissue components form coherent regions and interact across a section—for example, epithelial versus stromal areas, necrotic regions, or immune-rich neighborhoods. The ability to separate meaningful tissue regions and to capture their spatial neighborhood structure is therefore a foundational capability that underpins a wide range of clinical and research applications [ 20 ] . Pathology foundation models (PFMs) have recently become the dominant approach for learning transferable WSI representations [ 27 ] . By self-supervised pre-training on large collections of unlabeled histology, models such as UNI [ 3 ] , Virchow [ 22 ] , and GigaPath [ 29 ] provide strong generic image embeddings. Vision–language approaches, including CONCH [ 13 ] and MUSK [ 26 ] , further aim to enrich these embeddings by aligning histological patterns with medical text. Accordingly, current benchmarking efforts largely focus on downstream endpoints, e.g., mutation prediction, survival modeling, and cancer subtyping [ 31 , 2 , 15 ] . These task-level evaluations are indispensable as they reflect practical use cases. However, they do not directly characterize what the representation itself encodes [ 16 ] : before adding task-specific heads and training aggregators, to what extent do the embeddings themselves separate meaningful tissue regions and respect their spatial continuity within a section? We propose to answer this question using paired WSI–spatial transcriptomics (ST) datasets, where gene expression is profiled at spatially indexed spots whose coordinates are registered to the matched pathology image from the same section [ 1 ] . A common first step in ST analysis is spatial domain identification (SDI), which partitions a section into contiguous tissue regions that share similar expression profiles [ 30 , 23 , 11 ] . SDI is widely used because the inferred regions often correspond to coherent anatomical or functional tissue regions, and many SDI methods further incorporate the matched pathology image as a morphological [ 17 ] . This makes SDI a natural diagnostic for pathology representations: if PFM image embeddings capture meaningful tissue semantics, then spot-level embeddings extracted from the matched WSI should support SDI-style partitioning into spatially coherent regions that are biologically or anatomically meaningful regions. Concretely, for each paired sample we extract spot-level PFM embeddings at the ST spot coordinates and treat embedding dimensions as “pseudo-expression” variables, forming a spot-by-feature matrix analogous to the gene-expression matrix used by SDI. We then apply established SDI pipelines on this pseudo-expression matrix to obtain a spatial partition. We evaluate the resulting partition using three parallel criteria: (i) unsupervised spatial coherence metrics that quantify whether inferred regions are spatially smooth and well-structured; (ii) transcriptomics-referenced agreement, comparing embedding-derived partitions against SDI partitions obtained from gene expression as a molecularly grounded target; and (iii) expert-referenced agreement, comparing against manual anatomical annotations when available. Together, these evaluations test whether PFM embeddings support both region separability and spatial neighborhood consistency, and whether the resulting partitions align with transcriptomics-derived structure or expert tissue labels. Based on this view, we introduce SpaPath-Bench , a systematic benchmark for evaluating spatial organization encoded in pathology foundation models. Our contributions are threefold: - We formulate SDI on PFM image embeddings as a representation-level benchmark that complements conventional downstream task-level evaluation. - We provide a three-way evaluation protocol: unsupervised spatial coherence, transcriptomics-referenced agreement, and expert-referenced agreement, capturing distinct yet meaningful notions of region validity. - We conduct a large-scale factorial study on 42 public paired WSI–ST datasets across 19 encoders, 7 SDI methods, and multiple clustering algorithms, yielding 83k total runs with statistical reporting. Figure 1: Overview of the benchmark pipeline for spatial domain understanding. 2 Benchmark Protocol 2.1 Benchmark Pipeline Given a spatial transcriptomics (ST) slide with a paired H&E image, we denote the measured spots as \mathcal{S}=\{s_{i}\}_{i=1}^{N} , where each spot s_{i} is associated with a 2D physical coordinate \mathbf{p}_{i}\in\mathbb{R}^{2} in the tissue plane. Our benchmark evaluates whether pathology foundation model (PFM) representations preserve information sufficient for recovering spatial domain structures by standardizing the pipeline from spot-level feature extraction to domain partitioning and metric computation. Step 1: Spot-aligned WSI sampling. For each spot s_{i}\in\mathcal{S} , we extract an aligned histology patch x_{i} from the paired H&E image centered at \mathbf{p}_{i} (using a fixed magnification and patch size). We apply only model-input standardization, including cropping and intensity normalization, to obtain the spot-level image inputs \mathcal{X}=\{x_{i}\}_{i=1}^{N} . Step 2: Foundation model embedding. Given a pre-trained encoder f_{\theta} (a PFM or a baseline vision model), we compute a D -dimensional embedding for each patch as \mathbf{z}_{i}=f_{\theta}(x_{i})\in\mathbb{R}^{D} . Stacking these embeddings forms the feature matrix \mathbf{Z}=[\mathbf{z}_{1},\ldots,\mathbf{z}_{N}]^{\top}\in\mathbb{R}^{N\times D} . We conceptualize \mathbf{Z} as a pseudo-expression matrix, where each latent dimension acts as a virtual gene measured at that spot, aligning histology-derived representations with standard ST analysis workflows. Step 3: Spatial representation module (PCA vs. SDI-based). To incorporate spatial context, we transform \mathbf{Z} into a spatially informed representation \mathbf{H}\in\mathbb{R}^{N\times d} via one of two routes: (i) Non-spatial baseline (PCA): \mathbf{H}=\mathrm{PCA}_{d}(\mathbf{Z}) with d\in\{32,64,128,256\} . (ii) SDI-based spatial representation: We construct a spatial neighborhood graph G=(V,E) over \mathcal{S} using k -nearest neighbors ( k=6 ) based on the coordinate matrix \mathbf{P}=[\mathbf{p}_{1},\ldots,\mathbf{p}_{N}]^{\top}\in\mathbb{R}^{N\times 2} . An SDI method g_{\phi} then learns the spatial representations as \mathbf{H}=g_{\phi}(\mathbf{Z},\mathbf{P},G) , acting as a standardized spatial representation learner operating on the pseudo-expression space to promote neighborhood coherence. Step 4: Controlled partition readout (clustering). Given \mathbf{H} , we generate a spatial domain partition \hat{\mathbf{y}}\in\{1,\ldots,K\}^{N} using a controlled clustering function c\in\{\text{K-means},\,\text{Louvain},\,\text{Leiden}\} , i.e., \hat{\mathbf{y}}=c(\mathbf{H}) . For expert-annotated slides, K matches the number of reference domains; for unlabeled slides, K is determined via reference-free criteria (Sec. 2.2 ). Decoupling representation learning (PCA/SDI) from the partition readout (clustering) makes performance differences more directly attributable to the learned embeddings under consistent readout choices. Step 5: Metric computation and ranking. We

Read the complete text