OTSurv: A Novel Multiple Instance Learning Framework for Survival Prediction with Heterogeneity-aware Optimal Transport
Qin Ren 1 Yifan Wang 1 Ruogu Fang 3 Haibin Ling 1 Chenyu You 1,2 · 2025
Read OTSurv: A Novel Multiple Instance Learning Framework for Survival Prediction with Heterogeneity-aware Optimal Transport by Qin Ren 1 Yifan Wang 1 Ruogu Fang 3 Haibin Ling 1 Chenyu You 1,2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-20741.txt.
Introduction
Qin Ren and co-authors built a tool called OTSurv in a 2025 paper on predicting cancer survival from microscope slides. A single slide holds thousands of small patches, and tumors vary a lot from patch to patch. Older tools often miss that variety, both across the whole slide and in single patches where the call is unsure.
OTSurv borrows a math method called optimal transport, which moves weight between groups under set rules. One rule handles the long tail of rare patch shapes, and a second rule trusts sure patches more than noisy ones. The method can be solved fast with a simple matrix routine. Across six standard test sets, OTSurv set new best scores for ranking which patients live longer.
Catalog record
| CREATOR | Qin Ren 1 Yifan Wang 1 Ruogu Fang 3 Haibin Ling 1 Chenyu You 1,2 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-20741
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OTSurv: A Novel Multiple Instance Learning Framework for Survival Prediction with Heterogeneity-aware Optimal Transport Qin Ren 1 Yifan Wang 1 Ruogu Fang 3 Haibin Ling 1 Chenyu You 1,2 Abstract Survival prediction using whole slide images (WSIs) can be formulated as a multiple instance learning (MIL) problem. However, existing MIL methods often fail to explicitly capture pathological heterogeneity within WSIs, both globally – through long-tailed morphological distributions, and locally – through tile-level prediction uncertainty. Optimal transport (OT) provides a principled way of modeling such heterogeneity by incorporating marginal distribution constraints. Building on this insight, we propose OTSurv , a novel MIL framework from an optimal transport perspective. Specifically, OTSurv formulates survival predictions as a heterogeneity-aware OT problem with two constraints: (1) global long-tail constraint that models prior morphological distributions to avert both mode collapse and excessive uniformity by regulating transport mass allocation, and (2) local uncertainty-aware constraint that prioritizes high-confidence patches while suppressing noise by progressively raising the total transport mass. We then recast the initial OT problem, augmented by these constraints, into an unbalanced OT formulation that can be solved with an efficient, hardware-friendly matrix scaling algorithm. Empirically, OTSurv sets new state-of-the-art results across six popular benchmarks, achieving an absolute 3.6% improvement in average C-index. In addition, OTSurv achieves statistical significance in log-rank tests and offers high interpretability, making it a powerful tool for survival prediction in digital pathology. Our codes are available at https://github.com/Y-Research-SBU/OTSurv . 1 Introduction Survival prediction, which estimates patient-specific time-to-event probabilities ( i.e. , overall survival), is a critical oncology task essential for optimizing therapeutic strategies [ 26 ] . In clinical practice, it mainly relies on pathologists’ meticulous analysis of tissue slides. However, variations in tissue composition and structure across different regions pose significant challenges in identifying prognostic patterns [ 2 , 6 , 20 , 35 , 34 , 19 , 10 ] . In particular, pathologists need to detect and interpret small or ambiguous regions that are crucial for survival outcomes. Capturing this heterogeneity is inherently challenging, and even slight missteps can lead to incomplete prognostic assessments that ultimately compromise patient survival. In digital pathology, neural networks have shown great promise in WSI-based survival prediction, but their ultra-high resolution ( e.g. , 10^{5}\times 10^{5} pixels) incurs high computational and annotation costs, rendering fully supervised learning impractical [ 32 ] . Thus, weakly supervised methods, particularly Multiple Instance Learning (MIL), have become the de facto solution, which treats each WSI as a bag of instances with only a bag-level survival label [ 31 , 38 , 14 , 23 ] . Analogous to how pathologists analyze tissue heterogeneity, MIL methods are required to effectively capture this variability to ensure that crucial survival-related information is not lost. Specifically, survival-related heterogeneity manifests at two scales. At global level, it involves capturing sparse patterns within the long-tailed distribution of patch types [ 7 ] . At local level, it focuses on eliminating the predictive uncertainty of each patch [ 21 ] . However, this dual-scale heterogeneity remains under-explored in current MIL approach: some completely ignore heterogeneity ( e.g. , Mean/Max Pooling), some focus only on single level ( global [ 25 , 16 ] or local [ 27 , 9 , 14 , 23 , 31 ] ), while others attempt to tackle both but without providing explicit guidance [ 33 ] . Additionally, computational limits force MIL models to sample tiles randomly, risking the omission of critical prognostic regions and hindering heterogeneity modeling. In this work, we aim to address the following question: how can MIL-based models explicitly account for both global and local pathological heterogeneity? We note that this heterogeneity in MIL essentially manifests as feature distribution variability, with global and local heterogeneity reflected in prototype-level and instance-level feature distributions, respectively. Optimal Transport (OT) [ 29 , 12 ] , as a mathematically interpretable framework that optimally aligns two distributions while minimizing transport cost, naturally fits this setting. By incorporating two marginal distribution constraints, OT provides a principled mechanism to explicitly model dual-scale heterogeneity. Building on this insight, we propose OTSurv , an OT -based MIL framework for surv ival prediction from an optimal transport perspective. OTSurv models survival prediction as an OT problem by aggregating a variable-sized set of instance features and mapping them onto a fixed-size set of trainable survival tokens, which is used for reference. This process explicitly accounts for both global and local heterogeneity through two tailored marginal distribution constraints. For global heterogeneity (long-tailed distribution), we introduce G lobal Long-tail C onstraint ( \mathbf{C_{G}} ), which models prior morphological distributions to prevent mode collapse and excessive uniformity by regularizing transport mass allocation. For local heterogeneity (difficult-to-predict patches), we propose L ocal Uncertainty-aware C onstraint ( \mathbf{C_{L}} ), which prioritizes high-confidence patches to suppress noise by progressively raising total transport mass. We then recast the augmented OT problem into an unbalanced OT formulation that can be solved with an efficient, hardware-friendly matrix scaling algorithm, by incorporating a virtual survival token to absorb unselected mass. Our key contributions are: (i) We propose OTSurv , a novel OT-based MIL framework for WSI survival prediction. (ii) We design two tailored marginal constraints in OT to model global and local heterogeneity in WSIs. (iii) Experiments on 6 popular benchmarks show that OTSurv outperforms previous SOTA methods in C-index, achieves statistical significance in log-rank tests, and provides strong interpretability. Figure 1: Overview of the OTSurv framework. (a) Framework of OTSurv: A WSI W is processed into patch features Z , aligned with survival tokens S via heterogeneity-aware OT, and aggregated into a survival embedding E . (b) heterogeneity-aware Optimal Transport: By extending the cost matrix with an additional column of zeros ( i.e. , virtual token), the unbalanced OT solver can be used for solving heterogeneity-aware OT with global and local constraints. 2 Method 2.1 Overview As illustrated in Fig. 1 , OTSurv reframes WSI-based survival prediction as a heterogeneity-aware optimal transport problem. It is composed of four distinct, yet interlocking, modules: (i) WSI Decomposition : A large-scale WSI W is partitioned into N non-overlapping patches \{x_{i}\}_{i=1}^{N} , denoted as x=\{x_{i}\}_{i=1}^{N}\in\mathbb{R}^{N\times c\times h\times w} , where c is the number of color channels, and h\times w is the patch resolution; (ii) Feature Embedding : A frozen encoder f_{\text{enc}} extracts patch-level features F=f_{\text{enc}}(x)\in\mathbb{R}^{N\times D} . These are then projected into a lower-dimensional latent space via a learnable linear projection, yielding instance embeddings Z=f_{\text{proj}}(F)\in\mathbb{R}^{N\times d} ; (iii) Feature Aggregation : At the core of our approach, the heterogeneity-aware OT module computes an optimal transport plan Q=f_{\text{OT}}(C)\in\mathbb{R}^{N\times K} , where the cost matrix C\in\mathbb{R}^{N\times K} is computed using normalized Euclidean distance between Z\in\mathbb{R}^{N\times d} and learnable survival tokens S\in\mathbb{R}^{K\times d} . The aggregated slide-level embedding is then obtained as E=f_{\text{agg}}(Q^{\top}Z)\in\mathbb{R}^{d} , where Q^{\top}Z\in\mathbb{R}^{K\times d} and f_{\text{agg}}(\cdot) is linear layer; and (iv) Risk Prediction : finally, the aggregated embedding E is fed into a linear predictor f_{\text{pred}} to produce the final risk score r=f_{\text{pred}}(E)\in\mathbb{R} . The entire model is optimized by minimizing a Cox proportional hazards loss [ 5 ] . 2.2 Heterogeneity-aware OT Problem In this section, we first overview OT theory, and then delve into an in-depth discussion of our proposed local and global OT marginal distribution constraints,