Ensemble learning of foundation models for precision oncology
2025
Read Ensemble learning of foundation models for precision oncology (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-16085.txt.
Introduction
Xiangde Luo and a large team blend top cancer image models in a 2025 study. Tissue slides are the base of cancer diagnosis and care picks, and smart models now learn rich views from whole slides. Each model was trained on its own data with its own plan, so scores swing and travel poorly to new labs.
Their frame, called ELF, joins five pre-trained slide models into one team. The blend evens out each model's weak spots and lifts the team's grip on new cases. Tests span care tasks in precision cancer work. Readers see how a team of models beats the best lone model.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-16085
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Ensemble learning of foundation models for precision oncology Abstract Xiangde Luo 1‡ , Xiyue Wang 1‡ , Feyisope Eweje 1 , Xiaoming Zhang 2 , Sen Yang 1 , Ryan Quinton 3 , Jinxi Xiang 1 , Yuchen Li 1 , Yuanfeng Ji 1 , Zhe Li 1 , Yijiang Chen 1 , Colin Bergstrom 3 , Ted Kim 1 , Francesca Maria Olguin 3 , Kelley Yuan 2 , Matthew Abikenari 4 , Andrew Heider 1 , Sierra Willens 3 , Sanjeeth Rajaram 3 , Robert West 2 , Joel Neal 3 , Maximilian Diehn 1 , Ruijiang Li {}^{\textbf{*}1,5} {affiliations} Department of Radiation Oncology, Stanford University School of Medicine, Stanford, CA, USA. Department of Pathology, Stanford University School of Medicine, Stanford, CA, USA Department of Medicine (Oncology), Stanford University School of Medicine, Stanford, CA, USA Department of Neurosurgery, Stanford University School of Medicine, Stanford, CA, USA Stanford Institute for Human-Centered Artificial Intelligence, Stanford, CA, USA \bm{{\ddagger}} equal contribution * Correspondence to Ruijiang Li ( [email protected] ). Funding This study was supported in part by the National Institutes of Health under research grants R01CA269559, R01CA285456 and R01CA290715 from the National Cancer Institute. Abstract Histopathology is essential for disease diagnosis and treatment decision-making. Recent advances in artificial intelligence (AI) have enabled the development of pathology foundation models that learn rich visual representations from large-scale whole-slide images (WSIs). However, existing models are often trained on disparate datasets using varying strategies, leading to inconsistent performance and limited generalizability. Here, we introduce ELF ( E nsemble L earning of F oundation models), a novel framework that integrates five state-of-the-art pathology foundation models to generate unified slide-level representations. Trained on 53,699 WSIs spanning 20 anatomical sites, ELF leverages ensemble learning to capture complementary information from diverse models while maintaining high data efficiency. Unlike traditional tile-level models, ELF’s slide-level architecture is particularly advantageous in clinical contexts where data are limited, such as therapeutic response prediction. We evaluated ELF across a wide range of clinical applications, including disease classification, biomarker detection, and response prediction to major anticancer therapies—cytotoxic chemotherapy, targeted therapy, and immunotherapy—across multiple cancer types. ELF consistently outperformed all constituent foundation models and existing slide-level models, demonstrating superior accuracy and robustness. Our results highlight the power of ensemble learning for pathology foundation models and suggest ELF as a scalable and generalizable solution for advancing AI-assisted precision oncology. Source codes: https://github.com/lilab-stanford/ELF Introduction Histopathology is a cornerstone of clinical practice, offering critical insights into cellular morphology and tissue architecture. As the gold standard for disease diagnosis, it also plays a vital role in guiding prognosis and informing treatment decisions. With the growing availability of digitized whole-slide histopathology images and advances in computational power, artificial intelligence (AI) has emerged as a powerful tool for histopathology image analysis, which has significant implications for precision oncology [ 1 , 2 , 3 , 4 ] . Among the most promising developments in this field are pathology foundation models—large-scale models pretrained using self-supervised learning on vast collections of histopathology slides [ 5 , 6 , 7 , 8 , 9 , 10 , 11 ] . These models can be fine-tuned for a wide range of downstream clinical tasks, with the potential to enhance diagnostic accuracy, identify novel prognostic and predictive biomarkers, and support personalized treatment strategies [ 12 , 13 , 14 ] . There has been a rapid proliferation of pathology foundation models in the last few years, with at least 15 developed and counting [ 15 ] . These foundation models are typically trained on proprietary datasets with different training strategies [ 16 , 17 ] , leading to model-specific biases and divergent performance across applications [ 18 , 19 ] . Indeed, recent benchmark studies [ 18 , 20 , 21 ] based on extensive evaluation have shown that the relative performance of pathology foundation models is highly variable across different tasks and even across datasets for the same task. In other words, no single foundation model outperformed others for all tasks. This creates a conundrum in the community about which foundation model one should use for a particular application. There is an emerging interest in combining the relative strengths of different foundation models. One recent study attempted to resolve the differences among several existing models using knowledge distillation [ 19 ] . As a result, the model effectively learns an ‘average’ feature representation, which may paradoxically reduce feature diversity and representation capability of the resulting model. This approach did not outperform existing foundation models as shown in benchmark studies [ 20 ] . The optimal strategy that truly leverages the complementary value of different foundation models remains to be explored. Here, we present ELF (Ensemble Learning of Foundation models), a new paradigm for integrating multiple foundation models. ELF incorporates five state-of-the-art pathology foundation models and generates a unified representation for the whole-slide image (WSI) through additional pretraining on 53,699 WSIs across 20 anatomical sites. As a pretrained slide-level foundation model, ELF has significant advantages over traditional tile-level foundation models in that it is much more data-efficient, and therefore, is particularly well suited to clinical applications where a sufficiently large dataset is not available for model fine-tuning. This is quite common in therapeutic response prediction which is focused on a particular drug regimen in a given indication and clinical setting. We evaluated the performance of ELF on a wide range of clinical applications, including challenging disease diagnosis, molecular biomarker detection, and treatment response prediction. In particular, we tested ELF for predicting response across all major anticancer therapies including cytotoxic chemotherapy, molecularly targeted therapy, and immunotherapy in various cancer types. ELF achieved superior performance compared with each of the five individual foundation models as well as existing slide-level foundation models [ 5 , 6 , 22 ] . These findings demonstrate the effectiveness of our ensemble learning approach for integrating pathology foundation models, with broad implications in precision medicine. Results Figure 1 : ELF model design and evaluation. a, Model pretraining. ELF is a new paradigm for integrating multiple foundation models through a unified slide-level pathology foundation model. Here, five independently trained tile-level foundation models were employed to construct this ensemble (GigaPath [ 5 ] , CONCHV1.5 [ 10 ] , Virchow2 [ 23 ] , H-Optimus-0 [ 8 ] , UNI [ 9 ] ). During pretraining, ELF employs contrastive learning to align slide embeddings derived from different foundation models applied to the same WSI, thereby capturing their complementary strengths. To further enhance pan-cancer representation learning, two auxiliary supervision tasks (cancer detection and organ classification) are incorporated in a multitask setting. An ensemble module integrates its outputs into a cohesive slide representation. b, Data distribution for ELF pretraining, which consists of 53,699 slides with clinical information across 20 anatomical sites from 11 public datasets. c, ELF is evaluated across diverse clinical applications, including disease subtyping, biomarker detection, and response prediction for anticancer therapy and immunotherapy. d, Across these clinical tasks, ELF consistently outperforms three leading slide-level pathology foundation models (Prov-GigaPath [ 5 ] , CHIEF [ 6 ] , and TITAN [ 22 ] ). Performance is reported using balanced accuracy (BA) for disease subtyping, and area under the ROC curve (AUC) for biomarker detection and treatment