MedGemma 1.5 Technical Report
Google Research and Google DeepMind · 2026
Read MedGemma 1.5 Technical Report by Google Research and Google DeepMind (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05081.txt.
Introduction
Sellergren and co-authors present MedGemma 1.5 4B, a model in the MedGemma set for imaging and document reading. It adds medical imaging, including CT and MRI volumes and tissue slide images. It adds finding via bounding boxes, multi-timepoint chest X-ray analysis, and reading of lab reports and health records. The report details changes for modes in one design: new training data, 3D volume slicing, and whole-slide tissue sampling. Against v1, the new model lifts 3D MRI scores by 11 percent, and 3D CT accuracy too.
Catalog record
| CREATOR | Google Research and Google DeepMind |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46293 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.05081
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MedGemma 1.5 Technical Report Google Research and Google DeepMind Abstract We introduce MedGemma 1.5 4B, the latest model in the MedGemma collection. MedGemma 1.5 expands on MedGemma 1 by integrating additional capabilities: high-dimensional medical imaging (CT/MRI volumes and histopathology whole slide images), anatomical localization via bounding boxes, multi-timepoint chest X-ray analysis, and improved medical document understanding (lab reports, electronic health records). We detail the innovations required to enable these modalities within a single architecture, including new training data, long-context 3D volume slicing, and whole-slide pathology sampling. Compared to MedGemma 1 4B, MedGemma 1.5 4B demonstrates significant gains in these new areas, improving 3D MRI condition classification accuracy by 11% and 3D CT condition classification by 3% (absolute improvements). In whole slide pathology imaging, MedGemma 1.5 4B achieves a 47% macro F1 gain. Additionally, it improves anatomical localization with a 35% increase in Intersection over Union on chest X-rays and achieves a 4% macro accuracy for longitudinal (multi-timepoint) chest x-ray analysis. Beyond its improved multimodal performance over MedGemma 1, MedGemma 1.5 improves on text-based clinical knowledge and reasoning, improving by 5% on MedQA accuracy and 22% on EHRQA accuracy. It also achieves an average of 18% macro F1 on 4 different lab report information extraction datasets (EHR Datasets 2, 3, 4, and Mendeley Clinical Laboratory Test Reports). Taken together, MedGemma 1.5 serves as a robust, open resource for the community, designed as an improved foundation on which developers can create the next generation of medical AI systems. Resources and tutorials for building upon MedGemma 1.5 can be found at https://goo.gle/medgemma . 1 Introduction Expanding the capabilities of open-weight medical foundation models to encompass complex, high-dimensional modalities is essential for comprehensive healthcare AI development. While recent advancements ( 39 ; 32 ) have demonstrated the utility of multimodal models in standard 2D imaging tasks, the number of models and benchmarks addressing more complicated imaging tasks are more limited. In this technical report, we introduce MedGemma 1.5, an updated model in the MedGemma collection integrating support for high-dimensional, volumetric, and longitudinal data, along with existing support for 2D imaging and text-based knowledge and reasoning, all within a single unified architecture. Specifically, MedGemma 1.5 expands the multimodal capabilities of previous releases by introducing native support for four medical imaging capabilities including: (1) 3D radiology interpretation (both CT and MRI volumes), (2) whole slide image (WSI) interepretaion for histopathology, (3) fine-grained anatomical localization for X-rays via bounding boxes, and (4) multi-timepoint radiology analysis. Through additional curated training datasets, we also incorporated improved capabilities for medical document (PDF) understanding and improved text-based clinical reasoning. As the first open model to achieve these diverse baseline capabilities in a single architecture, MedGemma 1.5 serves as a robust, open resource for the community, designed as an improved foundation on which developers can create the next generation of medical AI systems. Figure 1 : Overview of model capabilities within the MedGemma collection. The updated MedGemma 1.5 4B architecture now supports 3D radiology (CT/MRI volumes), pathology whole slide imaging (WSI), anatomical localization, and multi-timepoint analysis. The original MedGemma 27B model remains available for complex clinical knowledge and reasoning tasks and MedSigLIP remains available for medical image classification and retrieval tasks. Figure 2 : The left panel details accuracy on medical text Q&A tasks (MedQA and EHRQA), while the right panel highlights performance across diverse medical imaging capabilities. Notably, the "medical image interpretation" score represents an unweighted macro average of the model’s performance across 7 distinct imaging tasks including MIMIC-CXR (both RadGraph F1 and report generation macro F1), CheXpert (unweighted average across 5 conditions), CXR 14 (unweighted average across 3 conditions), Path MCQA, DermMCQA, and EyePACS. "Lab report extraction" is macro-averaged over results from EHR dataset 2, 3 and 4 as well as Mendeley Clinical Laboratory Test Reports (macro F1). All scores are reported as percentages. While the out-of-the-box performance is highly promising, the model is not meant to be deployed without the necessary clinical fine-tuning. Fine-tuning may improve results and adapt the framework for practical use. 2 Methods Similar to MedGemma 1, MedGemma 4B 1.5 is based off of Gemma3 ( 34 ) with the same architecture. The vision encoder is 400M MedSigLIP encoder ( 32 ) . The methodological updates for MedGemma 4B version 1.5 primarily fall into three categories: first, we incorporated several new training datasets with the goal of broadening medical knowledge and expanding capabilities for “high-dimensional” medical imaging including 3D CT and MRI volumes and Whole Slide Images (WSIs) for histopathology. Second, we implemented minor modifications to the modeling methodology to improve training efficiency and model capabilities. Third, we expanded evaluations to assess model performance on updated capabilities. Table 1 : Additional training data for MedGemma 4B 1.5 relative to MedGemma 1 Modality Dataset No. Train Examples Training stages Description Radiology CXR-IND1 605,732 PT, Distill, RL Dataset of chest X-ray images and free text reports from a large hospital system based in India CT Dataset 1 282,963 PT, Distill, RL Dataset of different axial CT studies across body parts (head, chest, abdomen) from a US-based radiology outpatient diagnostic center network. MRI Dataset 1 167,674 PT, Distill, RL Dataset of different axial multi-parametric MRI studies across body parts (head, abdomen, knee) from a US-based radiology outpatient diagnostic center network. Chest ImaGenome ( 38 ) 39,968 RL Dataset of chest X-ray with sequential images and bounding boxes from IBM Research. Pathology Whole Slide Imaging Internal WSI Histopathology 335,825 PT, RL WSIs with paired final diagnosis text reports. WSIs were tiled into individual patches and aggregated for input as described in the Methods. Dermatology Dermatology Dataset 4 25,560 PT, Distill Dermatology dataset featuring multiple images and longitudinal visits and records from Japan. Dermatology Dataset 5 87,879 PT, Distill, RL Dermatology dataset featuring unlabeled images. ISIC 40,269 PT, Distill Dermoscopic images with lesion diagnoses or attribute labels. Electronic Health Record and Laboratory Reports EHRQA ∗ 9,809 (QA Pairs) Distill Question/answer dataset drawn from synthetic FHIR records. EHR Dataset 2 1,539 (2,846 pages) Distill Lab Reports across different departments in histopathology such as Biochemistry, Clinical histopathology, Hematology, Microbiology and Serology EHR Dataset 3 6214 (18,035 pages) Distill Lab Reports across different departments in histopathology such as Biochemistry, Clinical histopathology, Hematology, Microbiology and Serology EHR Dataset 4 497 (1,278 pages) Distill Synthetic reports based on a Latex powered custom PDF generator for different lab report templates in the US EHR Dataset 5 33,882 (user queries) Distill Synthetic dataset of approximately 60,000 health-relevant user queries • ∗ Note that EHRQA was previously not included in the training of MedGemma 1 4B but was included in training data MedGemma 1 27B. (This dataset is also referred to as EHR Dataset 1 in the Model Card.) • PT: Continued Pretraining (supervised finetuning of LLM), RL: Reinforcement learning. Distill: Distilled from teacher model(s). Table 2 : Additional evaluation datasets for MedGemma 1.5 Task Dataset Modality No. Eval. Examples OOD \dagger Public * Medical text QA EHRNoteQA ( 22 ) Text 962 ✓ ✓ CXR temporal analysis MS-CXR-T ( 4 ) Radiology longitudinal 1326 - ✓ 3D CT classification CT Dataset 1 Radiology CT (Volumes) 1229 - - CT-RATE ( 11 ) Radiology CT (Volumes) 1558 ✓ ✓ CXR Finding localization Chest ImaGenome ( 38 ) Radiology localization