Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI

Minh Duc Do, Tillmann Rheude, Noel Kronenberg, Roland Eils, Benjamin Wild · 2026

Read Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI by Minh Duc Do, Tillmann Rheude, Noel Kronenberg, Roland Eils, Benjamin Wild (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26894.txt.

Description

Minh Duc Do, Tillmann Rheude, Noel Kronenberg, Roland Eils, and Benjamin Wild present MICViT, a transformer model for three-dimensional brain MRI. Brain scans come in several modalities, image types that highlight different tissue properties. Learning from them is hard: the data are huge, and patient numbers are small next to the variety of anatomy and disease. Combining the modalities well is the central challenge.

MICViT models context at three levels. Within each modality it attends locally and globally. Across modalities it again attends locally and globally, letting image types inform each other at every scale. The test task was predicting brain age. Three data sets, from large biobank to small clinic cohorts, were used. The model consistently beat leading convolutional and transformer rivals, and gained more from added modalities than they did.

Catalog record

CREATORMinh Duc Do, Tillmann Rheude, Noel Kronenberg, Roland Eils, Benjamin Wild
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.26894

Browse the full library · About the Tower of Babel