Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI
Minh Duc Do, Tillmann Rheude, Noel Kronenberg, Roland Eils, Benjamin Wild · 2026
Read Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI by Minh Duc Do, Tillmann Rheude, Noel Kronenberg, Roland Eils, Benjamin Wild (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26894.txt.
Description
Minh Duc Do, Tillmann Rheude, Noel Kronenberg, Roland Eils, and Benjamin Wild present MICViT, a transformer model for three-dimensional brain MRI. Brain scans come in several modalities, image types that highlight different tissue properties. Learning from them is hard: the data are huge, and patient numbers are small next to the variety of anatomy and disease. Combining the modalities well is the central challenge.
MICViT models context at three levels. Within each modality it attends locally and globally. Across modalities it again attends locally and globally, letting image types inform each other at every scale. The test task was predicting brain age. Three data sets, from large biobank to small clinic cohorts, were used. The model consistently beat leading convolutional and transformer rivals, and gained more from added modalities than they did.
Catalog record
| CREATOR | Minh Duc Do, Tillmann Rheude, Noel Kronenberg, Roland Eils, Benjamin Wild |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26894