MedMoE: Modality-Specialized Mixture of Experts for Medical Vision-Language Understanding
Shivang Chopra, Gabriela Sanchez-Rodriguez, Lingchao Mao, Andrew J Feola, Jing Li, Zsolt Kira · 2025
Read MedMoE: Modality-Specialized Mixture of Experts for Medical Vision-Language Understanding by Shivang Chopra, Gabriela Sanchez-Rodriguez, Lingchao Mao, Andrew J Feola, Jing Li, Zsolt Kira (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-08356.txt.
Description
Medical scans come in many types, and each type shows disease at a different scale of detail. Shivang Chopra and co-authors build a vision-language system that adapts to the scan type, in a 2025 paper. Most systems treat all local image features in one uniform way. Their system, MedMoE, routes image features through expert branches picked by report type.
Features come in several scales from a transformer backbone, so fine and coarse detail both enter. Each expert branch learns the look of one imaging style. The output lines up image regions with the words that describe them, with no need for type labels at test time. Benchmark tests showed better alignment and retrieval across scan types.
Catalog record
| CREATOR | Shivang Chopra, Gabriela Sanchez-Rodriguez, Lingchao Mao, Andrew J Feola, Jing Li, Zsolt Kira |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-08356