MedMoE: Modality-Specialized Mixture of Experts for Medical Vision-Language Understanding

Shivang Chopra, Gabriela Sanchez-Rodriguez, Lingchao Mao, Andrew J Feola, Jing Li, Zsolt Kira · 2025

Read MedMoE: Modality-Specialized Mixture of Experts for Medical Vision-Language Understanding by Shivang Chopra, Gabriela Sanchez-Rodriguez, Lingchao Mao, Andrew J Feola, Jing Li, Zsolt Kira (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-08356.txt.

Description

Medical scans come in many types, and each type shows disease at a different scale of detail. Shivang Chopra and co-authors build a vision-language system that adapts to the scan type, in a 2025 paper. Most systems treat all local image features in one uniform way. Their system, MedMoE, routes image features through expert branches picked by report type.

Features come in several scales from a transformer backbone, so fine and coarse detail both enter. Each expert branch learns the look of one imaging style. The output lines up image regions with the words that describe them, with no need for type labels at test time. Benchmark tests showed better alignment and retrieval across scan types.

Catalog record

CREATORShivang Chopra, Gabriela Sanchez-Rodriguez, Lingchao Mao, Andrew J Feola, Jing Li, Zsolt Kira
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-08356

Browse the full library · About the Tower of Babel