Describe Anything in Medical Images
Xi Xiao, Yunbei Zhang, Thanh-Huy Nguyen, Ba-Thinh Lam, Janet Wang, Lin Zhao, Jihun Hamm, Tianyang Wang, Xingjian Li, Xiao Wang, Hao Xu, Tianming Liu, Min Xu · 2025
Read Describe Anything in Medical Images by Xi Xiao, Yunbei Zhang, Thanh-Huy Nguyen, Ba-Thinh Lam, Janet Wang, Lin Zhao, Jihun Hamm, Tianyang Wang, Xingjian Li, Xiao Wang, Hao Xu, Tianming Liu, Min Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-05804.txt.
Description
Xi Xiao and eleven co-authors built MedDAM in twenty twenty-five, bringing region-specific image captioning to medicine. General captioning models can describe a marked region of a natural image in detail without explicit training pairs. Medical reading, though, hinges on subtle regional findings, and no framework had adapted the idea clinically. MedDAM pairs large vision-language models with prompts designed by medical experts for each imaging modality.
Because medicine lacks ground-truth region captions, the team built an evaluation benchmark around attribute-level verification questions instead. Across chest X-ray, lung CT, and skin data sets, MedDAM beat leading general models, including much larger commercial systems. The results establish region-level semantic alignment as a foundation for clinical vision-language tools.
Catalog record
| CREATOR | Xi Xiao, Yunbei Zhang, Thanh-Huy Nguyen, Ba-Thinh Lam, Janet Wang, Lin Zhao, Jihun Hamm, Tianyang Wang, Xingjian Li, Xiao Wang, Hao Xu, Tianming Liu, Min Xu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-05804