MedProbCLIP: Probabilistic Adaptation of Vision-Language Foundation Model for Reliable Radiograph-Report Retrieval
Ahmad Elallaf Yu Zhang Yuktha Priya Masupalli Jeong Yang Young Lee Zechun Cao Gongbo Liang · 2026
Read MedProbCLIP: Probabilistic Adaptation of Vision-Language Foundation Model for Reliable Radiograph-Report Retrieval by Ahmad Elallaf Yu Zhang Yuktha Priya Masupalli Jeong Yang Young Lee Zechun Cao Gongbo Liang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-16019.txt.
Description
Elallaf and colleagues make chest X ray retrieval more trustworthy by replacing point embeddings with distributions. Vision language models learn strong image and text encodings, but their fixed vectors give no sense of doubt. That is a flaw in high stakes medical retrieval, where one report can match many images and vice versa.
MedProbCLIP models each image and report as a Gaussian cloud, trained to match pairs while penalizing overconfident scores. Multi view images and multi section reports supervise training, yet inference needs only one radiograph and one report. On MIMIC chest X ray data it beats fixed vector and prior probabilistic baselines on retrieval and zero shot classification. Calibration is better, selective retrieval is safer, and behaviour under realistic clinical corruption is sturdier.
Catalog record
| CREATOR | Ahmad Elallaf Yu Zhang Yuktha Priya Masupalli Jeong Yang Young Lee Zechun Cao Gongbo Liang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-16019