MedProbCLIP: Probabilistic Adaptation of Vision-Language Foundation Model for Reliable Radiograph-Report Retrieval

Ahmad Elallaf Yu Zhang Yuktha Priya Masupalli Jeong Yang Young Lee Zechun Cao Gongbo Liang · 2026

Read MedProbCLIP: Probabilistic Adaptation of Vision-Language Foundation Model for Reliable Radiograph-Report Retrieval by Ahmad Elallaf Yu Zhang Yuktha Priya Masupalli Jeong Yang Young Lee Zechun Cao Gongbo Liang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-16019.txt.

Description

Elallaf and colleagues make chest X ray retrieval more trustworthy by replacing point embeddings with distributions. Vision language models learn strong image and text encodings, but their fixed vectors give no sense of doubt. That is a flaw in high stakes medical retrieval, where one report can match many images and vice versa.

MedProbCLIP models each image and report as a Gaussian cloud, trained to match pairs while penalizing overconfident scores. Multi view images and multi section reports supervise training, yet inference needs only one radiograph and one report. On MIMIC chest X ray data it beats fixed vector and prior probabilistic baselines on retrieval and zero shot classification. Calibration is better, selective retrieval is safer, and behaviour under realistic clinical corruption is sturdier.

Catalog record

CREATORAhmad Elallaf Yu Zhang Yuktha Priya Masupalli Jeong Yang Young Lee Zechun Cao Gongbo Liang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-16019

Browse the full library · About the Tower of Babel