Test-Time-Scaling for Zero-Shot Diagnosis with Visual-Language Reasoning
Ji Young Byun, Young-Jin Park, Navid Azizan, Rama Chellappa · 2025
Read Test-Time-Scaling for Zero-Shot Diagnosis with Visual-Language Reasoning by Ji Young Byun, Young-Jin Park, Navid Azizan, Rama Chellappa (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-11166.txt.
Description
Byun, Park, Azizan, and Chellappa present a training-free method for diagnosing medical images with vision and language models. A vision-language model first writes several readings of a scan or slide from open prompts. A language model then weighs the many candidate answers at test time to settle on one diagnosis. No labeled training set is needed, which matters where expert labels are scarce and costly.
The team tested the approach on X-ray-type images, eye images, and tissue slides. Their test-time weighing raised accuracy both for their own pipeline and for baseline methods. An added analysis shows that open, unbiased prompts in the first stage make the final diagnoses more reliable than guided ones.
Catalog record
| CREATOR | Ji Young Byun, Young-Jin Park, Navid Azizan, Rama Chellappa |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-11166