Test-Time-Scaling for Zero-Shot Diagnosis with Visual-Language Reasoning

Ji Young Byun, Young-Jin Park, Navid Azizan, Rama Chellappa · 2025

Read Test-Time-Scaling for Zero-Shot Diagnosis with Visual-Language Reasoning by Ji Young Byun, Young-Jin Park, Navid Azizan, Rama Chellappa (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-11166.txt.

Description

Byun, Park, Azizan, and Chellappa present a training-free method for diagnosing medical images with vision and language models. A vision-language model first writes several readings of a scan or slide from open prompts. A language model then weighs the many candidate answers at test time to settle on one diagnosis. No labeled training set is needed, which matters where expert labels are scarce and costly.

The team tested the approach on X-ray-type images, eye images, and tissue slides. Their test-time weighing raised accuracy both for their own pipeline and for baseline methods. An added analysis shows that open, unbiased prompts in the first stage make the final diagnoses more reliable than guided ones.

Catalog record

CREATORJi Young Byun, Young-Jin Park, Navid Azizan, Rama Chellappa
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-11166

Browse the full library · About the Tower of Babel