MedObvious: Exposing the Medical Moravec’s Paradox in VLMs via Clinical Triage
Ufaq Khan 1, Umair Nawaz 1, Lekkala Sai Teja 2, Numaan Saeed 1, Muhammad Bilal 3, Yutong Xie 1, Mohammad Yaqub 1, Muhammad Haris Khan 1 · 2026
Read MedObvious: Exposing the Medical Moravec’s Paradox in VLMs via Clinical Triage by Ufaq Khan 1, Umair Nawaz 1, Lekkala Sai Teja 2, Numaan Saeed 1, Muhammad Bilal 3, Yutong Xie 1, Mohammad Yaqub 1, Muhammad Haris Khan 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23501.txt.
Description
Khan and seven co-authors build MedObvious, a benchmark for the sanity checks that start medical image reading. Clinicians first confirm the scan is valid: right modality, right anatomy, sane orientation. Most tests skip that step and trust the input. MedObvious packs 1,880 tasks where models must spot a broken panel in image sets. Five tiers climb from mix-ups to triage-style traps. Across 17 vision models, checking proves shaky. Models invent flaws on clean sets and wobble as sets grow. Scores swing with the answer format.
Catalog record
| CREATOR | Ufaq Khan 1, Umair Nawaz 1, Lekkala Sai Teja 2, Numaan Saeed 1, Muhammad Bilal 3, Yutong Xie 1, Mohammad Yaqub 1, Muhammad Haris Khan 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24150 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.23501