NeuroVLM-Bench: Evaluation of Vision-Enabled Large Language Models for Clinical Reasoning in Neurological Disorders

Katarina Trojachanec Dineva, Stefan Andonov, Ilinka Ivanoska, Ivan Kitanovski, Sasho Gramatikov, Tamara Kostova, Monika Simjanoska Misheva, Kostadin Mishev · 2026

Read NeuroVLM-Bench: Evaluation of Vision-Enabled Large Language Models for Clinical Reasoning in Neurological Disorders by Katarina Trojachanec Dineva, Stefan Andonov, Ilinka Ivanoska, Ivan Kitanovski, Sasho Gramatikov, Tamara Kostova, Monika Simjanoska Misheva, Kostadin Mishev (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24846.txt.

Description

Dineva and co-authors benchmark vision language models for clinical reasoning on brain disorders. Their NeuroVLM-Bench uses curated MRI and CT datasets with multiple sclerosis, stroke, tumours, other cases, and normal controls. Models must output diagnosis, subtype, modality, sequence, and plane at once. Scores cover abstention, calibration, output validity, and efficiency. Across twenty frontier models, traits such as modality and plane are nearly solved. Reasoning, above all subtype calls, stays hard; tumours are easiest, while multiple sclerosis remains difficult.

Catalog record

CREATORKatarina Trojachanec Dineva, Stefan Andonov, Ilinka Ivanoska, Ivan Kitanovski, Sasho Gramatikov, Tamara Kostova, Monika Simjanoska Misheva, Kostadin Mishev
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE149948
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.24846

Browse the full library · About the Tower of Babel