Stress Tests RE VE AL Fragile Temporal and Visual Grounding in Video-Language Models

Sethuraman T V, Savya Khosla, Aditi Tiwari, Vidya Ganesh, Rakshana Jayaprakash, [2pt] Aditya Jain, Vignesh Srinivasakumar, Onkar Kishor Susladkar, Srinidhi Sunkara, [2pt] Aditya Shanmugham, Rakesh Vaideeswaran, Abbaas Alif Mohamed Nishar, [2pt] Simon Jenni, Derek Hoiem, [5pt] University of Illinois · 2026

Read Stress Tests RE VE AL Fragile Temporal and Visual Grounding in Video-Language Models by Sethuraman T V, Savya Khosla, Aditi Tiwari, Vidya Ganesh, Rakshana Jayaprakash, [2pt] Aditya Jain, Vignesh Srinivasakumar, Onkar Kishor Susladkar, Srinidhi Sunkara, [2pt] Aditya Shanmugham, Rakesh Vaideeswaran, Abbaas Alif Mohamed Nishar, [2pt] Simon Jenni, Derek Hoiem, [5pt] University of Illinois (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11244.txt.

Description

Video-language models score well, yet they may barely watch the video. Sethuraman T and fourteen co-authors offer REVEAL, a diagnostic stress-test benchmark for when and why these models under-use visual evidence. Failures follow two paths: signals never encoded, or signals encoded but overruled by model priors.

Five controlled probes test camera motion, cross-frame integration, sycophancy, language-only shortcuts, and time expectation bias. Across twelve models, failures prove systematic, with most falling below chance on probes humans solve easily. Under assertive prompts, output barely changes between real video and noise. REVEAL pushes tests from aggregate scores toward structured trust checks.

Catalog record

CREATORSethuraman T V, Savya Khosla, Aditi Tiwari, Vidya Ganesh, Rakshana Jayaprakash, [2pt] Aditya Jain, Vignesh Srinivasakumar, Onkar Kishor Susladkar, Srinidhi Sunkara, [2pt] Aditya Shanmugham, Rakesh Vaideeswaran, Abbaas Alif Mohamed Nishar, [2pt] Simon Jenni, Derek Hoiem, [5pt] University of Illinois
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-11244

Browse the full library · About the Tower of Babel