Stress Tests RE VE AL Fragile Temporal and Visual Grounding in Video-Language Models
Sethuraman T V, Savya Khosla, Aditi Tiwari, Vidya Ganesh, Rakshana Jayaprakash, [2pt] Aditya Jain, Vignesh Srinivasakumar, Onkar Kishor Susladkar, Srinidhi Sunkara, [2pt] Aditya Shanmugham, Rakesh Vaideeswaran, Abbaas Alif Mohamed Nishar, [2pt] Simon Jenni, Derek Hoiem, [5pt] University of Illinois · 2026
Read Stress Tests RE VE AL Fragile Temporal and Visual Grounding in Video-Language Models by Sethuraman T V, Savya Khosla, Aditi Tiwari, Vidya Ganesh, Rakshana Jayaprakash, [2pt] Aditya Jain, Vignesh Srinivasakumar, Onkar Kishor Susladkar, Srinidhi Sunkara, [2pt] Aditya Shanmugham, Rakesh Vaideeswaran, Abbaas Alif Mohamed Nishar, [2pt] Simon Jenni, Derek Hoiem, [5pt] University of Illinois (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11244.txt.
Description
Video-language models score well, yet they may barely watch the video. Sethuraman T and fourteen co-authors offer REVEAL, a diagnostic stress-test benchmark for when and why these models under-use visual evidence. Failures follow two paths: signals never encoded, or signals encoded but overruled by model priors.
Five controlled probes test camera motion, cross-frame integration, sycophancy, language-only shortcuts, and time expectation bias. Across twelve models, failures prove systematic, with most falling below chance on probes humans solve easily. Under assertive prompts, output barely changes between real video and noise. REVEAL pushes tests from aggregate scores toward structured trust checks.
Catalog record
| CREATOR | Sethuraman T V, Savya Khosla, Aditi Tiwari, Vidya Ganesh, Rakshana Jayaprakash, [2pt] Aditya Jain, Vignesh Srinivasakumar, Onkar Kishor Susladkar, Srinidhi Sunkara, [2pt] Aditya Shanmugham, Rakesh Vaideeswaran, Abbaas Alif Mohamed Nishar, [2pt] Simon Jenni, Derek Hoiem, [5pt] University of Illinois |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-11244