Assessing Situational and Spatial Awareness of VLMs with Synthetically Generated Video
Pascal Benschop, Justin Dauwels, Jan van Gemert · 2026
Read Assessing Situational and Spatial Awareness of VLMs with Synthetically Generated Video by Pascal Benschop, Justin Dauwels, Jan van Gemert (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15780.txt.
Description
Pascal Benschop, Justin Dauwels, and Jan van Gemert test vision-language models on synthetic video in a 2026 arXiv paper. Spatial reasoning in these models stays fragile. It breaks when meaning hinges on subtle timing or geometry. The authors build a synthetic benchmark to probe two skills. One is situational awareness: telling a harmful interaction from a benign one. The other is spatial awareness: tracking who does what to whom.
Relative positions and motion also fall under the second skill. Synthetic video gives full control over those cues. Each factor can be varied while others stay fixed. That control exposes exactly where models fail. Real video cannot isolate causes so cleanly. For safety uses like monitoring, knowing a model's blind spots is essential.
Catalog record
| CREATOR | Pascal Benschop, Justin Dauwels, Jan van Gemert |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-15780