OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs
Yifei Li, Pengyiang Liu, Yuhang Zang, Zhongyue Shi, Qi Fu, Hongye Hao, Jiwen Lu · 2026
Read OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs by Yifei Li, Pengyiang Liu, Yuhang Zang, Zhongyue Shi, Qi Fu, Hongye Hao, Jiwen Lu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03890.txt.
Introduction
Li and co-authors benchmark streaming spatial intelligence in multimodal models with OVO-S-Bench. Robots, AR systems, and self-driving agents reason from continuous first-person streams. Evidence often sits outside the current view. Offline video tests and event-focused sets miss that spatial demand. This benchmark is fully human-annotated: 1,680 questions over 348 videos. Each question carries a time stamp and an evidence window.
At test time the model sees only the video prefix before the query. Four levels rise in abstraction, from instant perception to allocentric mapping. Thirty-eight models face the set. The best trails human experts by 33 points under the same access rules. Allocentric mapping is the dominant bottleneck. Streaming-tuned and spatial-tuned models even trail their own backbones. Ungrounded chain-of-thought makes spatial errors worse. The testbed sets a demanding bar for next-generation systems.
Catalog record
| CREATOR | Yifei Li, Pengyiang Liu, Yuhang Zang, Zhongyue Shi, Qi Fu, Hongye Hao, Jiwen Lu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 117 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.03890