OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs

Yifei Li, Pengyiang Liu, Yuhang Zang, Zhongyue Shi, Qi Fu, Hongye Hao, Jiwen Lu · 2026

Read OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs by Yifei Li, Pengyiang Liu, Yuhang Zang, Zhongyue Shi, Qi Fu, Hongye Hao, Jiwen Lu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03890.txt.

Introduction

Li and co-authors benchmark streaming spatial intelligence in multimodal models with OVO-S-Bench. Robots, AR systems, and self-driving agents reason from continuous first-person streams. Evidence often sits outside the current view. Offline video tests and event-focused sets miss that spatial demand. This benchmark is fully human-annotated: 1,680 questions over 348 videos. Each question carries a time stamp and an evidence window.

At test time the model sees only the video prefix before the query. Four levels rise in abstraction, from instant perception to allocentric mapping. Thirty-eight models face the set. The best trails human experts by 33 points under the same access rules. Allocentric mapping is the dominant bottleneck. Streaming-tuned and spatial-tuned models even trail their own backbones. Ungrounded chain-of-thought makes spatial errors worse. The testbed sets a demanding bar for next-generation systems.

Catalog record

CREATORYifei Li, Pengyiang Liu, Yuhang Zang, Zhongyue Shi, Qi Fu, Hongye Hao, Jiwen Lu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE117 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03890

Browse the full library · About the Tower of Babel