OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video Understanding

Ruixiang Zhao Jie Yang Zijie Xin Tianyi Wang, Fengyun Rao Jing LYU Xirong Li, [1mm] Renmin University of China WeChat Vision, Tencent Inc.[2mm] Project page : https://ruixiangzhao.github.io/OmniPro · 2026

Read OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video Understanding by Ruixiang Zhao Jie Yang Zijie Xin Tianyi Wang, Fengyun Rao Jing LYU Xirong Li, [1mm] Renmin University of China WeChat Vision, Tencent Inc.[2mm] Project page : https://ruixiangzhao.github.io/OmniPro (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18577.txt.

Description

Ruixiang Zhao and six co-authors present OmniPro, a 2026 benchmark jointly testing omni-modal perception, proactive responding, and diverse video understanding in streaming video. It holds 2,700 human-verified samples across 9 sub-tasks and 3 cognitive levels, with 84 percent requiring audio signals. A dual-mode protocol tests content understanding in Probe mode and full proactive ability in Online mode. Eleven models show audio gains vary widely, performance degrades over time, and non-speech audio perception stays weakest.

Catalog record

CREATORRuixiang Zhao Jie Yang Zijie Xin Tianyi Wang, Fengyun Rao Jing LYU Xirong Li, [1mm] Renmin University of China WeChat Vision, Tencent Inc.[2mm] Project page : https://ruixiangzhao.github.io/OmniPro
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53711
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.18577

Browse the full library · About the Tower of Babel