OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video Understanding
Ruixiang Zhao Jie Yang Zijie Xin Tianyi Wang, Fengyun Rao Jing LYU Xirong Li, [1mm] Renmin University of China WeChat Vision, Tencent Inc.[2mm] Project page : https://ruixiangzhao.github.io/OmniPro · 2026
Read OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video Understanding by Ruixiang Zhao Jie Yang Zijie Xin Tianyi Wang, Fengyun Rao Jing LYU Xirong Li, [1mm] Renmin University of China WeChat Vision, Tencent Inc.[2mm] Project page : https://ruixiangzhao.github.io/OmniPro (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18577.txt.
Description
Ruixiang Zhao and six co-authors present OmniPro, a 2026 benchmark jointly testing omni-modal perception, proactive responding, and diverse video understanding in streaming video. It holds 2,700 human-verified samples across 9 sub-tasks and 3 cognitive levels, with 84 percent requiring audio signals. A dual-mode protocol tests content understanding in Probe mode and full proactive ability in Online mode. Eleven models show audio gains vary widely, performance degrades over time, and non-speech audio perception stays weakest.
Catalog record
| CREATOR | Ruixiang Zhao Jie Yang Zijie Xin Tianyi Wang, Fengyun Rao Jing LYU Xirong Li, [1mm] Renmin University of China WeChat Vision, Tencent Inc.[2mm] Project page : https://ruixiangzhao.github.io/OmniPro |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53711 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18577