LVOmniBench : Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMs
Keda Tao 1,2,3, † \dagger Yuhua Zheng 1,2, † , ‡ \dagger,\ddagger Jia Xu 2, ‡ \ddagger, Wenjie Du 2, ‡ \ddagger Kele Shao 1,4,2 Hesong Wang 1,2 Xueyi Chen 2 Xin Jin 2, Junhan Zhu 2, ‡ \ddagger Bohan Yu 3 Weiqiang Wang 3 Jian Liu 3 Can Qin 5, Yulun Zhang 6 Ming-Hsuan Yang 7 Huan Wang 2, ⋆ \star, 1 Zhejiang University 2 Westlake University 3 Ant Group, 4 Shanghai Innovation Institute 5 Independent Researcher, 6 Shanghai Jiao Tong University 7 University of California Merced · 2026
Read LVOmniBench : Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMs by Keda Tao 1,2,3, † \dagger Yuhua Zheng 1,2, † , ‡ \dagger,\ddagger Jia Xu 2, ‡ \ddagger, Wenjie Du 2, ‡ \ddagger Kele Shao 1,4,2 Hesong Wang 1,2 Xueyi Chen 2 Xin Jin 2, Junhan Zhu 2, ‡ \ddagger Bohan Yu 3 Weiqiang Wang 3 Jian Liu 3 Can Qin 5, Yulun Zhang 6 Ming-Hsuan Yang 7 Huan Wang 2, ⋆ \star, 1 Zhejiang University 2 Westlake University 3 Ant Group, 4 Shanghai Innovation Institute 5 Independent Researcher, 6 Shanghai Jiao Tong University 7 University of California Merced (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19217.txt.
Description
Tao and co-authors build a benchmark for models that must grasp long audio and video together. Current tests use clips of a few minutes, but real videos run far longer. Their LVOmniBench holds 275 videos of 10 to 90 minutes and 1,014 questions. It tests long memory, time spotting, fine detail, and cross-modal sense. Open models score below 35 percent on the tasks. The best closed model reaches about 65 percent. The gap shows how hard long media still is.
Catalog record
| CREATOR | Keda Tao 1,2,3, † \dagger Yuhua Zheng 1,2, † , ‡ \dagger,\ddagger Jia Xu 2, ‡ \ddagger, Wenjie Du 2, ‡ \ddagger Kele Shao 1,4,2 Hesong Wang 1,2 Xueyi Chen 2 Xin Jin 2, Junhan Zhu 2, ‡ \ddagger Bohan Yu 3 Weiqiang Wang 3 Jian Liu 3 Can Qin 5, Yulun Zhang 6 Ming-Hsuan Yang 7 Huan Wang 2, ⋆ \star, 1 Zhejiang University 2 Westlake University 3 Ant Group, 4 Shanghai Innovation Institute 5 Independent Researcher, 6 Shanghai Jiao Tong University 7 University of California Merced |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42783 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.19217