RefereeBench: Are Video MLLMs Ready to be Multi-Sport Referees? DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; XX XX–XX, XX; XX, XX ISBN: 978-1-4503-XXXX-X/2018/06 4282 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Computer vision
Yichen Xu, Yuanhang Liu, Chuhan Wang, Zihan Zhao, Jinghan Luo, Jianzhe Ma, Wenxuan Wang, Qin Jin · 2026
Read RefereeBench: Are Video MLLMs Ready to be Multi-Sport Referees? DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; XX XX–XX, XX; XX, XX ISBN: 978-1-4503-XXXX-X/2018/06 4282 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Computer vision by Yichen Xu, Yuanhang Liu, Chuhan Wang, Zihan Zhao, Jinghan Luo, Jianzhe Ma, Wenxuan Wang, Qin Jin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15736.txt.
Description
Xu and seven colleagues test video MLLMs as auto sports refs with RefereeBench, the first big ref test bed. It spans 11 sports, 925 checked videos, and 6,475 Q and A pairs, grading foul spotting, foul and penalty sorts, foul and penalty logic, entity spotting, and time pinning. Even top models land near 60 percent right, and the best open model, Qwen3-VL, hits just 47 percent. Models spot incidents and players well but fumble rule use and time pinning, and cry foul too oft on clean clips.
Catalog record
| CREATOR | Yichen Xu, Yuanhang Liu, Chuhan Wang, Zihan Zhao, Jinghan Luo, Jianzhe Ma, Wenxuan Wang, Qin Jin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56497 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.15736