RefereeBench: Are Video MLLMs Ready to be Multi-Sport Referees? DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; XX XX–XX, XX; XX, XX ISBN: 978-1-4503-XXXX-X/2018/06 4282 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Computer vision

Yichen Xu, Yuanhang Liu, Chuhan Wang, Zihan Zhao, Jinghan Luo, Jianzhe Ma, Wenxuan Wang, Qin Jin · 2026

Read RefereeBench: Are Video MLLMs Ready to be Multi-Sport Referees? DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; XX XX–XX, XX; XX, XX ISBN: 978-1-4503-XXXX-X/2018/06 4282 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Computer vision by Yichen Xu, Yuanhang Liu, Chuhan Wang, Zihan Zhao, Jinghan Luo, Jianzhe Ma, Wenxuan Wang, Qin Jin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15736.txt.

Description

Xu and seven colleagues test video MLLMs as auto sports refs with RefereeBench, the first big ref test bed. It spans 11 sports, 925 checked videos, and 6,475 Q and A pairs, grading foul spotting, foul and penalty sorts, foul and penalty logic, entity spotting, and time pinning. Even top models land near 60 percent right, and the best open model, Qwen3-VL, hits just 47 percent. Models spot incidents and players well but fumble rule use and time pinning, and cry foul too oft on clean clips.

Catalog record

CREATORYichen Xu, Yuanhang Liu, Chuhan Wang, Zihan Zhao, Jinghan Luo, Jianzhe Ma, Wenxuan Wang, Qin Jin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56497
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.15736

Browse the full library · About the Tower of Babel