UVE: Are MLLMs Unified Evaluators for AI-Generated Videos?
Yuanxin Liu, Rui Zhu, Shuhuai Ren, Jiacong Wang, Haoyuan Guo, Xu Sun, Lu Jiang · 2025
Read UVE: Are MLLMs Unified Evaluators for AI-Generated Videos? by Yuanxin Liu, Rui Zhu, Shuhuai Ren, Jiacong Wang, Haoyuan Guo, Xu Sun, Lu Jiang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-09949.txt.
Description
Yuanxin Liu and six co-authors ask whether big AI models can judge AI-made videos in a 2025 paper. Video generators improve monthly, and scoring their output by hand does not scale. Older automatic scores were built for other jobs or trained narrowly on one trait.
The team built a benchmark of generated videos with human preference labels across fifteen traits, from realism to motion quality. They then tested eighteen large models that see and read. The best models still trail human judges, but they clearly beat the older specialized scorers. The largest models did best. The paper also probes which design choices matter most when a model is used as a judge. The findings support one generalist judge over many narrow ones, while marking how far the approach still has to go.
Catalog record
| CREATOR | Yuanxin Liu, Rui Zhu, Shuhuai Ren, Jiacong Wang, Haoyuan Guo, Xu Sun, Lu Jiang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-09949