LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretation
Jiarui Wang 1 , Huiyu Duan 1,2 , Ziheng Jia 1 , Yu Zhao 1 , Woo Yi Yang 1 , Zicheng Zhang 1 , Zijian Chen 1 , Juntong Wang 1 , Yuke Xing 1 , Guangtao Zhai 1,2 , Xiongkuo Min 1 1 Institute of Image Communication and Network Engineering, 2 MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai · 2025
Read LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretation by Jiarui Wang 1 , Huiyu Duan 1,2 , Ziheng Jia 1 , Yu Zhao 1 , Woo Yi Yang 1 , Zicheng Zhang 1 , Zijian Chen 1 , Juntong Wang 1 , Yuke Xing 1 , Guangtao Zhai 1,2 , Xiongkuo Min 1 1 Institute of Image Communication and Network Engineering, 2 MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12098.txt.
Introduction
Jiarui Wang and colleagues build LOVE, a benchmark for AI made video quality, in work from 2025. Text to video tools grow fast, yet their clips still show quality and match flaws. Fair grading needs large human score sets, which past benchmarks lacked at scale.
Their AIGVE-60K set holds over fifty-eight thousand clips from thirty video models. Human scores top one hundred twenty thousand, with sixty thousand question pairs as well. Prompts span twenty fine task types for broad coverage of video skills. The LOVE metric grades clips on looks, text match, and task accuracy jointly. Tests show top grading skill that carries to other video benchmarks.
Catalog record
| CREATOR | Jiarui Wang 1 , Huiyu Duan 1,2 , Ziheng Jia 1 , Yu Zhao 1 , Woo Yi Yang 1 , Zicheng Zhang 1 , Zijian Chen 1 , Juntong Wang 1 , Yuke Xing 1 , Guangtao Zhai 1,2 , Xiongkuo Min 1 1 Institute of Image Communication and Network Engineering, 2 MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 159 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-12098