LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretation

Jiarui Wang 1 , Huiyu Duan 1,2 , Ziheng Jia 1 , Yu Zhao 1 , Woo Yi Yang 1 , Zicheng Zhang 1 , Zijian Chen 1 , Juntong Wang 1 , Yuke Xing 1 , Guangtao Zhai 1,2 , Xiongkuo Min 1 1 Institute of Image Communication and Network Engineering, 2 MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai · 2025

Read LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretation by Jiarui Wang 1 , Huiyu Duan 1,2 , Ziheng Jia 1 , Yu Zhao 1 , Woo Yi Yang 1 , Zicheng Zhang 1 , Zijian Chen 1 , Juntong Wang 1 , Yuke Xing 1 , Guangtao Zhai 1,2 , Xiongkuo Min 1 1 Institute of Image Communication and Network Engineering, 2 MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12098.txt.

Introduction

Jiarui Wang and colleagues build LOVE, a benchmark for AI made video quality, in work from 2025. Text to video tools grow fast, yet their clips still show quality and match flaws. Fair grading needs large human score sets, which past benchmarks lacked at scale.

Their AIGVE-60K set holds over fifty-eight thousand clips from thirty video models. Human scores top one hundred twenty thousand, with sixty thousand question pairs as well. Prompts span twenty fine task types for broad coverage of video skills. The LOVE metric grades clips on looks, text match, and task accuracy jointly. Tests show top grading skill that carries to other video benchmarks.

Catalog record

CREATORJiarui Wang 1 , Huiyu Duan 1,2 , Ziheng Jia 1 , Yu Zhao 1 , Woo Yi Yang 1 , Zicheng Zhang 1 , Zijian Chen 1 , Juntong Wang 1 , Yuke Xing 1 , Guangtao Zhai 1,2 , Xiongkuo Min 1 1 Institute of Image Communication and Network Engineering, 2 MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE159 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-12098

Browse the full library · About the Tower of Babel