WorldJen : An End-to-End Multi-Dimensional Benchmark for Generative Video Models
Karthik Inbasekar Guy Rom Omer Shlomovits moonmath.ai · 2026
Read WorldJen : An End-to-End Multi-Dimensional Benchmark for Generative Video Models by Karthik Inbasekar Guy Rom Omer Shlomovits moonmath.ai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03475.txt.
Description
Inbasekar and two colleagues offer a tougher way to grade AI-made video. Reference-based scores reward pixel fidelity over sense, while distribution scores reward texture over physical plausibility, and yes-or-no question benchmarks lean toward yes and use low-resolution judges that miss failures over time. WorldJen replaces binary questions with Likert-scale questionnaires, graded by a vision-language model fed frames at native resolution, and uses adversarial prompts that probe up to sixteen quality dimensions at once.
A blind human study of nearly twenty-seven hundred pairwise judgments over fifty prompts and six leading models sets a three-tier ground-truth ranking, and the automated judge reproduces that tier structure independently. Six ablations check the framework's robustness. By testing many dimensions per video instead of one, WorldJen cuts the cost of reliable evaluation while catching temporal failures that older benchmarks overlook.
Catalog record
| CREATOR | Karthik Inbasekar Guy Rom Omer Shlomovits moonmath.ai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 153 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.03475