Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editing

Hao Yang, Zhiyu Tan # \#, Jia Gong, Luozheng Qin, Hesen Chen, Xiaomeng Yang, Yuqing Sun, Yuetan Lin, Mengping Yang *, Hao Li * · 2026

Read Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editing by Hao Yang, Zhiyu Tan # \#, Jia Gong, Luozheng Qin, Hesen Chen, Xiaomeng Yang, Yuqing Sun, Yuetan Lin, Mengping Yang *, Hao Li * (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08820.txt.

Description

Making a video from a written request, or editing one with a plain-language order, is the job of Omni-Video 2. Hao Yang and nine co-authors link a large multimodal model, which reads and reasons about the request, to a video diffusion model that draws the frames. The reader model first writes a clear caption of the target scene, which then guides generation.

A light adapter feeds those guiding signals into a ready-made text-to-video model, reusing its skills at low cost. Scaled to 14 billion parameters, the system handles object removal, additions, background swaps, and tricky motion edits. On the FiVE editing test and the VBench generation test, it follows complex orders better than rivals while matching them on quality.

Catalog record

CREATORHao Yang, Zhiyu Tan # \#, Jia Gong, Luozheng Qin, Hesen Chen, Xiaomeng Yang, Yuqing Sun, Yuetan Lin, Mengping Yang *, Hao Li *
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08820

Browse the full library · About the Tower of Babel