Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editing
Hao Yang, Zhiyu Tan # \#, Jia Gong, Luozheng Qin, Hesen Chen, Xiaomeng Yang, Yuqing Sun, Yuetan Lin, Mengping Yang *, Hao Li * · 2026
Read Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editing by Hao Yang, Zhiyu Tan # \#, Jia Gong, Luozheng Qin, Hesen Chen, Xiaomeng Yang, Yuqing Sun, Yuetan Lin, Mengping Yang *, Hao Li * (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08820.txt.
Description
Making a video from a written request, or editing one with a plain-language order, is the job of Omni-Video 2. Hao Yang and nine co-authors link a large multimodal model, which reads and reasons about the request, to a video diffusion model that draws the frames. The reader model first writes a clear caption of the target scene, which then guides generation.
A light adapter feeds those guiding signals into a ready-made text-to-video model, reusing its skills at low cost. Scaled to 14 billion parameters, the system handles object removal, additions, background swaps, and tricky motion edits. On the FiVE editing test and the VBench generation test, it follows complex orders better than rivals while matching them on quality.
Catalog record
| CREATOR | Hao Yang, Zhiyu Tan # \#, Jia Gong, Luozheng Qin, Hesen Chen, Xiaomeng Yang, Yuqing Sun, Yuetan Lin, Mengping Yang *, Hao Li * |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-08820