V In O : A Unified V isual Generator with In terleaved O mniModal Context

Junyi Chen, Tong He, Zhoujie Fu, Pengfei Wan, Kun Gai, Weicai Ye · 2026

Read V In O : A Unified V isual Generator with In terleaved O mniModal Context by Junyi Chen, Tong He, Zhoujie Fu, Pengfei Wan, Kun Gai, Weicai Ye (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-02358.txt.

Description

Junyi Chen and five co authors present VINO, a single model that can generate and edit both images and video. Most tools use a separate model or module for each task and each kind of input. VINO instead feeds text, images, and video into one shared diffusion backbone as an interleaved stream of conditioning tokens from a vision language model.

That shared design supports grounding in several reference images, following long instructions, and keeping a subject's identity steady across still and moving content. Training proceeds in stages, growing a video generation base model into a multi task system that takes images and video in and out. Across generation and editing benchmarks the unified model performs strongly without any task specific parts.

Catalog record

CREATORJunyi Chen, Tong He, Zhoujie Fu, Pengfei Wan, Kun Gai, Weicai Ye
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-02358

Browse the full library · About the Tower of Babel