VINCIE: Unlocking In-context Image Editing from Video

Leigang Qu Feng Cheng Ziyan Yang Qi Zhao Shanchuan Lin, Yichun Shi Yicong Li Wenjie Wang Tat-Seng Chua Lu Jiang · 2025

Read VINCIE: Unlocking In-context Image Editing from Video by Leigang Qu Feng Cheng Ziyan Yang Qi Zhao Shanchuan Lin, Yichun Shi Yicong Li Wenjie Wang Tat-Seng Chua Lu Jiang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-10941.txt.

Description

Leigang Qu and co-authors teach an image editor new tricks by letting it watch videos. In-context editing changes a picture based on a run of prior images and text, but training data for it usually needs expert pipelines to build. Video, by contrast, already holds long, natural chains of changing scenes.

The team annotates videos as interleaved streams of images and words. A block-causal diffusion transformer then trains on three stand-in tasks: guessing the next image, the current mask, and the next mask. The editor that results tops two multi-turn editing benchmarks. Though raised on video alone, it also composes several concepts in one scene, spins visual stories, and chains edits in sequence. A new benchmark for multi-turn editing comes with the work.

Catalog record

CREATORLeigang Qu Feng Cheng Ziyan Yang Qi Zhao Shanchuan Lin, Yichun Shi Yicong Li Wenjie Wang Tat-Seng Chua Lu Jiang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-10941

Browse the full library · About the Tower of Babel