La T t E - F l o w : Layerwise Timestep-Expert Flow-based Transformer

Ying Shen, Zhiyang Xu, Jiuhai Chen, Shizhe Diao, Jiaxin Zhang, Yuguang Yao Joy Rimchala Ismini Lourentzou Lifu Huang · 2025

Read La T t E - F l o w : Layerwise Timestep-Expert Flow-based Transformer by Ying Shen, Zhiyang Xu, Jiuhai Chen, Shizhe Diao, Jiaxin Zhang, Yuguang Yao Joy Rimchala Ismini Lourentzou Lifu Huang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06952.txt.

Description

Ying Shen and co-authors present, in a 2025 paper, a single AI model that both understands images and creates them, without the usual heavy cost. Unified models promise one system for many vision and language tasks. In practice they need huge pretraining, lag behind specialist models, and generate images slowly. The authors build on a strong pretrained vision-language model to inherit its understanding skills.

Their design, LaTtE-Flow, splits image generation across groups of layers, each handling a slice of the generation timeline. Only a few layers wake at each step, which speeds sampling sharply. A new attention trick reuses information across layers to hold quality. Tests showed strong understanding scores and image quality rivaling rivals, at about six times the generation speed. The authors pitch it for settings where time and computing power are tight.

Catalog record

CREATORYing Shen, Zhiyang Xu, Jiuhai Chen, Shizhe Diao, Jiaxin Zhang, Yuguang Yao Joy Rimchala Ismini Lourentzou Lifu Huang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-06952

Browse the full library · About the Tower of Babel