Laminating Representation Autoencoders for Efficient Diffusion

Ramón Calvo-González, François Fleuret · 2026

Read Laminating Representation Autoencoders for Efficient Diffusion by Ramón Calvo-González, François Fleuret (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04873.txt.

Description

Diffusion models can now generate images direct from the patch features of a self-supervised encoder, but those dense patch grids carry heavy redundancy. Ramón Calvo-González and François Fleuret built FlatDINO, an autoencoder that compresses that representation into a short one-dimensional run of continuous tokens. The squeeze cuts sequence length eightfold and total size far more.

A large diffusion transformer trained on those latents scored well on ImageNet generation while using a fraction of the compute per step of the uncompressed version. The authors are plain that these are preliminary results and the work is in progress. Even so, the savings point to a cheaper route for feature-space diffusion.

Catalog record

CREATORRamón Calvo-González, François Fleuret
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04873

Browse the full library · About the Tower of Babel