Laminating Representation Autoencoders for Efficient Diffusion
Ramón Calvo-González, François Fleuret · 2026
Read Laminating Representation Autoencoders for Efficient Diffusion by Ramón Calvo-González, François Fleuret (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04873.txt.
Description
Diffusion models can now generate images direct from the patch features of a self-supervised encoder, but those dense patch grids carry heavy redundancy. Ramón Calvo-González and François Fleuret built FlatDINO, an autoencoder that compresses that representation into a short one-dimensional run of continuous tokens. The squeeze cuts sequence length eightfold and total size far more.
A large diffusion transformer trained on those latents scored well on ImageNet generation while using a fraction of the compute per step of the uncompressed version. The authors are plain that these are preliminary results and the work is in progress. Even so, the savings point to a cheaper route for feature-space diffusion.
Catalog record
| CREATOR | Ramón Calvo-González, François Fleuret |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04873