Masked Autoencoders Are Effective Tokenizers for Diffusion Models
Hao Chen ∗, Yujin Han ∗, Fangyi Chen, Xiang Li, Yidong Wang, Jindong Wang, Ze Wang, Zicheng Liu, Difan Zou, Bhiksha Raj · 2025
Read Masked Autoencoders Are Effective Tokenizers for Diffusion Models by Hao Chen ∗, Yujin Han ∗, Fangyi Chen, Xiang Li, Yidong Wang, Jindong Wang, Ze Wang, Zicheng Liu, Difan Zou, Bhiksha Raj (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03444.txt.
Description
A team of ten authors proposes MAETok in 2025, a tokenizer that gives diffusion image models a better latent space to work in. Latent traits, more than strict rules on their form, may drive image quality. Tests link good output to latent clouds with fewer clumps and sharper class cues.
MAETok learns through mask modeling, which packs meaning into the latent codes while keeping rebuild quality high. On ImageNet it hit top scores with just 128 tokens per image. Training ran 76 times faster and output 31 times faster than rivals at large size, the team reports.
Catalog record
| CREATOR | Hao Chen ∗, Yujin Han ∗, Fangyi Chen, Xiang Li, Yidong Wang, Jindong Wang, Ze Wang, Zicheng Liu, Difan Zou, Bhiksha Raj |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-03444