DC-AR: Efficient Masked Autoregressive Image Generation with Deep Compression Hybrid Tokenizer

Yecheng Wu, Junyu Chen, Zhuoyang Zhang, Enze Xie, Jincheng Yu, Jinyi Hu, Yao Lu, Song Han, Han Cai · 2025

Read DC-AR: Efficient Masked Autoregressive Image Generation with Deep Compression Hybrid Tokenizer by Yecheng Wu, Junyu Chen, Zhuoyang Zhang, Enze Xie, Jincheng Yu, Jinyi Hu, Yao Lu, Song Han, Han Cai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-04947.txt.

Description

Yecheng Wu and co-authors close the quality gap between autoregressive and diffusion image generators by compressing far harder before generating. Their 2025 paper introduces a hybrid tokenizer that squeezes images thirty-two-fold spatially while keeping reconstruction faithful across resolutions. Prior masked autoregressive models lagged because their tokenizers wasted capacity.

Generation then runs in two passes: discrete tokens lay down the image's structure, and residual tokens refine the details. The result tops its comparison class on standard quality benchmarks while running several times faster, with much lower latency, than leading diffusion and autoregressive rivals. Speed and quality usually trade against each other in image synthesis; this design refuses the trade by fixing the representation first. The authors frame the tokenizer, not the generator, as the bottleneck the field had misdiagnosed. Their cookbook of design choices is offered for reuse.

Catalog record

CREATORYecheng Wu, Junyu Chen, Zhuoyang Zhang, Enze Xie, Jincheng Yu, Jinyi Hu, Yao Lu, Song Han, Han Cai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-04947

Browse the full library · About the Tower of Babel