Rethinking Discrete Tokens: Treating Them as Conditions for Continuous Autoregressive Image Synthesis
Peng Zheng, Junke Wang, Yi Chang, Yizhou Yu, Rui Ma, Zuxuan Wu · 2025
Read Rethinking Discrete Tokens: Treating Them as Conditions for Continuous Autoregressive Image Synthesis by Peng Zheng, Junke Wang, Yi Chang, Yizhou Yu, Rui Ma, Zuxuan Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01756.txt.
Description
Peng Zheng and five co-authors reframed in 2025 how image generators use discrete tokens. Squeezing pictures into token codes loses detail, while predicting smooth continuous values risks drifting off the map of real images. Their model, DisCon, keeps tokens but demotes them: tokens become the condition, and the model predicts the continuous picture given them.
That swap keeps the structure of language-style generation while dodging the worst losses of both camps. Benchmarks test whether pictures stay sharp and plausible. The work nudges image synthesis toward hybrids that borrow language models' discipline without their blur.
Catalog record
| CREATOR | Peng Zheng, Junke Wang, Yi Chang, Yizhou Yu, Rui Ma, Zuxuan Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-01756