Rethinking Discrete Tokens: Treating Them as Conditions for Continuous Autoregressive Image Synthesis

Peng Zheng, Junke Wang, Yi Chang, Yizhou Yu, Rui Ma, Zuxuan Wu · 2025

Read Rethinking Discrete Tokens: Treating Them as Conditions for Continuous Autoregressive Image Synthesis by Peng Zheng, Junke Wang, Yi Chang, Yizhou Yu, Rui Ma, Zuxuan Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01756.txt.

Description

Peng Zheng and five co-authors reframed in 2025 how image generators use discrete tokens. Squeezing pictures into token codes loses detail, while predicting smooth continuous values risks drifting off the map of real images. Their model, DisCon, keeps tokens but demotes them: tokens become the condition, and the model predicts the continuous picture given them.

That swap keeps the structure of language-style generation while dodging the worst losses of both camps. Benchmarks test whether pictures stay sharp and plausible. The work nudges image synthesis toward hybrids that borrow language models' discipline without their blur.

Catalog record

CREATORPeng Zheng, Junke Wang, Yi Chang, Yizhou Yu, Rui Ma, Zuxuan Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-01756

Browse the full library · About the Tower of Babel