TAP: A Token-Adaptive Predictor Framework for Training-Free Diffusion Acceleration
Haowei Zhu, Tingxuan Huang, Xing Wang, Tianyu Zhao, Jiexi Wang, Weifeng Chen, Xurui Peng, Fangmin Chen, Junhai Yong, Bin Wang · 2026
Read TAP: A Token-Adaptive Predictor Framework for Training-Free Diffusion Acceleration by Haowei Zhu, Tingxuan Huang, Xing Wang, Tianyu Zhao, Jiexi Wang, Weifeng Chen, Xurui Peng, Fangmin Chen, Junhai Yong, Bin Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03792.txt.
Description
Haowei Zhu and nine colleagues speed up diffusion image generation by letting every token pick its own shortcut. Diffusion models are slow because each sampling step re-runs the whole network. Predictors can forecast a token's trajectory and skip work, but one fixed predictor fits all tokens badly. Their 2026 framework, TAP, chooses per token and per step, with no retraining at all.
A single full pass through the model's first layer acts as a cheap probe. From it, proxy errors are computed for a small family of candidate predictors, mostly Taylor expansions of varying order and horizon. Each token then gets whichever predictor the probe rated best for it. The overhead is negligible, the speedups large, and perceptual quality barely moves. Across architectures and tasks, TAP beats fixed global predictors and caching-only baselines on the accuracy-efficiency frontier.
Catalog record
| CREATOR | Haowei Zhu, Tingxuan Huang, Xing Wang, Tianyu Zhao, Jiexi Wang, Weifeng Chen, Xurui Peng, Fangmin Chen, Junhai Yong, Bin Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52225 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.03792