Optimus: Elastic Decoding for Efficient Diffusion LLM Serving DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 123-A56-BU3
Chiyue Wei, Cong Guo, Bowen Duan, Junyao Zhang, Haoxuan Shan, Yifei Wang, Yangjie Zhou, Hai “Helen” Li, Danyang Zhuo, Yiran Chen · 2026
Read Optimus: Elastic Decoding for Efficient Diffusion LLM Serving DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 123-A56-BU3 by Chiyue Wei, Cong Guo, Bowen Duan, Junyao Zhang, Haoxuan Shan, Yifei Wang, Yangjie Zhou, Hai “Helen” Li, Danyang Zhuo, Yiran Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24832.txt.
Description
Chiyue Wei and co-authors present Optimus, an elastic decoding system for diffusion model serving. Autoregressive decoding wastes GPUs through one-by-one execution, while diffusion models decode several tokens per iteration for speed. Fixed block-size diffusion decoding shifts with load: large blocks use idle GPUs at low load but saturate with wasted computation at high load. Optimus treats decoding granularity as a runtime control, trading GPU use for token efficiency. Chunked decoding enables fine execution without new training, while load-aware scheduling picks chunk sizes from runtime.
Catalog record
| CREATOR | Chiyue Wei, Cong Guo, Bowen Duan, Junyao Zhang, Haoxuan Shan, Yifei Wang, Yangjie Zhou, Hai “Helen” Li, Danyang Zhuo, Yiran Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56968 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.24832