Optimus: Elastic Decoding for Efficient Diffusion LLM Serving DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 123-A56-BU3

Chiyue Wei, Cong Guo, Bowen Duan, Junyao Zhang, Haoxuan Shan, Yifei Wang, Yangjie Zhou, Hai “Helen” Li, Danyang Zhuo, Yiran Chen · 2026

Read Optimus: Elastic Decoding for Efficient Diffusion LLM Serving DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 123-A56-BU3 by Chiyue Wei, Cong Guo, Bowen Duan, Junyao Zhang, Haoxuan Shan, Yifei Wang, Yangjie Zhou, Hai “Helen” Li, Danyang Zhuo, Yiran Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24832.txt.

Description

Chiyue Wei and co-authors present Optimus, an elastic decoding system for diffusion model serving. Autoregressive decoding wastes GPUs through one-by-one execution, while diffusion models decode several tokens per iteration for speed. Fixed block-size diffusion decoding shifts with load: large blocks use idle GPUs at low load but saturate with wasted computation at high load. Optimus treats decoding granularity as a runtime control, trading GPU use for token efficiency. Chunked decoding enables fine execution without new training, while load-aware scheduling picks chunk sizes from runtime.

Catalog record

CREATORChiyue Wei, Cong Guo, Bowen Duan, Junyao Zhang, Haoxuan Shan, Yifei Wang, Yangjie Zhou, Hai “Helen” Li, Danyang Zhuo, Yiran Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56968
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.24832

Browse the full library · About the Tower of Babel