Locality-aware Parallel Decoding for Efficient Autoregressive Image Generation
Zhuoyang Zhang, Luke J. Huang, Chengyue Wu, Shang Yang, Kelly Peng, Song Han, NVIDIA, First Intelligence · 2025
Read Locality-aware Parallel Decoding for Efficient Autoregressive Image Generation by Zhuoyang Zhang, Luke J. Huang, Chengyue Wu, Shang Yang, Kelly Peng, Song Han, NVIDIA, First Intelligence (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01957.txt.
Description
Zhuoyang Zhang and co-authors generate images many patches at a time in a 2025 paper. Classic autoregressive image models predict one patch after another, a slow, memory-bound crawl. Earlier parallel attempts bought little speed before quality slipped.
Two ideas carry their method. A flexible architecture uses learnable query tokens to aim generation at chosen spots, in any order, with co-generated tokens able to see each other. A locality-aware schedule groups patches to lean on nearby context and dodge internal clashes. Steps fell from 256 to twenty at small size, and from 1,024 to forty-eight at larger size. Latency beat prior parallel models by over three times, at matched quality.
Catalog record
| CREATOR | Zhuoyang Zhang, Luke J. Huang, Chengyue Wu, Shang Yang, Kelly Peng, Song Han, NVIDIA, First Intelligence |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-01957