Locality-aware Parallel Decoding for Efficient Autoregressive Image Generation

Zhuoyang Zhang, Luke J. Huang, Chengyue Wu, Shang Yang, Kelly Peng, Song Han, NVIDIA, First Intelligence · 2025

Read Locality-aware Parallel Decoding for Efficient Autoregressive Image Generation by Zhuoyang Zhang, Luke J. Huang, Chengyue Wu, Shang Yang, Kelly Peng, Song Han, NVIDIA, First Intelligence (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01957.txt.

Description

Zhuoyang Zhang and co-authors generate images many patches at a time in a 2025 paper. Classic autoregressive image models predict one patch after another, a slow, memory-bound crawl. Earlier parallel attempts bought little speed before quality slipped.

Two ideas carry their method. A flexible architecture uses learnable query tokens to aim generation at chosen spots, in any order, with co-generated tokens able to see each other. A locality-aware schedule groups patches to lean on nearby context and dodge internal clashes. Steps fell from 256 to twenty at small size, and from 1,024 to forty-eight at larger size. Latency beat prior parallel models by over three times, at matched quality.

Catalog record

CREATORZhuoyang Zhang, Luke J. Huang, Chengyue Wu, Shang Yang, Kelly Peng, Song Han, NVIDIA, First Intelligence
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-01957

Browse the full library · About the Tower of Babel