Pacer : Blockwise Pre-verification for Speculative Decoding with Adaptive Length

Situo Zhang, Yifan Zhang, Zichen Zhu, Hankun Wang, Da Ma, Danyang Zhang, Lu Chen, Kai Yu · 2026

Read Pacer : Blockwise Pre-verification for Speculative Decoding with Adaptive Length by Situo Zhang, Yifan Zhang, Zichen Zhu, Hankun Wang, Da Ma, Danyang Zhang, Lu Chen, Kai Yu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01274.txt.

Description

Situo Zhang and co-authors build PACER, a block-wise pre-check plan that tunes draft length on the fly in speculative decoding. Plain speculative decoding drafts a fixed token count per round, yet the best length swings a lot from step to step. PACER adds a light trainable pre-check layer vetting draft blocks before the big model sees them, halting growth when a block fails. Tests on many model pairs show speedups up to 2.66x over plain decoding, beating standard plans, and pairing with Ouroboros lifts gains further.

Catalog record

CREATORSituo Zhang, Yifan Zhang, Zichen Zhu, Hankun Wang, Da Ma, Danyang Zhang, Lu Chen, Kai Yu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50537
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01274

Browse the full library · About the Tower of Babel