Pacer : Blockwise Pre-verification for Speculative Decoding with Adaptive Length
Situo Zhang, Yifan Zhang, Zichen Zhu, Hankun Wang, Da Ma, Danyang Zhang, Lu Chen, Kai Yu · 2026
Read Pacer : Blockwise Pre-verification for Speculative Decoding with Adaptive Length by Situo Zhang, Yifan Zhang, Zichen Zhu, Hankun Wang, Da Ma, Danyang Zhang, Lu Chen, Kai Yu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01274.txt.
Description
Situo Zhang and co-authors build PACER, a block-wise pre-check plan that tunes draft length on the fly in speculative decoding. Plain speculative decoding drafts a fixed token count per round, yet the best length swings a lot from step to step. PACER adds a light trainable pre-check layer vetting draft blocks before the big model sees them, halting growth when a block fails. Tests on many model pairs show speedups up to 2.66x over plain decoding, beating standard plans, and pairing with Ouroboros lifts gains further.
Catalog record
| CREATOR | Situo Zhang, Yifan Zhang, Zichen Zhu, Hankun Wang, Da Ma, Danyang Zhang, Lu Chen, Kai Yu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50537 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.01274