ConFu: Contemplate the Future for Better Speculative Sampling
Zongyue Qin, Raghavv Goel, Mukul Gagrani, Risheek Garrepalli, Mingu Lee, Yizhou Sun · 2026
Read ConFu: Contemplate the Future for Better Speculative Sampling by Zongyue Qin, Raghavv Goel, Mukul Gagrani, Risheek Garrepalli, Mingu Lee, Yizhou Sun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08899.txt.
Description
Zongyue Qin and colleagues help draft models look ahead in speculative decoding. Drafts that see only the current prefix drift from the target over steps as errors pile up. Their ConFu frame adds contemplate tokens and soft prompts for future signals, a dynamic token mechanism with mixture-of-experts, and anchor-token training, beating EAGLE-3 on acceptance and speed.
Catalog record
| CREATOR | Zongyue Qin, Raghavv Goel, Mukul Gagrani, Risheek Garrepalli, Mingu Lee, Yizhou Sun |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42861 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.08899