ConFu: Contemplate the Future for Better Speculative Sampling

Zongyue Qin, Raghavv Goel, Mukul Gagrani, Risheek Garrepalli, Mingu Lee, Yizhou Sun · 2026

Read ConFu: Contemplate the Future for Better Speculative Sampling by Zongyue Qin, Raghavv Goel, Mukul Gagrani, Risheek Garrepalli, Mingu Lee, Yizhou Sun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08899.txt.

Description

Zongyue Qin and colleagues help draft models look ahead in speculative decoding. Drafts that see only the current prefix drift from the target over steps as errors pile up. Their ConFu frame adds contemplate tokens and soft prompts for future signals, a dynamic token mechanism with mixture-of-experts, and anchor-token training, beating EAGLE-3 on acceptance and speed.

Catalog record

CREATORZongyue Qin, Raghavv Goel, Mukul Gagrani, Risheek Garrepalli, Mingu Lee, Yizhou Sun
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42861
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08899

Browse the full library · About the Tower of Babel