The Model Knows, the Decoder Finds: Future Value Guided Particle Power Sampling
Tu Nguyen, Matthieu Zimmer, Rasul Tutunov, Xiaotong Ji, Haitham Bou Ammar · 2026
Read The Model Knows, the Decoder Finds: Future Value Guided Particle Power Sampling by Tu Nguyen, Matthieu Zimmer, Rasul Tutunov, Xiaotong Ji, Haitham Bou Ammar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-02427.txt.
Description
Tu Nguyen and four co-authors present a decoding method for language models that needs no new training. Their starting point is that a plain model often gives some chance to correct long answers, but standard decoding may miss them. Power sampling tries to favor those strong paths, yet a prefix that looks weak now may lead to a good ending.
Their method, called APPS, keeps a bounded set of partial answers alive in blocks. At set points, short trial continuations help judge which partial answers should survive, and a learned head can replace those trials in a cheaper variant. The design gives a direct knob, the number of paths kept, for trading accuracy against run time and memory.
Catalog record
| CREATOR | Tu Nguyen, Matthieu Zimmer, Rasul Tutunov, Xiaotong Ji, Haitham Bou Ammar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.02427