The Model Knows, the Decoder Finds: Future Value Guided Particle Power Sampling

Tu Nguyen, Matthieu Zimmer, Rasul Tutunov, Xiaotong Ji, Haitham Bou Ammar · 2026

Read The Model Knows, the Decoder Finds: Future Value Guided Particle Power Sampling by Tu Nguyen, Matthieu Zimmer, Rasul Tutunov, Xiaotong Ji, Haitham Bou Ammar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-02427.txt.

Description

Tu Nguyen and four co-authors present a decoding method for language models that needs no new training. Their starting point is that a plain model often gives some chance to correct long answers, but standard decoding may miss them. Power sampling tries to favor those strong paths, yet a prefix that looks weak now may lead to a good ending.

Their method, called APPS, keeps a bounded set of partial answers alive in blocks. At set points, short trial continuations help judge which partial answers should survive, and a learned head can replace those trials in a cheaper variant. The design gives a direct knob, the number of paths kept, for trading accuracy against run time and memory.

Catalog record

CREATORTu Nguyen, Matthieu Zimmer, Rasul Tutunov, Xiaotong Ji, Haitham Bou Ammar
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.02427

Browse the full library · About the Tower of Babel