Select to Think: Unlocking SLM Potential with Local Sufficiency

Wenxuan Ye, Yangyang Zhang, Xueli An, Georg Carle, Yunpu Ma · 2026

Read Select to Think: Unlocking SLM Potential with Local Sufficiency by Wenxuan Ye, Yangyang Zhang, Xueli An, Georg Carle, Yunpu Ma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26940.txt.

Description

Ye and four colleagues propose Select to Think, turning a large model's role in small-model reasoning from generation to selection. At divergence points, the large model's preferred token often sits in the small model's top candidates, even if not the top pick. S2T-Local distills that selection logic into the small model, letting it re-rank alone without calling the large model at inference time. Top eight small-model candidates hold its choice 95 percent of the time, and S2T-Local beats greedy decoding on math.

Catalog record

CREATORWenxuan Ye, Yangyang Zhang, Xueli An, Georg Carle, Yunpu Ma
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE130347
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.26940

Browse the full library · About the Tower of Babel