Guiding Reasoning in Small Language Models with LLM Assistance
Yujin Kim, Euiin Yi, Minu Kim, Se-Young Yun, Taehyeon Kim · 2025
Read Guiding Reasoning in Small Language Models with LLM Assistance by Yujin Kim, Euiin Yi, Minu Kim, Se-Young Yun, Taehyeon Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-09923.txt.
Description
Yujin Kim and co-authors help small language models reason with hints from big ones in a 2025 paper. Small models are cheap and fast but falter on problems needing long chains of logic. Calling a large model for every step wastes the savings. Their framework, SMART, watches the small model's work and steps in only where it looks shaky.
A scoring pass flags the uncertain steps in a draft solution. Only those steps get corrective reasoning from the large model, like scaffolding placed just where a builder wobbles. The search for a good reasoning path is framed as finding an optimal policy, which steers the chain toward right answers without brute-force sampling. On math reasoning sets, the targeted help lifted scores sharply, opening tasks the small models could not solve alone.
Catalog record
| CREATOR | Yujin Kim, Euiin Yi, Minu Kim, Se-Young Yun, Taehyeon Kim |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-09923