Guiding Reasoning in Small Language Models with LLM Assistance

Yujin Kim, Euiin Yi, Minu Kim, Se-Young Yun, Taehyeon Kim · 2025

Read Guiding Reasoning in Small Language Models with LLM Assistance by Yujin Kim, Euiin Yi, Minu Kim, Se-Young Yun, Taehyeon Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-09923.txt.

Description

Yujin Kim and co-authors help small language models reason with hints from big ones in a 2025 paper. Small models are cheap and fast but falter on problems needing long chains of logic. Calling a large model for every step wastes the savings. Their framework, SMART, watches the small model's work and steps in only where it looks shaky.

A scoring pass flags the uncertain steps in a draft solution. Only those steps get corrective reasoning from the large model, like scaffolding placed just where a builder wobbles. The search for a good reasoning path is framed as finding an optimal policy, which steers the chain toward right answers without brute-force sampling. On math reasoning sets, the targeted help lifted scores sharply, opening tasks the small models could not solve alone.

Catalog record

CREATORYujin Kim, Euiin Yi, Minu Kim, Se-Young Yun, Taehyeon Kim
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-09923

Browse the full library · About the Tower of Babel