Teaching Large Language Models to Reason through Learning and Forgetting
Tianwei Ni, Allen Nie, Sapana Chaudhary, Yao Liu, Huzefa Rangwala, Rasool Fakoor · 2025
Read Teaching Large Language Models to Reason through Learning and Forgetting by Tianwei Ni, Allen Nie, Sapana Chaudhary, Yao Liu, Huzefa Rangwala, Rasool Fakoor (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11364.txt.
Description
Search at answer time makes language models smarter but slow, and Tianwei Ni and co-authors bake the search into the model instead, in work from twenty twenty-five. Training data pairs winning paths from search with failed ones. The model learns from wins and is taught to forget the fails.
Naive tuning can dull the search skill, they warn, but a gentler rate guards it. On two hard number puzzles, success rose by about a fifth over answer-time search, while answer time fell by a huge factor. Their learn-and-forget mix also beat plain fine-tuning and taste-based methods. The trick trades costly run-time search for cheap training-time search.
Catalog record
| CREATOR | Tianwei Ni, Allen Nie, Sapana Chaudhary, Yao Liu, Huzefa Rangwala, Rasool Fakoor |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-11364