Teaching Large Language Models to Reason through Learning and Forgetting

Tianwei Ni, Allen Nie, Sapana Chaudhary, Yao Liu, Huzefa Rangwala, Rasool Fakoor · 2025

Read Teaching Large Language Models to Reason through Learning and Forgetting by Tianwei Ni, Allen Nie, Sapana Chaudhary, Yao Liu, Huzefa Rangwala, Rasool Fakoor (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11364.txt.

Description

Search at answer time makes language models smarter but slow, and Tianwei Ni and co-authors bake the search into the model instead, in work from twenty twenty-five. Training data pairs winning paths from search with failed ones. The model learns from wins and is taught to forget the fails.

Naive tuning can dull the search skill, they warn, but a gentler rate guards it. On two hard number puzzles, success rose by about a fifth over answer-time search, while answer time fell by a huge factor. Their learn-and-forget mix also beat plain fine-tuning and taste-based methods. The trick trades costly run-time search for cheap training-time search.

Catalog record

CREATORTianwei Ni, Allen Nie, Sapana Chaudhary, Yao Liu, Huzefa Rangwala, Rasool Fakoor
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-11364

Browse the full library · About the Tower of Babel