Learning to Reason from Feedback at Test-Time
Yanyang Li, Michael R. Lyu, Liwei Wang · 2025
Read Learning to Reason from Feedback at Test-Time by Yanyang Li, Michael R. Lyu, Liwei Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15771.txt.
Description
Yanyang Li and co-authors present a 2025 study on how large language models can learn from feedback while they work. Many hard tasks fail on a first try, so a model often needs to react to notes and try again. Older methods either retry with no memory of past tries or fail when tasks grow longer.
The team frames feedback use as a step-by-step tuning problem at test time. They add a small learned tool that guides how the model uses each round of feedback. Tests on two models and four reasoning data sets show better scores and better scaling than older methods. The work points to a clearer way to help models improve from feedback instead of starting over.
Catalog record
| CREATOR | Yanyang Li, Michael R. Lyu, Liwei Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-15771