Learning to Reason from Feedback at Test-Time

Yanyang Li, Michael R. Lyu, Liwei Wang · 2025

Read Learning to Reason from Feedback at Test-Time by Yanyang Li, Michael R. Lyu, Liwei Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15771.txt.

Description

Yanyang Li and co-authors present a 2025 study on how large language models can learn from feedback while they work. Many hard tasks fail on a first try, so a model often needs to react to notes and try again. Older methods either retry with no memory of past tries or fail when tasks grow longer.

The team frames feedback use as a step-by-step tuning problem at test time. They add a small learned tool that guides how the model uses each round of feedback. Tests on two models and four reasoning data sets show better scores and better scaling than older methods. The work points to a clearer way to help models improve from feedback instead of starting over.

Catalog record

CREATORYanyang Li, Michael R. Lyu, Liwei Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-15771

Browse the full library · About the Tower of Babel