Reinforcing Thinking through Reasoning-Enhanced Reward Models
Diji Yang, Linda Zeng, Kezhen Chen, Yi Zhang · 2025
Read Reinforcing Thinking through Reasoning-Enhanced Reward Models by Diji Yang, Linda Zeng, Kezhen Chen, Yi Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01457.txt.
Description
Diji Yang, Linda Zeng, Kezhen Chen, and Yi Zhang improve the thinking of large language models with outside feedback, in work from twenty twenty-four. Long chains of thought can drift or clash, most of all near what a model knows. Letting a model grade itself tends to repeat its own bias.
Their frame first gathers traces of the model's behavior, then trains a small outside critic. At run time, the critic flags suspect steps and makes the model drop weak paths and try new ones. The base model itself stays unchanged. Tests on reasoning tasks beat self critique methods by a clear margin. The critic is light and needs no hand labels, so the plan scales well.
Catalog record
| CREATOR | Diji Yang, Linda Zeng, Kezhen Chen, Yi Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-01457