Reinforcing Thinking through Reasoning-Enhanced Reward Models

Diji Yang, Linda Zeng, Kezhen Chen, Yi Zhang · 2025

Read Reinforcing Thinking through Reasoning-Enhanced Reward Models by Diji Yang, Linda Zeng, Kezhen Chen, Yi Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01457.txt.

Description

Diji Yang, Linda Zeng, Kezhen Chen, and Yi Zhang improve the thinking of large language models with outside feedback, in work from twenty twenty-four. Long chains of thought can drift or clash, most of all near what a model knows. Letting a model grade itself tends to repeat its own bias.

Their frame first gathers traces of the model's behavior, then trains a small outside critic. At run time, the critic flags suspect steps and makes the model drop weak paths and try new ones. The base model itself stays unchanged. Tests on reasoning tasks beat self critique methods by a clear margin. The critic is light and needs no hand labels, so the plan scales well.

Catalog record

CREATORDiji Yang, Linda Zeng, Kezhen Chen, Yi Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-01457

Browse the full library · About the Tower of Babel