Behavior Injection: Preparing Language Models for Reinforcement Learning

Zhepeng Cen, Yihang Yao, William Han, Zuxin Liu, Ding Zhao · 2025

Read Behavior Injection: Preparing Language Models for Reinforcement Learning by Zhepeng Cen, Yihang Yao, William Han, Zuxin Liu, Ding Zhao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18917.txt.

Description

Zhepeng Cen, Yihang Yao, William Han, Zuxin Liu, and Ding Zhao prep chat models for reward-based tuning in a 2025 paper. Such tuning lifts reason skill, yet models reply to it in wild split ways. Some leap, some stall, and some slide back in the runs.

Step maths bare two marks of models that gain: sound first rolls and strong cross-pull of the train data. Their prep seeds the tune data with scout and grind acts ahead of time. That seed makes the model more fit for the tune stage.

Catalog record

CREATORZhepeng Cen, Yihang Yao, William Han, Zuxin Liu, Ding Zhao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18917

Browse the full library · About the Tower of Babel