RC-GRPO: Reward-Conditioned Group Relative Policy Optimization for Multi-Turn Tool Calling Agents
Haitian Zhong, Jixiu Zhai, Lei Song, Jiang Bian, Qiang Liu, Tieniu Tan · 2026
Read RC-GRPO: Reward-Conditioned Group Relative Policy Optimization for Multi-Turn Tool Calling Agents by Haitian Zhong, Jixiu Zhai, Lei Song, Jiang Bian, Qiang Liu, Tieniu Tan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03025.txt.
Description
Tool-calling agents that stall during training are the problem for Haitian Zhong and 5 co-authors in a 2026 paper. In multi-turn tool use, rewards are sparse and exploration is costly. A standard recipe can stall when every rollout in a group scores all zero or all one, leaving no useful learning signal.
Their method, RC-GRPO, steers exploration with discrete reward tokens placed in the prompt. A first policy learns to produce trajectories of distinct quality on demand. During reinforcement learning, varied reward tokens diversify each group. Tests on a Berkeley function-calling benchmark followed. Performance improved consistently, and one setup surpassed all closed-source models tested.
Catalog record
| CREATOR | Haitian Zhong, Jixiu Zhai, Lei Song, Jiang Bian, Qiang Liu, Tieniu Tan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-03025