RC-GRPO: Reward-Conditioned Group Relative Policy Optimization for Multi-Turn Tool Calling Agents

Haitian Zhong, Jixiu Zhai, Lei Song, Jiang Bian, Qiang Liu, Tieniu Tan · 2026

Read RC-GRPO: Reward-Conditioned Group Relative Policy Optimization for Multi-Turn Tool Calling Agents by Haitian Zhong, Jixiu Zhai, Lei Song, Jiang Bian, Qiang Liu, Tieniu Tan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03025.txt.

Description

Tool-calling agents that stall during training are the problem for Haitian Zhong and 5 co-authors in a 2026 paper. In multi-turn tool use, rewards are sparse and exploration is costly. A standard recipe can stall when every rollout in a group scores all zero or all one, leaving no useful learning signal.

Their method, RC-GRPO, steers exploration with discrete reward tokens placed in the prompt. A first policy learns to produce trajectories of distinct quality on demand. During reinforcement learning, varied reward tokens diversify each group. Tests on a Berkeley function-calling benchmark followed. Performance improved consistently, and one setup surpassed all closed-source models tested.

Catalog record

CREATORHaitian Zhong, Jixiu Zhai, Lei Song, Jiang Bian, Qiang Liu, Tieniu Tan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03025

Browse the full library · About the Tower of Babel