CoBA-RL: Capability-Oriented Budget Allocation for Reinforcement Learning in LLMs

Zhiyuan Yao, Yi-Kai Zhang, Yuxin Chen, Yueqing Sun, Zishan Xu, Yu Yang, Tianhao Hu, Qi Gu, Hui Su, Xunliang Cai · 2026

Read CoBA-RL: Capability-Oriented Budget Allocation for Reinforcement Learning in LLMs by Zhiyuan Yao, Yi-Kai Zhang, Yuxin Chen, Yueqing Sun, Zishan Xu, Yu Yang, Tianhao Hu, Qi Gu, Hui Su, Xunliang Cai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03048.txt.

Description

Spending training computation where it helps most is the idea behind a 2026 paper by Zhiyuan Yao and 9 co-authors. Reinforcement learning with verifiable rewards improves language model reasoning. Standard methods give every training example the same rollout budget, wasting effort on examples the model has already mastered or cannot yet use for learning at its current stage.

Their algorithm, CoBA-RL, estimates each task's potential training gain with a capability-oriented value function. A heap-based greedy strategy then allocates rollouts to the highest-value samples and recalibrates as capability evolves. The method explicitly balances exploration against exploitation. Experiments across challenging benchmarks showed consistent generalization improvements. The authors argue that quantifying sample training value is pivotal for efficient post-training of language models.

Catalog record

CREATORZhiyuan Yao, Yi-Kai Zhang, Yuxin Chen, Yueqing Sun, Zishan Xu, Yu Yang, Tianhao Hu, Qi Gu, Hui Su, Xunliang Cai
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03048

Browse the full library · About the Tower of Babel