CoBA-RL: Capability-Oriented Budget Allocation for Reinforcement Learning in LLMs
Zhiyuan Yao, Yi-Kai Zhang, Yuxin Chen, Yueqing Sun, Zishan Xu, Yu Yang, Tianhao Hu, Qi Gu, Hui Su, Xunliang Cai · 2026
Read CoBA-RL: Capability-Oriented Budget Allocation for Reinforcement Learning in LLMs by Zhiyuan Yao, Yi-Kai Zhang, Yuxin Chen, Yueqing Sun, Zishan Xu, Yu Yang, Tianhao Hu, Qi Gu, Hui Su, Xunliang Cai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03048.txt.
Description
Spending training computation where it helps most is the idea behind a 2026 paper by Zhiyuan Yao and 9 co-authors. Reinforcement learning with verifiable rewards improves language model reasoning. Standard methods give every training example the same rollout budget, wasting effort on examples the model has already mastered or cannot yet use for learning at its current stage.
Their algorithm, CoBA-RL, estimates each task's potential training gain with a capability-oriented value function. A heap-based greedy strategy then allocates rollouts to the highest-value samples and recalibrates as capability evolves. The method explicitly balances exploration against exploitation. Experiments across challenging benchmarks showed consistent generalization improvements. The authors argue that quantifying sample training value is pivotal for efficient post-training of language models.
Catalog record
| CREATOR | Zhiyuan Yao, Yi-Kai Zhang, Yuxin Chen, Yueqing Sun, Zishan Xu, Yu Yang, Tianhao Hu, Qi Gu, Hui Su, Xunliang Cai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-03048