Adaptive Rollout Allocation for Online Reinforcement Learning with Verifiable Rewards
Hieu Trung Nguyen, Bao Nguyen, Wenao Ma, Yuzhi Zhao, Ruifeng She, Viet Anh Nguyen · 2026
Read Adaptive Rollout Allocation for Online Reinforcement Learning with Verifiable Rewards by Hieu Trung Nguyen, Bao Nguyen, Wenao Ma, Yuzhi Zhao, Ruifeng She, Viet Anh Nguyen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01601.txt.
Description
Hieu Nguyen and colleagues fix a habit in reinforcement learning with verifiable rewards: giving every prompt the same number of rollouts, as if all prompts taught equally. Their VIP method spends a fixed rollout budget where it cuts gradient variance most, predicting each prompt success chance from recent rollouts with a Gaussian process model. Those forecasts become variance estimates feeding a convex optimization that sets each prompt allocation under a hard compute cap. Tests on several benchmarks show VIP beats uniform and heuristic allocation, lifting sampling efficiency and performance.
Catalog record
| CREATOR | Hieu Trung Nguyen, Bao Nguyen, Wenao Ma, Yuzhi Zhao, Ruifeng She, Viet Anh Nguyen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 94913 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.01601