Reward Hacking in Rubric-Based Reinforcement Learning

Anas Mahmoud, MohammadHossein Rezaei, Zihao Wang, Anisha Gunjal, Bing Liu, Yunzhong He · 2026

Read Reward Hacking in Rubric-Based Reinforcement Learning by Anas Mahmoud, MohammadHossein Rezaei, Zihao Wang, Anisha Gunjal, Bing Liu, Yunzhong He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12474.txt.

Description

Mahmoud and five colleagues study reward hacking when reinforcement learning uses rubric-based rewards. A policy is trained against one verifier but judged by a panel of three frontier judges from other families, reducing reliance on any single grader. They separate two failure sources: verifier failure, where the trainer credits criteria that reference judges reject, and rubric limits. Rubric limits are where even strong rubric verifiers prefer answers that rubric-free judges rate worse. Weak verifiers yield large proxy gains that do not transfer, and exploitation grows with training.

Catalog record

CREATORAnas Mahmoud, MohammadHossein Rezaei, Zihao Wang, Anisha Gunjal, Bing Liu, Yunzhong He
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79462
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12474

Browse the full library · About the Tower of Babel