FormalRewardBench: A Benchmark for Formal Theorem Proving Reward Models
Zeynel A. Ulusan, Burak S. Akbudak, Can S. Erer, Gözde Gül Şahin · 2026
Read FormalRewardBench: A Benchmark for Formal Theorem Proving Reward Models by Zeynel A. Ulusan, Burak S. Akbudak, Can S. Erer, Gözde Gül Şahin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10141.txt.
Description
Ulusan and three colleagues introduce FormalRewardBench, the first benchmark for judging reward models in formal theorem proving with Lean 4. Neural provers trained by reinforcement learning with verifiable rewards get only binary correctness signals, so partial progress on hard problems earns nothing, a sparse credit assignment problem. Learned reward models could grade proof quality beyond pass or fail, but comparing them has required expensive training ablations.
The benchmark holds 250 preference pairs. Each pairs a correct proof with an incorrect variant made by one of five expert error injections: forced mistakes, minimal single-point variations, verbose incorrect proofs, natural-language justifications, and Python code injection. Frontier language models scored highest at 59.8 percent, while specialised theorem provers scored worst at 24.4 percent, suggesting that proving skill does not transfer to proof evaluation. The benchmark is released for further work.
Catalog record
| CREATOR | Zeynel A. Ulusan, Burak S. Akbudak, Can S. Erer, Gözde Gül Şahin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10141