Do We Need Frontier Models to Verify Mathematical Proofs?
Rajeev Alur, Mayur Naik · 2026
Read Do We Need Frontier Models to Verify Mathematical Proofs? by Rajeev Alur, Mayur Naik (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-02450.txt.
Description
Naik and colleagues ask whether frontier models are needed to verify mathematical proofs. Evaluating four open source and two frontier models on human graded competition proofs, they track accuracy and self consistency across repeated judgments. Smaller open models trail frontier models by about 10 percent in accuracy but run about 25 percent more inconsistent. Accuracy stays sensitive to prompt choice. Yet smaller models possess frontier level ability, but struggle to elicit it with general prompts. An LLM guided search builds a specialized ensemble that lifts smaller model accuracy and consistency.
Catalog record
| CREATOR | Rajeev Alur, Mayur Naik |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55154 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.02450