Do We Need Frontier Models to Verify Mathematical Proofs?

Rajeev Alur, Mayur Naik · 2026

Read Do We Need Frontier Models to Verify Mathematical Proofs? by Rajeev Alur, Mayur Naik (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-02450.txt.

Description

Naik and colleagues ask whether frontier models are needed to verify mathematical proofs. Evaluating four open source and two frontier models on human graded competition proofs, they track accuracy and self consistency across repeated judgments. Smaller open models trail frontier models by about 10 percent in accuracy but run about 25 percent more inconsistent. Accuracy stays sensitive to prompt choice. Yet smaller models possess frontier level ability, but struggle to elicit it with general prompts. An LLM guided search builds a specialized ensemble that lifts smaller model accuracy and consistency.

Catalog record

CREATORRajeev Alur, Mayur Naik
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55154
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.02450

Browse the full library · About the Tower of Babel