Agentic Proving for Program Verification

Alessandro Sosso, Akhil Arora, Bas Spitters · 2026

Read Agentic Proving for Program Verification by Alessandro Sosso, Akhil Arora, Bas Spitters (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23772.txt.

Description

Sosso and colleagues test Claude Code on CLEVER, a Lean 4 benchmark for verifiable code making. Claude makes valid specifications for 98.8 percent of problems, with 81.3 percent also passed by CLEVER's isomorphism scoring. It checks code against specifications for 87.5 percent of problems, and reaches 98.1 percent success on the end-to-end pipeline over entries with consistent inputs. Across all stages, Claude gives feedback, spotting causes of failure and old bugs. The findings highlight a mismatch between existing benchmarks and modern agentic provers, calling for rigorous, bug-resilient methods.

Catalog record

CREATORAlessandro Sosso, Akhil Arora, Bas Spitters
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58470
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.23772

Browse the full library · About the Tower of Babel