VeruSAGE: A Study of Agent-Based Verification for Rust Systems

Chenyuan Yang, Natalie Neamtu, Chris Hawblitzel, Jacob R. Lorch, Shan Lu, [1.5ex] University of Illinois Urbana-Champaign Carnegie Mellon University · 2025

Read VeruSAGE: A Study of Agent-Based Verification for Rust Systems by Chenyuan Yang, Natalie Neamtu, Chris Hawblitzel, Jacob R. Lorch, Shan Lu, [1.5ex] University of Illinois Urbana-Champaign Carnegie Mellon University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-18436.txt.

Description

Chenyuan Yang and four co-authors test whether large language models can prove that system software is correct. Their paper, posted to arXiv in December 2025, focuses on programs written in Rust and checked with the Verus verifier. They built VeruSAGE-Bench, a benchmark of 849 proof tasks drawn from eight open-source verified Rust systems.

The team paired different models, including GPT-5 and Sonnet 4.5, with agent setups tuned to each model's strengths. The best pairing finished over 80 percent of the benchmark tasks. It also solved over 90 percent of a separate set of proof tasks that human experts had not yet finished. The study suggests AI agents could take on much of the proof work in verified software.

Catalog record

CREATORChenyuan Yang, Natalie Neamtu, Chris Hawblitzel, Jacob R. Lorch, Shan Lu, [1.5ex] University of Illinois Urbana-Champaign Carnegie Mellon University
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-18436

Browse the full library · About the Tower of Babel