Beyond Static Snapshots: A Grounded Evaluation Framework for Language Models at the Agentic Frontier

Jazmia Henry, Stanford HAI, Collide · 2026

Read Beyond Static Snapshots: A Grounded Evaluation Framework for Language Models at the Agentic Frontier by Jazmia Henry, Stanford HAI, Collide (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17573.txt.

Description

Henry argues that tests for large language models fail four ways, making them unfit for agentic systems: distributional, temporal, scope, and process invalidity. These flaws compound in feedback training, turning reward hacking into a predictable outcome of test design, not a freak training flaw. Her framework, Grounded Continuous Evaluation, with ISOPro as reference, swaps the learned reward model for a deterministic verifier and updates adapters on CPU. Across three model families and two task areas, ISOPro posts the largest gains and smallest setbacks versus its rival.

Catalog record

CREATORJazmia Henry, Stanford HAI, Collide
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26443
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17573

Browse the full library · About the Tower of Babel