Guideline-Grounded Evidence Accumulation for High-Stakes Agent Verification

Yichi Zhang, Nabeel Seedat, Yinpeng Dong, Peng Cui, Jun Zhu, Mihaela van der Schaar · 2026

Read Guideline-Grounded Evidence Accumulation for High-Stakes Agent Verification by Yichi Zhang, Nabeel Seedat, Yinpeng Dong, Peng Cui, Jun Zhu, Mihaela van der Schaar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02798.txt.

Description

Yichi Zhang, Nabeel Seedat, Yinpeng Dong, and colleagues verify AI agents by checking each step against expert rulebooks. Their 2026 framework, GLEAN, targets high-stakes work such as clinical diagnosis, where a wrong agent answer carries real risk. Standard verifiers often lack domain knowledge and give poorly calibrated confidence.

GLEAN compiles expert protocols into step-by-step ratings along the agent's path, then merges those ratings into features. A Bayesian model turns the merged evidence into a calibrated chance of being correct. When doubt stays high, the system actively gathers more evidence by widening guideline coverage and running cross-checks. On diagnosis tasks from a major hospital dataset, it beat the best rival on both accuracy ranking and calibration.

Catalog record

CREATORYichi Zhang, Nabeel Seedat, Yinpeng Dong, Peng Cui, Jun Zhu, Mihaela van der Schaar
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67032
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.02798

Browse the full library · About the Tower of Babel