Guideline-Grounded Evidence Accumulation for High-Stakes Agent Verification
Yichi Zhang, Nabeel Seedat, Yinpeng Dong, Peng Cui, Jun Zhu, Mihaela van der Schaar · 2026
Read Guideline-Grounded Evidence Accumulation for High-Stakes Agent Verification by Yichi Zhang, Nabeel Seedat, Yinpeng Dong, Peng Cui, Jun Zhu, Mihaela van der Schaar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02798.txt.
Description
Yichi Zhang, Nabeel Seedat, Yinpeng Dong, and colleagues verify AI agents by checking each step against expert rulebooks. Their 2026 framework, GLEAN, targets high-stakes work such as clinical diagnosis, where a wrong agent answer carries real risk. Standard verifiers often lack domain knowledge and give poorly calibrated confidence.
GLEAN compiles expert protocols into step-by-step ratings along the agent's path, then merges those ratings into features. A Bayesian model turns the merged evidence into a calibrated chance of being correct. When doubt stays high, the system actively gathers more evidence by widening guideline coverage and running cross-checks. On diagnosis tasks from a major hospital dataset, it beat the best rival on both accuracy ranking and calibration.
Catalog record
| CREATOR | Yichi Zhang, Nabeel Seedat, Yinpeng Dong, Peng Cui, Jun Zhu, Mihaela van der Schaar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67032 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.02798