Drift-Bench : D iagnosing Coope R ative Breakdowns in LLM Agents under I nput F aults via Multi- T urn Interaction
Han Bao, Zheyuan Zhang, Pengcheng Jing, Zhengqing Yuan, Kaiwen Shi, Yanfang Ye · 2026
Read Drift-Bench : D iagnosing Coope R ative Breakdowns in LLM Agents under I nput F aults via Multi- T urn Interaction by Han Bao, Zheyuan Zhang, Pengcheng Jing, Zhengqing Yuan, Kaiwen Shi, Yanfang Ye (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02455.txt.
Description
Han Bao and 5 co-authors build a benchmark for what happens when users give AI agents flawed instructions, in a 2026 arXiv paper. Real inputs often hide intent, omit parameters, assume false facts, or stay ambiguous. Text-only tests miss the execution risks that follow when an agent can act over multiple turns.
Drift-Bench evaluates agents through multi-turn clarification in state-oriented and service-oriented environments. A taxonomy of cooperative breakdowns, grounded in classical communication theory, organizes the fault types. A persona-driven user simulator and the Rise evaluation protocol run the interactions. Experiments show substantial performance drops under input faults. Clarification success varied widely across personas and fault types. The benchmark gives agent builders a diagnostic tool for failures that could otherwise become unsafe executions.
Catalog record
| CREATOR | Han Bao, Zheyuan Zhang, Pengcheng Jing, Zhengqing Yuan, Kaiwen Shi, Yanfang Ye |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02455