Why Agent Caching Fails and How to Fix It: Structured Intent Canonicalization with Few-Shot Learning
Abhinaba Basu · 2026
Read Why Agent Caching Fails and How to Fix It: Structured Intent Canonicalization with Few-Shot Learning by Abhinaba Basu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-18922.txt.
Description
Personal AI agents waste money on repeated language model calls, and existing cache methods fail badly in practice. Abhinaba Basu, writing alone in 2026, shows why. Cache success needs key consistency and precision, not classification accuracy. Cache-key testing reduces to clustering testing, and V-measure decomposition separates those traits.
The author introduces W5H2, a structured intent decomposition framework. With SetFit and eight examples per class, it reaches high accuracy on a major benchmark in about two milliseconds. That beats both a leading cache method and a twenty-billion-parameter model, which is far slower. On a new multilingual agentic dataset, it also transfers across languages. A five-tier cascade handles most chats locally, projecting a very large cost cut, with risk-controlled selective prediction guarantees. Keys matter more than labels here. Consistent keys make caches work.
Catalog record
| CREATOR | Abhinaba Basu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-18922