Why Agent Caching Fails and How to Fix It: Structured Intent Canonicalization with Few-Shot Learning

Abhinaba Basu · 2026

Read Why Agent Caching Fails and How to Fix It: Structured Intent Canonicalization with Few-Shot Learning by Abhinaba Basu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-18922.txt.

Description

Personal AI agents waste money on repeated language model calls, and existing cache methods fail badly in practice. Abhinaba Basu, writing alone in 2026, shows why. Cache success needs key consistency and precision, not classification accuracy. Cache-key testing reduces to clustering testing, and V-measure decomposition separates those traits.

The author introduces W5H2, a structured intent decomposition framework. With SetFit and eight examples per class, it reaches high accuracy on a major benchmark in about two milliseconds. That beats both a leading cache method and a twenty-billion-parameter model, which is far slower. On a new multilingual agentic dataset, it also transfers across languages. A five-tier cascade handles most chats locally, projecting a very large cost cut, with risk-controlled selective prediction guarantees. Keys matter more than labels here. Consistent keys make caches work.

Catalog record

CREATORAbhinaba Basu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-18922

Browse the full library · About the Tower of Babel