Diagnosing Retrieval vs. Utilization Bottlenecks in LLM Agent Memory

Boqin Yuan, Yue Su, Kun Yao · 2026

Read Diagnosing Retrieval vs. Utilization Bottlenecks in LLM Agent Memory by Boqin Yuan, Yue Su, Kun Yao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02473.txt.

Description

Boqin Yuan, Yue Su, and Kun Yao diagnose where memory-augmented agents fail in this 2026 paper. Such agents store past interactions and retrieve them to answer later questions. Teams debate whether better writing or better retrieval matters more. Their diagnostic framework crosses three write styles with three retrieval methods.

Write styles range from raw chunks to extracted facts and summaries. Retrieval spans cosine matching, keyword search, and a hybrid reranker. On a long-conversation benchmark, retrieval choice swung accuracy by about twenty points. Write style moved it by only a few points. Raw chunks, needing no model calls, matched or beat costly lossy options. Failures clustered at retrieval, not at use of retrieved text. Better retrieval, they argue, beats fancier writing today.

Catalog record

CREATORBoqin Yuan, Yue Su, Kun Yao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23406
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.02473

Browse the full library · About the Tower of Babel