The Interference Gap: Comparing Retrieval Bounds in Human Memory and RAG Systems

Dongxin Guo ([email protected]), Jikun Wu, Siu-Ming Yiu · 2026

Read The Interference Gap: Comparing Retrieval Bounds in Human Memory and RAG Systems by Dongxin Guo ([email protected]), Jikun Wu, Siu-Ming Yiu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28327.txt.

Introduction

Dongxin Guo, Jikun Wu, and Siu-Ming Yiu compare two kinds of memory under interference: human episodic memory and retrieval-augmented generation, the technique where a system fetches text to answer questions. As more links compete for the same cue, recall worsens in people, a classic effect called fan, and retrieval worsens in machines.

Guo and colleagues fit both with one signal detection framework, using experiments with over a hundred participants plus matching computer models. Accuracy fell in a logarithmic pattern with association count in both systems, but people showed lower sensitivity to interference than dense passage retrieval. A brain-inspired system, HippoRAG, landed between the two. Parameter checks confirmed its quantities could be pinned down, and model comparison favored the logarithmic form. Six testable predictions link the two research fields.

Catalog record

CREATORDongxin Guo ([email protected]), Jikun Wu, Siu-Ming Yiu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.28327

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Interference Gap: Comparing Retrieval Bounds in Human Memory and RAG Systems Dongxin Guo ([email protected]), Jikun Wu, Siu-Ming Yiu Abstract How do retrieval bounds compare between human episodic memory and Retrieval-Augmented Generation (RAG) systems under semantic interference? We present a unified signal detection theory (SDT) framework that applies to both, and use it to fit behavioral and computational data in matched paradigms. Both systems show logarithmic accuracy decline with association count ( fan ), but humans exhibit lower interference sensitivity ( α / σ = 0.41 \alpha/\sigma=0.41 ) than dense passage retrieval ( α / σ = 0.67 \alpha/\sigma=0.67 ), with cognitively-inspired HippoRAG falling between the two ( α / σ = 0.44 \alpha/\sigma=0.44 ). Behavioral experiments ( N = 112 N=112 ) and simulations validate the framework; parameter recovery confirms identifiability ( r ≥ .93 r\geq.93 ) and model comparison favors the logarithmic specification over a power-law alternative ( Δ ​ BIC > 15 \Delta\text{BIC}>15 ). We discuss encoding specificity, temporal context binding, and retrieval gating as candidate mechanisms whose causal role remains to be established. Six falsifiable predictions connect cognitive memory research with AI retrieval evaluation. Keywords: episodic memory; retrieval-augmented generation; interference; signal detection theory; human-AI comparison Introduction Trying to remember which of your friends lives at a particular address is harder when several friends live in the same neighborhood. The same kind of competition arises in artificial intelligence: when a retrieval-augmented language model searches a corpus of overlapping documents, the more documents share a topic, the harder it becomes to surface the specific one a query needs. Both phenomena instantiate a common computational challenge: retrieval under semantic interference , where a cue activates multiple candidate responses competing for selection. Human memory exhibits the fan effect ( 2 ; 1 ) : as the number of facts associated with a concept (the “fan” of associations) grows, retrieval of any particular fact becomes slower and less accurate, with error growing approximately logarithmically in the fan. Memory is also subject to serial position effects : items at the start and end of a list are recalled better than items in the middle ( 23 ) . These phenomena have been characterized over five decades of cognitive research with precise quantitative descriptions of when and how retrieval fails under interference. Retrieval-Augmented Generation (RAG) systems, neural retrievers that condition language-model outputs on externally indexed text, exhibit analogous patterns. The “Lost in the Middle” phenomenon shows that information placed in the middle of a long context is recovered roughly 20 percentage points less accurately than information at either end ( 18 ) , and RAG generation quality degrades substantially when retrieved passages are semantically similar to but not relevant for the query ( 6 ; 3 ) . These failures are particularly pronounced when the retrieval corpus contains many documents competing for the same query. Despite decades of research on interference in human memory ( 33 ; 36 ) and growing evidence of parallel failures in RAG systems ( 25 ) , no theoretical framework has unified the two under common computational principles enabling direct quantitative comparison. We address this gap with the question: What are the formal bounds on retrieval accuracy under semantic interference, and how do they compare between human episodic memory and RAG systems? We develop a signal detection theory (SDT) framework ( 21 ; 12 ) applicable to both, contributing to a broader effort to apply cognitive science to AI evaluation ( 4 ; 16 ) . Our contributions are: (1) closed-form expressions for retrieval accuracy that fit both human and RAG data; (2) parameter-level differences across systems that suggest, rather than demonstrate, candidate mechanisms; (3) validation through matched behavioral-computational paradigms; and (4) parameter identifiability established via recovery analysis, sensitivity testing, and model comparison ( 35 ) . Background The fan effect ( 2 ; 1 ) is a robust empirical signature of interference in human associative memory, replicated across paradigms ranging from sentence-recognition to location-based scenarios ( 27 ) . A family of computational models (ACT-R, MINERVA 2, SAM, REM, and TCM) formalize different mechanisms by which interference arises from overlap among distributed memory traces ( 10 ; 26 ; 29 ; 11 ) , but all share the unifying insight that retrieval depends on the discriminability of the target trace from its competitors, with discriminability degrading as associative overlap grows ( 15 ) . RAG systems ( 17 ) exhibit analogous failures. The two systems we evaluate against humans illustrate the dominant design space. Dense Passage Retrieval (DPR; 13 ) encodes queries and passages into a shared vector space using a BERT-based bi-encoder and retrieves by inner-product similarity; ColBERTv2 ( 28 ) uses fine-grained late-interaction matching. Both consistently underperform on datasets where many passages share content with the gold passage ( 31 ) , and both exhibit position-dependent degradation: the “Lost in the Middle” effect, in which information placed near the middle of a long context is retrieved \sim 20 pp less accurately than information at either end ( 18 ) , mirrors the classic serial-position curve from human memory. 3 catalog seven recurrent failure points in production RAG systems, several of which parallel known interference phenomena. The third RAG system we evaluate, HippoRAG ( 8 ) , is explicitly cognitively-inspired: it implements a hippocampal indexing scheme in which extracted entities serve as sparse, addressable nodes and personalized PageRank over the resulting knowledge graph approximates the pattern-completion role of CA3 ( 30 ; 22 ) . The Tolman-Eichenbaum Machine ( 34 ) provides a related theoretical bridge connecting relational memory to hippocampal structural representations. These architectures suggest that biological organizing principles may inform retriever design; whether they actually capture biological interference resistance is exactly the empirical question this paper takes up. Theoretical Framework We model retrieval as discrimination between target and competitor memory traces under semantic interference, grounding the model in signal detection theory. Generative Model Consider a memory store \mathcal{M}=\{m_{1},\ldots,m_{N}\} containing N stored traces and a retrieval cue q for one designated target trace. Each trace m_{i} generates a scalar match signal x_{i} with the cue, with the target signal drawn from a Gaussian centered at \mu_{T} and competitor signals drawn from a Gaussian centered at \mu_{C} , both with shared variance \sigma^{2} : x_{i}\mid\text{target}\sim\mathcal{N}(\mu_{T},\,\sigma^{2}),\quad x_{i}\mid\text{competitor}\sim\mathcal{N}(\mu_{C},\,\sigma^{2}). (1) Discriminability d^{\prime}=(\mu_{T}-\mu_{C})/\sigma measures how separable target and competitor traces are in signal space ( 12 ; 5 ) . Higher d^{\prime} corresponds to better differentiation; in hippocampal terms, this connects naturally to pattern-separation efficiency ( 37 ) . Interference Model The classical fan effect is captured in ACT-R ( 1 ) by the activation rule S_{ji}=S-\ln(f_{j}) , where S_{ji} is the associative strength from cue j to chunk i , S is a baseline strength, and f_{j} is the fan, the number of chunks associated with cue j . Mapping this onto the SDT framework, fan reduces the target signal mean logarithmically with a sensitivity coefficient \alpha : \mu_{T}(f)=\mu_{T}^{0}-\alpha\ln(f)\;\;\Rightarrow\;\;d^{\prime}(f)=d^{\prime}_{0}-\frac{\alpha}{\sigma}\ln(f), (2) where \mu_{T}^{0} is the target mean at fan 1, d^{\prime}_{0}=(\mu_{T}^{0}-\mu_{C})/\sigma is the zero-interference discriminability, and the dimensionless ratio \alpha/\sigma governs the rate of accuracy decline with fan. Lower \alpha/\sigma indicates better-preserved discriminability under associative load; we will treat it as an inverse index of pattern-separation efficiency. Serial position effects

Read the complete text