Reclaim Evaluation: A Lossy Memory Is Worse Than an Empty One
Alex Kwon [email protected] · 2026
Read Reclaim Evaluation: A Lossy Memory Is Worse Than an Empty One by Alex Kwon [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-25449.txt.
Introduction
A chatbot that remembers a wrong fact but forgets the evidence behind it can be worse than one that remembers nothing. Alex Kwon names that failure brittle memory in 2026 and builds an evaluation for it. A conversation drifts and the memory is compressed to a fixed budget. Then a correction arrives. Can the model recover the true answer, scored exactly against ground truth with no judge model involved? Eight models face paired memory conditions under matched budgets.
Lossy memory was never better than empty memory, and clearly worse for models inclined to answer rather than abstain. One simple policy repaired much of the damage: keep the source that lets an answer be recomputed, and drop the stored conclusion instead. The failure also compounded across repeated memory cycles and showed up in three deployed memory systems and real dialogue data.
Catalog record
| CREATOR | Alex Kwon [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 102 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.25449
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Reclaim Evaluation: A Lossy Memory Is Worse Than an Empty One Alex Kwon [email protected] Abstract A language model’s memory can be worse than no memory at all . A memory that keeps a wrong conclusion but drops the work behind it makes the model emit the stale value as a confident answer, where an empty memory would make it abstain; we call this brittle memory . We measure it with reclaim evaluation : compress a drifted interaction at a fixed budget, then test whether a correction recovers the known answer, scored against ground truth with no judge. Correctability is bottlenecked not by capability but by whether the answer-determining source survives compression, so an 8 8 B model and a frontier one wall in the same place. Across eight models a lossy memory is never better than an empty one, and strictly worse on those disposed to answer rather than abstain. A one-line source-first policy, keep the recomputable source and drop the re-derivable conclusion, restores correctability at equal budget where the answer-determining source is compact and identifiable ; a length-matched control rules out added text, and a deployable one-prompt form reclaims 0.49 0.49 – 0.88 0.88 , rising toward the oracle’s 1.00 1.00 when a frontier model writes the note. The failure compounds through a memory loop and replicates on three deployed memory systems and on real dialogue (MultiWOZ), with a located boundary past which the fix fails silently unless the note records its completeness. This is a controlled study of a mechanism: judge-free exact scoring, matched-budget controls, and validators built to come out false; we release the harness, the paired memory conditions, and these validators. 1 1 1 Code, data, and the reproduction harness: https://github.com/collapseindex/reclaim-eval . Figure 1: Compression decides whether an error stays fixable. Only a compressed memory crosses from session 1 to session 2, at a fixed budget. lossy compression keeps the salient wrong conclusion and discards the source, so a later correction has nothing to recompute from and the model confidently returns the stale value; source-first keeps the recomputable source instead, so the same correction lands and the model recovers the truth. Same budget, opposite outcome. Numbers are directed-arm RR at low integrity; the source-first memory shown is the hand-built oracle, and a deployable one-prompt distiller reclaims 0.49 – 0.88 (§ 6 ). Table 1: Claims and evidence. Every load-bearing claim, the evidence behind it, and its epistemic status: shown (direct measurement), analytic (follows from the definitions), or suggestive (preliminary, not load-bearing). The behavioral results are the contribution; the information bound ( analytic ) is apparatus. Claim Evidence Status A lossy memory is never better than an empty one, and strictly worse on models disposed to answer: with the source gone, a model that answers emits a confident wrong value instead of abstaining (4 of 8 models; the frontier OpenAI and Anthropic systems abstain and escape it). Tab. 3 , 10 , 7 , 17 shown The wall and fix sit in the same place from an 8 B model to a frontier one (capability-invariant). Tab. 5 , 8 shown Source-first removes the wall at equal budget; the lever is content, not text. Tab. 5 shown A single lossy error cascades across a memory loop and stays uncorrectable short of re-supplying the answer; source-first holds to a budget horizon. Tab. 12 shown The wall and fix appear in three deployed memory systems and on real dialogue (MultiWOZ). Tab. 8 , 9 shown A one-prompt source-first deploys ( 0.49 – 0.88 ); aiming retrieval at the source instead does not rescue it (distillation is the lever). Tab. 8 shown Source-first is robust to generic, false-locus, and confident-wrong-value corrections; a sustained push and an injected fabricated source are capability-gated. Tab. 18 , 19 shown Past its budget or under noise the fix decays (the crossover tracks the budget) and fails silently unless the note records completeness. Fig. 2 , 3 ; Tab. 11 shown Apparatus : source absent \Rightarrow the answer is uncomputable; the wall exists. Def. & validators (§ 3 , 4 ) analytic Compact-source memory is more prevalent in agentic than chat domains (ordering, not absolute level). Tab. 13 suggestive 1 Introduction Language models are increasingly deployed in settings where they must remember. Assistant “memory” features, long-running agents, and retrieval pipelines all carry information forward across a context window or a session boundary, and they do so by compressing : a conversation, a document, or a trajectory is reduced to a summary, a note, or a set of retrieved chunks ( Packer et al. 2023 ; Lewis et al. 2020 ) . The implicit assumption behind these systems is that a compression which preserves the model’s answer has preserved what matters. We show that this assumption is incomplete in a consequential way. Compression decides not only what a model can recall, but whether the model can later be corrected . When a model has committed to a wrong intermediate conclusion and that conclusion is carried forward while the evidence behind it is dropped, a later correction has nothing to act on: the model restates the error, and no stronger model we tested recovers from it. We call this failure brittle memory , by analogy to a memory that looks intact, the salient answer is still there, yet shatters the moment it is asked to support a correction. And because deployed agents feed memory into memory, the damage does not stay local: a single dropped-source error compounds down the chain, corrupting a growing span of downstream steps and resisting any correction that names the error rather than re-supplying it, however late it arrives, while a source-preserving memory stays correctable to a bounded budget horizon (§ 9 ). The deployment-relevant stake is therefore not one wrong answer but a compounding, uncorrectable one. This is not a hypothetical. The dominant instinct in summarization is to keep the takeaway and drop the working . A note that records “the total was $55” while discarding the line items preserves the wrong answer and destroys the only means to fix it. We make this precise, measure it, and show it is a design choice rather than a property of the model. Two things must be kept apart. The information loss is immediate from the definition (a value cannot be recomputed without its inputs, and no capability changes that), but that is only the setup : it says nothing about what the model does next. The finding is behavioral. The same model abstains or emits a confident wrong value depending only on what the memory kept. A source-less model does not reliably abstain (§ 5 ), and on a model that answers, a memory that kept the wrong conclusion is worse than one that kept nothing: the stale value acts as an attractor it emits even while hedging. Calibration here is therefore induced by a memory design, not a fixed trait to measure once, and the danger is not that the source is gone but that the model does not act like it is gone. We do not propose universal source retention. We identify the regime where memory must keep a recomputation path, and show current summary-like memories often drop it there; how much