Useful Memories Become Faulty When Continuously Updated by LLMs
Dylan Zhang, Yanshan Lin, Zhengkun Wu, Yihang Sun, Bingxuan Li, Dianqi Li, Hao Peng · 2026
Read Useful Memories Become Faulty When Continuously Updated by LLMs by Dylan Zhang, Yanshan Lin, Zhengkun Wu, Yihang Sun, Bingxuan Li, Dianqi Li, Hao Peng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12978.txt.
Description
Zhang and six co-authors find that consolidated memories written by language models turn faulty with continuous updating, even when built from useful experience. Memory quality first rises, then falls below the no-memory baseline; GPT-5.4 fails 54% of previously solved ARC-AGI problems after consolidating from ground-truth solutions. Keeping raw episodes intact stays competitive, so the authors urge treating raw episodes as first-class evidence and gating consolidation explicitly.
Catalog record
| CREATOR | Dylan Zhang, Yanshan Lin, Zhengkun Wu, Yihang Sun, Bingxuan Li, Dianqi Li, Hao Peng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 142802 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.12978