Useful Memories Become Faulty When Continuously Updated by LLMs

Dylan Zhang, Yanshan Lin, Zhengkun Wu, Yihang Sun, Bingxuan Li, Dianqi Li, Hao Peng · 2026

Read Useful Memories Become Faulty When Continuously Updated by LLMs by Dylan Zhang, Yanshan Lin, Zhengkun Wu, Yihang Sun, Bingxuan Li, Dianqi Li, Hao Peng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12978.txt.

Description

Zhang and six co-authors find that consolidated memories written by language models turn faulty with continuous updating, even when built from useful experience. Memory quality first rises, then falls below the no-memory baseline; GPT-5.4 fails 54% of previously solved ARC-AGI problems after consolidating from ground-truth solutions. Keeping raw episodes intact stays competitive, so the authors urge treating raw episodes as first-class evidence and gating consolidation explicitly.

Catalog record

CREATORDylan Zhang, Yanshan Lin, Zhengkun Wu, Yihang Sun, Bingxuan Li, Dianqi Li, Hao Peng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE142802
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12978

Browse the full library · About the Tower of Babel