Factual recall in linear associative memories: sharp asymptotics and mechanistic insights

Alessio Giorlandino, Sebastian Goldt, Antoine Maillard · 2026

Read Factual recall in linear associative memories: sharp asymptotics and mechanistic insights by Alessio Giorlandino, Sebastian Goldt, Antoine Maillard (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10795.txt.

Description

Alessio Giorlandino, Sebastian Goldt, and Antoine Maillard pin down how many facts a minimal associative memory can store and recall exactly. Large language models recall facts with ease, yet the hard limits of storing input-output pairs in a network layer have stayed murky.

The team studies a single-layer linear memory that must keep every target well separated from the rest. They build a decoupled twin model and show it matches the original on capacity, weight spectra, and mechanism. Statistical-physics tools then yield an exact capacity formula, extended to two-layer linear nets. Memory researchers get sharp asymptotics plus a mechanistic picture of how recall organizes itself.

Catalog record

CREATORAlessio Giorlandino, Sebastian Goldt, Antoine Maillard
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE106259
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.10795

Browse the full library · About the Tower of Babel