Factual recall in linear associative memories: sharp asymptotics and mechanistic insights
Alessio Giorlandino, Sebastian Goldt, Antoine Maillard · 2026
Read Factual recall in linear associative memories: sharp asymptotics and mechanistic insights by Alessio Giorlandino, Sebastian Goldt, Antoine Maillard (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10795.txt.
Description
Alessio Giorlandino, Sebastian Goldt, and Antoine Maillard pin down how many facts a minimal associative memory can store and recall exactly. Large language models recall facts with ease, yet the hard limits of storing input-output pairs in a network layer have stayed murky.
The team studies a single-layer linear memory that must keep every target well separated from the rest. They build a decoupled twin model and show it matches the original on capacity, weight spectra, and mechanism. Statistical-physics tools then yield an exact capacity formula, extended to two-layer linear nets. Memory researchers get sharp asymptotics plus a mechanistic picture of how recall organizes itself.
Catalog record
| CREATOR | Alessio Giorlandino, Sebastian Goldt, Antoine Maillard |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 106259 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10795