Spectral Archaeology: The Causal Topology of Model Evolution
Valentin Noël · 2026
Read Spectral Archaeology: The Causal Topology of Model Evolution by Valentin Noël (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03424.txt.
Description
Valentin Noël, working alone, introduces a probe that looks inside language models instead of only testing what they output. The method treats each model layer as a graph of tokens and measures how connected that graph is. From those measures it builds a spectral fingerprint, a pattern that can mark how a model changed during training.
Noël tested twelve models in ten languages and found stable fingerprints that standard tests missed. One failure, named Passive-Triggered Connectivity Collapse, appears when training shifts from code to chat and breaks odd sentence forms in English only. The study also finds four common processing strategies across models. Simple threshold rules could identify model lineages perfectly, which helps anyone auditing how models evolve.
Catalog record
| CREATOR | Valentin Noël |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-03424