Geometry of Reason: Spectral Signatures of Valid Mathematical Reasoning
Valentin Noël · 2026
Read Geometry of Reason: Spectral Signatures of Valid Mathematical Reasoning by Valentin Noël (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00791.txt.
Description
Valentin Noël looks for the fingerprints of genuine mathematical reasoning inside a transformer's attention patterns. Telling whether a language model truly reasons or merely pattern-matches is an open problem: trained verifier models are expensive, and rules based on the final text are brittle. Noël treats each attention matrix as a weighted graph connecting tokens.
From those graphs he extracts four spectral diagnostics, including the Fiedler value and spectral entropy, none of which need any learned parameters. Across seven models from four architecture families, valid reasoning showed a measurable spectral signature with very large effect sizes, allowing a single threshold to classify reasoning traces with high accuracy. The signal tracked logical coherence rather than mere acceptance by a proof checker.
Catalog record
| CREATOR | Valentin Noël |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-00791