Geometry of Reason: Spectral Signatures of Valid Mathematical Reasoning

Valentin Noël · 2026

Read Geometry of Reason: Spectral Signatures of Valid Mathematical Reasoning by Valentin Noël (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00791.txt.

Description

Valentin Noël looks for the fingerprints of genuine mathematical reasoning inside a transformer's attention patterns. Telling whether a language model truly reasons or merely pattern-matches is an open problem: trained verifier models are expensive, and rules based on the final text are brittle. Noël treats each attention matrix as a weighted graph connecting tokens.

From those graphs he extracts four spectral diagnostics, including the Fiedler value and spectral entropy, none of which need any learned parameters. Across seven models from four architecture families, valid reasoning showed a measurable spectral signature with very large effect sizes, allowing a single threshold to classify reasoning traces with high accuracy. The signal tracked logical coherence rather than mere acceptance by a proof checker.

Catalog record

CREATORValentin Noël
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-00791

Browse the full library · About the Tower of Babel