Formalizing Latent Thoughts: Four Axioms of Thought Representation in LLMs
Fahd Seddik, Fatemeh Fard · 2026
Read Formalizing Latent Thoughts: Four Axioms of Thought Representation in LLMs by Fahd Seddik, Fatemeh Fard (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-27378.txt.
Introduction
Seddik and Fard grade the hidden thought vectors of large language models against four axioms, instead of trusting benchmark scores. Latent reasoning replaces written chain-of-thought with continuous vectors, promising speed. But accuracy alone cannot tell whether the representation itself is sound or the model is compensating. Their axioms, Causality, Minimality, Separability, and Stability, each get a quantitative measure computed directly on the representation. In the 2026 language model paper, open-weight models are audited across twenty-three reasoning tasks.
No candidate satisfies all four axioms at once. The representations do separate task types reliably, a partial pass. They cannot, however, distinguish two different questions within the same task. Worse, they encode little information beyond what the input embedding already held. The failure repeats across dense, distilled, and reinforcement-trained model families, marking it as structural rather than a matter of scale.
Catalog record
| CREATOR | Fahd Seddik, Fatemeh Fard |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 151 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.27378