When Models Manipulate Manifolds: The Geometry of a Counting Task

Wes Gurnee , Emmanuel Ameisen , Isaac Kauvar, Julius Tarng, Adam Pearce, Chris Olah, Joshua Batson[1em] Anthropic, Equal contribution. Corresponding author: [email protected] · 2026

Read When Models Manipulate Manifolds: The Geometry of a Counting Task by Wes Gurnee , Emmanuel Ameisen , Isaac Kauvar, Julius Tarng, Adam Pearce, Chris Olah, Joshua Batson[1em] Anthropic, Equal contribution. Corresponding author: [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04480.txt.

Description

Wes Gurnee and six co-authors open up a language model and watch it count, in a 2026 arXiv paper. The subject is Claude 3.5 Haiku, and the task is humble: breaking fixed-width text into lines, which requires knowing how many characters each line already holds, though the model only ever sees tokens. The team traces how that count is represented and used inside the network.

Character counts, they find, live on low-dimensional curved manifolds, marked out by families of sparse features much like the place cells animals use to track position. Attention heads then twist those manifolds to estimate the distance to the line's edge, and arrange the estimates at right angles so a simple boundary can trigger the break. Causal interventions confirm the story, and the team even finds visual illusions: character sequences that hijack the counting machinery and fool the model about where a line stands.

Catalog record

CREATORWes Gurnee , Emmanuel Ameisen , Isaac Kauvar, Julius Tarng, Adam Pearce, Chris Olah, Joshua Batson[1em] Anthropic, Equal contribution. Corresponding author: [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-04480

Browse the full library · About the Tower of Babel