Repeated-Token Counting Reveals a Dissociation Between Representations and Outputs

Sohan Venkatesh · 2026

Read Repeated-Token Counting Reveals a Dissociation Between Representations and Outputs by Sohan Venkatesh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09239.txt.

Description

Venkatesh overturns the usual explanation for language model failures at counting repeated tokens. Counting failures are commonly blamed on weak internal count tracking, but linear probes recover the correct count almost perfectly at every layer. That holds even where the wrong answer crystallises, even as the model outputs an incorrect count.

No collapse appears in attention patterns over repeated tokens, and tokenisation artefacts explain none of the failure. Rather, a format triggered MLP block overwrites the correct count with one fixed wrong answer at roughly 88 to 93 percent depth. The prior triggers on repeated word tokens in space separated lists, is absent for digit tokens, and is suppressed by commas in bigger models but survives in smaller ones. The pattern holds across Llama-3.2 and Qwen2.5 models at the same relative depth. Counting failure is a routing failure, not a representation failure, and the two demand different interventions.

Catalog record

CREATORSohan Venkatesh
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.09239

Browse the full library · About the Tower of Babel