Abstraction Induces the Brain Alignment of Language and Speech Models

Emily Cheng, Aditya R. Vaidya, Richard Antonello · 2026

Read Abstraction Induces the Brain Alignment of Language and Speech Models by Emily Cheng, Aditya R. Vaidya, Richard Antonello (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04081.txt.

Description

Middle layers of language models predict brain activity best, and Emily Cheng and 2 co-authors explain why. Their 2026 paper compares hidden states from language and speech models against fMRI and ECoG recordings of people processing natural language. Output layers, tuned for next-word prediction, do worse.

The winning layers are where models build abstract meaning. A peak in intrinsic dimension, a measure of feature complexity, marks that abstraction zone. Dimension strongly predicts brain alignment, and the link grows during pretraining. Fine-tuning toward the brain causally improves prediction. The shared currency between models and brains, they argue, is meaning abstraction, not word guessing.

Catalog record

CREATOREmily Cheng, Aditya R. Vaidya, Richard Antonello
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04081

Browse the full library · About the Tower of Babel