Universal Neurons in GPT-2: Emergence, Persistence, and Functional Impact

Advey Nandan, Cheng-Ting Chou, Amrit Kurakula, Cole Blondin, Kevin Zhu, Vasu Sharma & Sean O’Brien · 2025

Read Universal Neurons in GPT-2: Emergence, Persistence, and Functional Impact by Advey Nandan, Cheng-Ting Chou, Amrit Kurakula, Cole Blondin, Kevin Zhu, Vasu Sharma & Sean O’Brien (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00903.txt.

Description

Advey Nandan and co-authors found shared neurons across GPT-2 models in two thousand twenty-five. Separately trained models might invent private internal codes. Instead, some neurons fire in sync across models. Five small GPT-2 copies were trained and compared. Their neuron activity was matched over millions of tokens. Checkpoints traced how the shared neurons evolve.

Shared neurons persisted through most of training. Early and deep layers held them most stably. Switching them off hurt predictions measurably. Their role is functional, not decorative. Convergent structure emerges from the training process itself. The result hints at universal features in language learning. Interpretability tools can target these stable units.

Catalog record

CREATORAdvey Nandan, Cheng-Ting Chou, Amrit Kurakula, Cole Blondin, Kevin Zhu, Vasu Sharma & Sean O’Brien
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-00903

Browse the full library · About the Tower of Babel