Neurons Speak in Ranges: Breaking Free from Discrete Neuronal Attribution
Muhammad Umair Haider [email protected], Hammad Rizwan [email protected], Hassan Sajjad, Peizhong Ju, A.B. Siddique · 2025
Read Neurons Speak in Ranges: Breaking Free from Discrete Neuronal Attribution by Muhammad Umair Haider [email protected], Hammad Rizwan [email protected], Hassan Sajjad, Peizhong Ju, A.B. Siddique (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-06809.txt.
Description
Haider and four colleagues argue that neurons in language models speak in ranges, not single switches, in twenty twenty-five. Single neurons were thought to own single concepts, yet most serve many. Across encoder and decoder models, they found a pattern. For a given concept, a neuron's firing sizes form a tight bell shaped range.
Ranges for unlike concepts barely overlap. Their NeuronLens tool reads and steers concepts by those ranges. Steering hit the target concept with far less damage to neighbors than neuron masking. Model performance held up better too. The lens offers a finer grip on model internals.
Catalog record
| CREATOR | Muhammad Umair Haider [email protected], Hammad Rizwan [email protected], Hassan Sajjad, Peizhong Ju, A.B. Siddique |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 117 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-06809