Where Does Toxicity Live? Mechanistic Localization and Targeted Suppression in Language Models WARNING: The content contains offensive model outputs and is toxic.
Himanshu Beniwal, Mayank Singh · 2026
Read Where Does Toxicity Live? Mechanistic Localization and Targeted Suppression in Language Models WARNING: The content contains offensive model outputs and is toxic. by Himanshu Beniwal, Mayank Singh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27997.txt.
Description
Himanshu Beniwal and Mayank Singh locate where toxicity lives inside language models, then suppress it without retraining. Their two frameworks trace toxic behavior to specific layers and neurons, chiefly early MLP layers, and dampen them during inference or with tiny weight edits. Across five models, toxicity fell while language quality held.
Catalog record
| CREATOR | Himanshu Beniwal, Mayank Singh |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49348 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27997