Where Does Toxicity Live? Mechanistic Localization and Targeted Suppression in Language Models WARNING: The content contains offensive model outputs and is toxic.

Himanshu Beniwal, Mayank Singh · 2026

Read Where Does Toxicity Live? Mechanistic Localization and Targeted Suppression in Language Models WARNING: The content contains offensive model outputs and is toxic. by Himanshu Beniwal, Mayank Singh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27997.txt.

Description

Himanshu Beniwal and Mayank Singh locate where toxicity lives inside language models, then suppress it without retraining. Their two frameworks trace toxic behavior to specific layers and neurons, chiefly early MLP layers, and dampen them during inference or with tiny weight edits. Across five models, toxicity fell while language quality held.

Catalog record

CREATORHimanshu Beniwal, Mayank Singh
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49348
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.27997

Browse the full library · About the Tower of Babel