Perturbation Probing: A Two-Pass-per-Prompt Diagnostic for FFN Behavioral Circuits in Aligned LLMs
Hongliang Liu, Tung-Ling Li, Yuhao Wu · 2026
Read Perturbation Probing: A Two-Pass-per-Prompt Diagnostic for FFN Behavioral Circuits in Aligned LLMs by Hongliang Liu, Tung-Ling Li, Yuhao Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27401.txt.
Description
Liu, Li, and Wu introduce perturbation probing, a tool that builds hypotheses about feedforward neurons from two forward passes per prompt, with no backpropagation. Across 13 models, they find opposition circuits, where training suppresses a pretraining tendency, and routing circuits, spread through attention. In safety refusal, about 50 neurons control the refusal template, and removing them flips 80 percent of response formats across 520 prompts with almost no harmful compliance. For language choice, direction injection switches English to Chinese on 99.1 percent of 580 prompts in 3 of 19 models, and fails elsewhere.
Catalog record
| CREATOR | Hongliang Liu, Tung-Ling Li, Yuhao Wu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90998 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.27401