Perturbation Probing: A Two-Pass-per-Prompt Diagnostic for FFN Behavioral Circuits in Aligned LLMs

Hongliang Liu, Tung-Ling Li, Yuhao Wu · 2026

Read Perturbation Probing: A Two-Pass-per-Prompt Diagnostic for FFN Behavioral Circuits in Aligned LLMs by Hongliang Liu, Tung-Ling Li, Yuhao Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27401.txt.

Description

Liu, Li, and Wu introduce perturbation probing, a tool that builds hypotheses about feedforward neurons from two forward passes per prompt, with no backpropagation. Across 13 models, they find opposition circuits, where training suppresses a pretraining tendency, and routing circuits, spread through attention. In safety refusal, about 50 neurons control the refusal template, and removing them flips 80 percent of response formats across 520 prompts with almost no harmful compliance. For language choice, direction injection switches English to Chinese on 99.1 percent of 580 prompts in 3 of 19 models, and fails elsewhere.

Catalog record

CREATORHongliang Liu, Tung-Ling Li, Yuhao Wu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE90998
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.27401

Browse the full library · About the Tower of Babel