Crafting Reversible SFT Behaviors in Large Language Models
Yuping Lin, Pengfei He, Yue Xing, Yingqian Cui, Jiayuan Ding, Subhabrata Mukherjee, Hui Liu, Zhen Xiang · 2026
Read Crafting Reversible SFT Behaviors in Large Language Models by Yuping Lin, Pengfei He, Yue Xing, Yingqian Cui, Jiayuan Ding, Subhabrata Mukherjee, Hui Liu, Zhen Xiang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06632.txt.
Description
Yuping Lin and seven co-authors ask whether a behavior taught by supervised fine-tuning can be compressed into a small, causally necessary subnetwork they call a carrier. Fine-tuning spreads new behaviors through a model with no structural control, and post-hoc circuit methods find only correlations, so behaviors cannot be switched selectively at inference time.
Their LCDD method jointly learns routing masks and weights under a utility budget, squeezing a behavior into a sparse carrier. A soft prompt called SFT-Eraser then reverses the behavior by matching activations on carrier channels, without changing weights. Across safety, fixed-response, and style behaviors, carriers preserve the behavior yet allow strong reversal, proving causal necessity.
Catalog record
| CREATOR | Yuping Lin, Pengfei He, Yue Xing, Yingqian Cui, Jiayuan Ding, Subhabrata Mukherjee, Hui Liu, Zhen Xiang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06632