RASA: Routing-Aware Safety Alignment for Mixture-of-Experts Models
Jiacheng Liang, Yuhui Wang, Tanqiu Jiang, Ting Wang · 2026
Read RASA: Routing-Aware Safety Alignment for Mixture-of-Experts Models by Jiacheng Liang, Yuhui Wang, Tanqiu Jiang, Ting Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04448.txt.
Description
In a 2026 paper, Jiacheng Liang and 3 co-authors tackle safety problems in Mixture-of-Experts language models. These models route each input to a small subset of expert networks. That routing can let standard safety training appear to work while leaving risky experts unchanged.
Their method, called RASA, first finds the experts most often activated by successful jailbreak attacks. It then fine-tunes only those experts while holding routing fixed. A later step keeps routing consistent with safe contexts. Across two model designs and many attacks, RASA gave near-perfect resistance and less over-refusal. It also preserved general ability on standard knowledge and math benchmarks.
Catalog record
| CREATOR | Jiacheng Liang, Yuhui Wang, Tanqiu Jiang, Ting Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04448