Dialectics of Alignment: Harnessing Unsafe Knowledge for Dynamic Safety Routing
Maryam Hashemzadeh α,β,γ Jerry Huang α,β,γ Minseon Kim δ Marc-Alexandre Côté β , δ ♣ {}^{\beta,\delta\,\clubsuit} Sarath Chandar α , β , ϵ , ζ ♣ {}^{\alpha,\beta,\epsilon,\zeta\,\clubsuit} ♣ \clubsuit Equal supervision α Chandar Research Lab β Mila – Quebec AI Institute γ Université de Montréal δ Microsoft Research ϵ Polytechnique Montréal ζ Canada CIFAR AI Chair · 2026
Read Dialectics of Alignment: Harnessing Unsafe Knowledge for Dynamic Safety Routing by Maryam Hashemzadeh α,β,γ Jerry Huang α,β,γ Minseon Kim δ Marc-Alexandre Côté β , δ ♣ {}^{\beta,\delta\,\clubsuit} Sarath Chandar α , β , ϵ , ζ ♣ {}^{\alpha,\beta,\epsilon,\zeta\,\clubsuit} ♣ \clubsuit Equal supervision α Chandar Research Lab β Mila – Quebec AI Institute γ Université de Montréal δ Microsoft Research ϵ Polytechnique Montréal ζ Canada CIFAR AI Chair (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00686.txt.
Description
Hashemzadeh and co-authors rethink AI safety in this 2026 paper. The standard path erases unsafe data or trains models to refuse all risky prompts. That cuts harm, but it also shrinks what a model knows. The result can be bland refusals to mild, lawful questions.
Their frame, SafeMoE, keeps unsafe knowledge but locks it in small expert parts. Each expert trains on harmful texts from one domain. A light routing network then steers these experts at run time. It trains on a small, well-picked set of safe and rich replies. The authors report over 20 percent relative gain in safe reply rates on strict tests. Replies also carry more real content, they say. The router works on new domains with no fresh training.
Catalog record
| CREATOR | Maryam Hashemzadeh α,β,γ Jerry Huang α,β,γ Minseon Kim δ Marc-Alexandre Côté β , δ ♣ {}^{\beta,\delta\,\clubsuit} Sarath Chandar α , β , ϵ , ζ ♣ {}^{\alpha,\beta,\epsilon,\zeta\,\clubsuit} ♣ \clubsuit Equal supervision α Chandar Research Lab β Mila – Quebec AI Institute γ Université de Montréal δ Microsoft Research ϵ Polytechnique Montréal ζ Canada CIFAR AI Chair |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 94 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.00686