SAeUron: Interpretable Concept Unlearning in Diffusion Models with Sparse Autoencoders
Bartosz Cywiński, Kamil Deja · 2025
Read SAeUron: Interpretable Concept Unlearning in Diffusion Models with Sparse Autoencoders by Bartosz Cywiński, Kamil Deja (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18052.txt.
Description
Bartosz Cywiński and Kamil Deja want image models to forget on request, and to show their work. Their method, SAeUron, first trains sparse autoencoders on a diffusion model's inner activations; the features that emerge are few, readable, and tied to specific concepts. Switching off the features for a chosen concept then blocks it while the rest of the model behaves.
On a standard unlearning benchmark the approach beat rivals at erasing concepts and styles, removed nudity in a prompt-safety test, and erased several concepts with one autoencoder. Unlike many methods, it also resisted adversarial prompts trying to sneak the banned content back.
Catalog record
| CREATOR | Bartosz Cywiński, Kamil Deja |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-18052