SAeUron: Interpretable Concept Unlearning in Diffusion Models with Sparse Autoencoders

Bartosz Cywiński, Kamil Deja · 2025

Read SAeUron: Interpretable Concept Unlearning in Diffusion Models with Sparse Autoencoders by Bartosz Cywiński, Kamil Deja (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18052.txt.

Description

Bartosz Cywiński and Kamil Deja want image models to forget on request, and to show their work. Their method, SAeUron, first trains sparse autoencoders on a diffusion model's inner activations; the features that emerge are few, readable, and tied to specific concepts. Switching off the features for a chosen concept then blocks it while the rest of the model behaves.

On a standard unlearning benchmark the approach beat rivals at erasing concepts and styles, removed nudity in a prompt-safety test, and erased several concepts with one autoencoder. Unlike many methods, it also resisted adversarial prompts trying to sneak the banned content back.

Catalog record

CREATORBartosz Cywiński, Kamil Deja
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-18052

Browse the full library · About the Tower of Babel