Probing the Representational Power of Sparse Autoencoders in Vision Models

Matthew L. Olson, Musashi Hinck, Neale Ratzlaff, Changbai Li, Phillip Howard, Vasudev Lal, Shao-Yen Tseng, vasudev.lal, shao-yen.tseng}@intel.com, [email protected] · 2025

Read Probing the Representational Power of Sparse Autoencoders in Vision Models by Matthew L. Olson, Musashi Hinck, Neale Ratzlaff, Changbai Li, Phillip Howard, Vasudev Lal, Shao-Yen Tseng, vasudev.lal, shao-yen.tseng}@intel.com, [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-11277.txt.

Description

Matthew Olson and co-authors probe in a 2025 paper if sparse autoencoders can open up vision models the way they have language models. These tools squeeze inner states through a thin layer and rebuild them, which yields features a human can read. Their power in the visual domain was largely untested before this work.

Broad tests span three model families, from image embedders to diffusion generators. The learned features carry clear meaning and lift performance on new, shifted data. In embedders they flag out of place inputs and mirror the model's inner concept tree. In diffusion models they steer image meaning through text encoder tweaks. A pipeline that finds human readable traits on its own is also shown.

Catalog record

CREATORMatthew L. Olson, Musashi Hinck, Neale Ratzlaff, Changbai Li, Phillip Howard, Vasudev Lal, Shao-Yen Tseng, vasudev.lal, shao-yen.tseng}@intel.com, [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-11277

Browse the full library · About the Tower of Babel