Towards Open-Ended Visual Scientific Discovery with Sparse Autoencoders

Samuel Stevens, Jacob Beattie, Tanya Berger-Wolf, Yu Su · 2025

Read Towards Open-Ended Visual Scientific Discovery with Sparse Autoencoders by Samuel Stevens, Jacob Beattie, Tanya Berger-Wolf, Yu Su (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17735.txt.

Introduction

Jacob Beattie, Samuel Stevens, Neil Rosser, Yu Su, and Tanya Berger-Wolf test whether large vision models can help scientists find new patterns, not just confirm known ones. They use sparse autoencoders, tools that split a model's inner features into clearer parts, plus simple ranking rules to surface promising features.

Trials cover scene images, fish images, and butterflies. The method rediscovers known concepts, recovers fine fish body features without labels, and picks out traits that separate look alike butterfly groups. The authors frame the work as a needed first step, with finding truly new phenomena still ahead.

Catalog record

CREATORSamuel Stevens, Jacob Beattie, Tanya Berger-Wolf, Yu Su
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-17735

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Open-Ended Visual Scientific Discovery with Sparse Autoencoders Samuel Stevens, Jacob Beattie, Tanya Berger-Wolf, Yu Su Abstract Scientific archives now contain hundreds of petabytes of data across genomics, ecology, climate, and molecular biology that could reveal undiscovered patterns if systematically analyzed at scale. Large-scale, weakly-supervised datasets in language and vision have driven the development of foundation models whose internal representations encode structure (patterns, co-occurrences and statistical regularities) beyond their training objectives. Most existing methods extract structure only for pre-specified targets; they excel at confirmation but do not support open-ended discovery of unknown patterns. We ask whether sparse autoencoders (SAEs) can enable open-ended feature discovery from foundation model representations. We evaluate this question in controlled rediscovery studies, where the learned SAE features are tested for alignment with semantic concepts on a standard segmentation benchmark and compared against strong label-free alternatives on concept-alignment metrics. Applied to ecological imagery, the same procedure surfaces fine-grained anatomical structure without access to segmentation or part labels, providing a scientific case study with ground-truth validation. While our experiments focus on vision with an ecology case study, the method is domain-agnostic and applicable to models in other sciences (e.g., proteins, genomics, weather). Our results indicate that sparse decomposition provides a practical instrument for exploring what scientific foundation models have learned, an important prerequisite for moving from confirmation to genuine discovery. 1 Introduction Scientific data now spans hundreds of petabytes across domains, far outpacing what any lab can annotate or manually inspect. 1 1 1 For example, the NIH Sequence Read Archive exposes roughly 47 PB of public sequencing data, the European Nucleotide Archive provides roughly 63 PB of immediately downloadable data, NASA Earthdata (EOSDIS) hosts more than 120 PB of open Earth science data, and a single reanalysis, ERA5, is on the order of 5 PB. Large neural networks trained on these datasets cover proteins (e.g., AlphaFold 3 [ 1 ] ), weather (e.g., GraphCast, GenCast [ 34 , 47 ] ), genomics (e.g., scGPT, ESM3 [ 12 , 23 ] ), and vision (e.g., Scale-MAE, BioCLIP 2 [ 48 , 19 ] ). These models achieve strong predictive performance across a variety of tasks by learning compressed representations of the underlying data distribution’s structure. Figure 1 : Validating an instrument for open-ended feature discovery. Left: Typical use of a foundation model in science: an input image is passed through a pretrained encoder and a task-specific head to yield class scores; the dense representation remains an opaque embedding, so unnamed factors are inaccessible. Right: Our procedure composes a foundation model with a sparse autoencoder, producing a library of interpretable semantic concepts with per-example activation maps. We find that these concepts align with and localize anatomical parts (e.g., head, dorsal fin) without seeing part-of-body labels. Fish images are shown as a case study with known anatomy providing a controlled rediscovery test; the explored method is domain-agnostic. However, current usage of such foundation models in science is predominantly task-centric: models are used as frozen feature extractors or fine-tuned for specific predictions (species classification [ 57 ] , cellular responses to perturbations [ 49 ] , 3-D protein structure [ 21 , 46 ] ). The learned, compressed representations are high-dimensional embeddings optimized for task performance. While these representations enable accurate predictions, they do not directly provide reusable scientific measurements or expose the structure the model learned for systematic investigation. This limits foundation models to confirmatory applications where the target concepts are pre-specified (see Table 1 ). Discovery vs. Confirmation Scientific discovery often involves establishing names and descriptions of previously unexplained phenomena in the world [ 33 ] . A morphological feature that distinguishes subspecies but is not formally cataloged, an unexplored correlation between climate variables, or a sequence motif in an understudied protein family: these cannot be found by methods that require specifying target concepts in advance. Foundation models trained on millions of samples have processed more data than any human could learn from. If these models have learned semantic patterns not captured by existing annotations, interpretability methods offer a route to systematically surface this learned structure. However, current interpretability approaches require specifying concepts: • Supervised probing tests for known concepts [ 4 ] . • Concept activation vectors (CAV) measure sensitivity to user-defined concepts [ 31 ] . • Saliency maps and attention visualizations explain individual predictions for predefined tasks [ 50 , 55 , 53 ] . These methods excel at confirmation , but cannot perform open-ended exploration to generate hypotheses about what patterns exist in the learned representations. When labels are scarce and salient factors are unknown (i.e., in scientific use cases), the inability to extract unnamed patterns from foundation models represents a significant limitation. If foundation models have learned meaningful patterns from data that exceed what humans can manually analyze, we need methods to surface those patterns without pre-specification [ 27 ] . We view such open-ended feature discovery as a prerequisite step toward scientific discovery. Table 1: Comparison of methods for extracting knowledge from foundation models. Most approaches require researchers to specify concepts or tasks in advance, limiting them to confirmatory analysis. SAEs support open-ended feature discovery by surfacing the model’s learned feature vocabulary in a structured format without any supervision. Method Input Output Example Discovery? Task Heads Labeled task dataset Task predictions Species classification ✗ Needs task labels Linear Probes Labeled concept \mathcal{A} samples Decodability of concept \mathcal{A} “Does DINOv3 see eyes?” ✗ Pre-specified concepts Concept Vec. Labeled concept \mathcal{A} samples Score for concept \mathcal{A} “Find a ‘striped’ direction” ✗ Needs concept samples Feature Viz. Selected neuron Synthetic images “DeepDream for neuron j ” ✗ Unstructured output Prototypes Labeled task dataset Task-tied prototypes “This looks like concept \mathcal{B} ” ✗ Task-specific SAEs (Ours) Unlabeled activations Interpretable features Discover new traits ✓ Finds unknown patterns Our approach. To address this gap, we study sparse autoencoders (SAEs) as a candidate mechanism for decomposing foundation model representations into interpretable features without concept supervision [ 7 , 56 , 13 , 17 ] . SAEs learn an overcomplete dictionary that reconstructs model activations through sparse linear combinations, with sparsity encouraging individual features to capture coherent semantic units. Unlike supervised methods, SAEs require no concept labels during training. Each learned feature provides a per-example activation score together with its decoding direction and exemplar evidence, enabling systematic investigation of what patterns the model represents. In short, we treat SAEs as a candidate tool for open-ended feature discovery from foundation models and seek to rigorously evaluate that tool in controlled settings [ 45 ] . Evidence. We train SAEs on patch-level activations from DINOv3 [ 52 ] , a self-supervised vision transformer (ViT, 15 ). We evaluate if SAEs can recover fine-grained semantic structure without access to labels in two settings: (1) ADE20K scene segmentation [ 63 ] , containing 150 object classes, and (2) ecological images, where we test recovery of anatomical body parts from the FishVista dataset [ 39 , 40 ] . Both settings provide known semantic structure, so they serve as controlled rediscovery tests of whether SAEs can recover concepts that domain experts already recognize. We find that SAEs reliably extract semantic concepts that were never explicitly labeled in DINOv3’s self-supervised training objective. We compare against decomposition

Read the complete text