Domain-Filtered Knowledge Graphs from Sparse Autoencoder Features Contrastive filtering, multi-scale structure recovery, and edge-labeled mechanism views

John Winnicki, Abeynaya Gnanasekaran, Eric Darve · 2026

Read Domain-Filtered Knowledge Graphs from Sparse Autoencoder Features Contrastive filtering, multi-scale structure recovery, and edge-labeled mechanism views by John Winnicki, Abeynaya Gnanasekaran, Eric Darve (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23829.txt.

Introduction

Winnicki, Gnanasekaran, and Darve turn flat inventories of sparse autoencoder features into domain-filtered knowledge graphs. They first build a strict domain concept universe from a large feature inventory using contrastive activations and multi-stage filtering. Then they build two aligned graph views, a co-occurrence graph for conceptual structure and a mechanism graph linking layers through sparse pathways, with automated edge labels. A biology textbook case study recovers chapter structure and bridging concepts.

Catalog record

CREATORJohn Winnicki, Abeynaya Gnanasekaran, Eric Darve
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67175
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.23829

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Domain-Filtered Knowledge Graphs from Sparse Autoencoder Features Contrastive filtering, multi-scale structure recovery, and edge-labeled mechanism views John Winnicki, Abeynaya Gnanasekaran, Eric Darve Abstract Sparse autoencoders (SAEs) extract millions of interpretable features from a language model, but flat feature inventories aren’t very useful on their own. Domain concepts get mixed with generic and weakly grounded features, while related ideas are scattered across many units, and there’s no way to understand relationships between features. We address this by first constructing a strict domain-specific concept universe from a large SAE inventory using contrastive activations and a multi-stage filtering process. Next, we build two aligned graph views on the filtered set: a co-occurrence graph for corpus-level conceptual structure, organized at multiple levels of granularity, and a transcoder-based mechanism graph that links source-layer and target-layer features through sparse latent pathways. Automated edge labeling then turns these graph views into readable knowledge graphs rather than unlabeled layouts. In a case study on a biology textbook, these graphs recover coherent chapter and subchapter-level structure, reveal concepts that bridge neighboring topics, and transform messy sentence-level activity containing thousands of features into compact, readable views that illustrate the model’s local activity. Taken together, this reframes a flat SAE inventory as an internal knowledge graph that converts feature-level interpretability into a global map of model knowledge and enables audits of reasoning faithfulness. 1 Introduction Sparse autoencoders (SAEs) make it possible to represent internal language-model activations as interpretable features rather than opaque neurons ( 8 ; 23 ; 19 ; 37 ) . Open suites such as Gemma Scope and Llama Scope extend this approach from small-scale demonstrations to large public inventories spanning many layers and thousands of features ( 29 ; 22 ) . Once we move beyond flat feature lists, the problem becomes one of structure rather than enumeration. The goal shifts from adding features to characterizing how concepts are organized and used within the model. This raises three concrete questions. First, which features belong to a coherent domain-specific region, rather than generic or weakly grounded behavior? Second, within that region, how are concepts organized across a corpus, what clusters together, what separates, and what bridges neighboring topics? Third, on a given input, how do local concept neighborhoods evolve, and which upstream concepts support which downstream ones through latent mechanisms? A useful interpretability object should answer all three: it should isolate a relevant conceptual region, reveal its global organization, and expose how that structure is used in local computation. A raw SAE inventory does not answer these questions well. Many highly active features reflect punctuation, formatting, or broad discourse patterns rather than domain-specific concepts, while semantically related ideas are often distributed across multiple neighboring features. At the corpus scale, this obscures how concepts cluster, separate, and bridge across topics. At local scale, the problem is no easier: a single sentence can activate thousands of features across the residual stream, so inspecting features one by one provides little insight into how meaningful concept neighborhoods are actually being used. To study internal conceptual structure across a corpus, we need a representation that is both selective and structured: it must isolate a coherent domain-specific region of feature space, organize the concepts within that region, and expose how local concept neighborhoods participate in downstream computation. In this work, we construct such a representation by first defining a strict domain-specific concept universe, and then organizing it with two aligned graph views: a co-occurrence graph for corpus-level structure, organized at multiple levels of granularity and a transcoder-based mechanism graph for local cross-layer explanation. Our contributions are: • We introduce a multi-stage contrastive filtering process for building a domain-specific concept universe from a much larger SAE inventory. • We build two aligned knowledge-graph views over the retained universe: a multi-granular co-occurrence graph for corpus structure and a transcoder mechanism graph for cross-layer concept flow. • We propose a hierarchical compression over the retained universe, so dense concept and mechanism graphs become readable. • We evaluate the framework on a biology textbook by testing its capability to recover chapter and subchapter-level structure, compress sentence-level activity into a readable mechanism atlas, and produce labeled edge relationships between concepts . 2 Related Work Sparse features at scale. Sparse autoencoders and related dictionary-learning methods established that many model concepts can be decomposed into sparse, often interpretable features ( 8 ; 23 ; 19 ; 37 ) . Open suites such as Gemma Scope and Llama Scope turn that insight into large public inventories, making it realistic to inspect many layers and many tens of thousands of features without rebuilding the sparse stack ( 29 ; 22 ) . A parallel line of work studies how those features should be described or named, from automated neuron explanations to output-centric feature descriptions ( 6 ; 20 ) . Our paper assumes such inventories exist and asks a different question: once the inventory is large enough, what scientific object should replace a flat feature list? Filtering and organization of feature spaces. Recent work shows that SAE feature spaces have meaningful geometry beyond isolated units. SAE geometry work studies local and global organization in feature clouds ( 28 ) , while mechanistic topic models show that interpretable features can support higher-level thematic organization ( 45 ) . Beyond geometry, emerging work studies graph structure directly: Clarke et al. build Jaccard-normalized same-layer co-occurrence graphs that surface strongly co-occurring communities and hub-and-spoke subgraphs, and Balcells et al. extend the graph view across adjacent layers to expose communities, pass-through motifs, and quasi-Boolean feature combinations ( 11 ; 4 ) . These papers are important precedents for treating feature spaces as structured objects. Our contribution differs in emphasis. We do not treat geometry alone as the endpoint; instead, we first define a strict retained universe for a specific corpus and then build multiple graph views on top of it. Thus, our approach connects structural organization of concepts to mechanistic relationships between them in a way that neither geometry nor topic models alone can provide. Circuits, transcoders, and cross-layer feature graphs. Mechanistic work on sparse feature circuits and transcoders moves from feature discovery toward explanatory graphs ( 31 ; 13 ) . Circuit-tracing with transcoders further develops prompt-specific attribution graphs, supernodes, and validation tools for understanding model behavior on individual prompts ( 3 ; 21 ) . Other work studies feature flow and matching across layers ( 27 ) . Our mechanism view is closest in spirit to this literature, but the object is different. Circuit-tracing papers seek prompt-specific causal or quasi-causal graphs tied to outputs; we instead build a source SAE, a target SAE, and a transcoder into a reusable domain-filtered graph framework whose visible source-to-target edges are readable projections of latent-mediated structure. Knowledge graphs and relation extraction. Classical knowledge graphs such as Freebase, NELL, and Wikidata represent information as entities linked by relation triples, and they motivated a large literature on knowledge-base population from text ( 7 ; 10 ; 41 ) . That line of work spans distant supervision for relation extraction, open information extraction, and broader information-extraction pipelines that extend a graph from unstructured corpora ( 34 ; 18 ; 36 ; 32 ) . Our setting is related, but we are not extracting an

Read the complete text