VASAE: Naming SAE Dictionary Directions with Vocabulary-Aligned Anchoring

Kairui Zhang, Ziwen Yu, Zahraa S. Abdallah, Martha Lewis · 2026

Read VASAE: Naming SAE Dictionary Directions with Vocabulary-Aligned Anchoring by Kairui Zhang, Ziwen Yu, Zahraa S. Abdallah, Martha Lewis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-27941.txt.

Introduction

Sparse autoencoders decompose transformer activations into named features. The names are usually assigned after training, though. Kairui Zhang and three colleagues introduce VASAE in 2026 to build names in from the start. Features train under vocabulary-aligned anchoring. Each feature's name is intrinsic. It is the token whose embedding lies nearest to that feature. Reconstruction quality matches a standard sparse autoencoder.

Alignment is strong in most layers tested. With a zero point eight cutoff, dictionaries on GPT-2-small streams align about ninety percent of features in layers zero to ten. Llama-3.1-8B shows the same pattern in shallow and middle layers. Its shallow layer reaches about ninety-two point eight percent aligned features. The final layer is the exception, with limited alignment. Case studies subtract the sentence-level mean sparse code. Many remaining token names then match nearby input tokens. Vocabulary-aligned anchoring thus complements post hoc interpretation of learned dictionaries.

Catalog record

CREATORKairui Zhang, Ziwen Yu, Zahraa S. Abdallah, Martha Lewis
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.27941

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

VASAE: Naming SAE Dictionary Directions with Vocabulary-Aligned Anchoring Kairui Zhang, Ziwen Yu, Zahraa S. Abdallah, Martha Lewis Abstract Sparse autoencoders (SAEs) provide useful decompositions of Transformer residual streams, but their learned features are usually named post hoc rather than directly connected to the Transformer’s token vocabulary. We introduce Vocabulary-Aligned Sparse Autoencoder (VASAE), a method that trains SAE features under vocabulary-aligned anchoring and assigns each feature an intrinsic token name: the token string whose embedding is nearest to that feature. Without reducing reconstruction quality compared with a standard SAE, VASAE produces dictionaries with vocabulary-aligned features. Using a 0.8 cutoff on the nearest-token alignment score, dictionaries trained on GPT-2-small post-residual streams align about 90% of features in layers 0–10. In Llama-3.1-8B, representative shallow and middle-layer dictionaries contain strongly aligned features, including 92.8% in the shallow layer, while the representative final-layer dictionary shows limited alignment. After subtracting the sentence-level mean sparse code, case studies show that many remaining intrinsic token names are relevant to nearby input tokens. These results suggest that vocabulary-aligned anchoring can connect learned features to intrinsic token names during training, complementing post hoc interpretation of learned dictionaries. Project page: https://karry-z.github.io/VASAE/ 1 Introduction Transformer architectures are a central model class for generative AI ( 27 ; 5 ) , and language-model performance has improved with model and data scale ( 15 ) . Their behavior, however, is produced by high-dimensional internal states that are difficult to inspect directly ( 1 ; 12 ) . In decoder-only Transformers, one important state is the residual stream : the vector channel that each Transformer block reads from and writes to ( 7 ) . Understanding this stream matters because it carries the intermediate information from which later layers compute next-token predictions ( 11 ; 12 ) . Sparse Autoencoders (SAEs)are increasingly used to decompose residual streams into sparse codes over learned dictionaries ( 16 ; 10 ) . In this paper, the dictionary is the decoder weight matrix, and a feature is one column, or direction, of that matrix. A sparse code is a vector of feature coefficients. Each entry corresponds to one feature. For a given residual-stream vector, most entries are zero, and a larger nonzero value means that the corresponding feature contributes more strongly to the reconstruction. Recent work uses SAEfeatures for circuit discovery as interpretability tools ( 20 ; 18 ) . Standard SAEs, however, learn features for reconstruction and sparsity rather than direct naming ( 16 ; 10 ) . Feature labels are usually assigned after training by inspecting contexts where the corresponding element of the sparse code is large, or by running a separate automated interpretation procedure ( 3 ; 23 ) , making interpretation a separate post-hoc step. Vocabulary-Aligned Sparse Autoencoder (VASAE)assigns a training-time nearest-token label to each learned decoder direction. The technical bottleneck is that the dictionary geometry and the vocabulary geometry are usually disconnected. Prior work shows that language-model representation spaces have nontrivial geometric structure, including anisotropy and dominant directions ( 8 ; 22 ) . Separately, weight-tying work shows that input and output embeddings are a central vocabulary interface in language models ( 24 ; 17 ) . A learned feature can reconstruct activations while lying far from any token embedding, so it has no intrinsic vocabulary-level name. The opposite design would force the decoder to equal the token embedding matrix; in this paper we test whether this hard-tied decoder is sufficient. The missing object is therefore a learnable dictionary that remains flexible for reconstruction while staying close enough to vocabulary directions to provide candidate token-based names. A token name is a geometry-derived label for a direction. Our key observation is that the language model already contains a model-internal, vocabulary-indexed set of reference directions when the token embeddings share dimensionality with the SAE decoder space: the fixed input token embeddings ( 27 ) . We use these embeddings as anchors, not as frozen features. Based on this observation, we propose VASAE, a SAEwhose learned features are trained with the usual sparse reconstruction objective plus a vocabulary-aligned anchor objective. Each feature is encouraged to stay close to its nearest token embedding, and after training receives an intrinsic token name : the token string whose embedding is nearest to that feature. Here intrinsic means that the name is induced by the trained feature’s location relative to the model’s own vocabulary embeddings. Empirically, VASAEachieves reconstruction metrics comparable to a standard SAEunder the tested settings while adding a geometric vocabulary-alignment signal. Across layers, it has comparable variance explained (VE)on GPT-2-small ( 0.965 ) and Llama-3.1-8B ( 0.931 ), while hard-tying the decoder to token embeddings has lower reconstruction metrics. On GPT-2-small, 89 – 94\% of features in layers L0 – L10 exceed the diagnostic alignment cutoff. With a larger tested anchor coefficient ( \lambda_{\text{anchor}}=5\times 10^{-3} ), Llama-3.1-8B reaches 92.8\% at L0 but remains unstable in the final representative layer. Case studies show intrinsic token names assigned to active features in context. Our contributions are: • We introduce VASAE: a soft vocabulary-anchoring objective that assigns learned SAEdecoder directions nearest-token names. • We evaluate reconstruction under vocabulary anchoring and test whether hard-tying the decoder to token embeddings is sufficient. • We analyze embedding-space feature alignment and vocabulary coverage, and use case studies to show intrinsic token names as geometry-derived identifiers. 2 Background Residual-stream SAEs, token embeddings, and vocabulary readouts all depend on the geometry of Transformer residual states. VASAEuses this geometry to define vocabulary-indexed anchors for learned SAEdecoder directions. 2.1 Transformer Residual Stream Transformer models maintain a persistent residual stream, which carries information across layers ( 27 ; 7 ) . Panel A of Figure 1 shows the standard Transformer structure used in this setup. Let \mathcal{V} be the vocabulary space and let \mathbf{W}_{E}\in\mathbb{R}^{|\mathcal{V}|\times d_{\mathrm{model}}} be the token embedding matrix, where d_{\mathrm{model}} is the model dimension. Throughout the paper, we use a row-vector convention to stay consistent with implementations. For a token v\in\mathcal{V} , we denote its embedding by \mathbf{w}_{v}\in\mathbb{R}^{d_{\mathrm{model}}} and write the initial post-residual stream as \mathbf{h}^{(0)}=\mathbf{w}_{v} . At each layer \ell , the residual stream is updated by adding the outputs of the attention and multi-layer perceptron (MLP)modules: \mathbf{h}^{(\ell)}=\mathbf{h}^{(\ell-1)}+\Attn_{\ell}(\mathbf{h}^{(\ell-1)})+\MLP_{\ell}(\mathbf{h}^{(\ell-1)}). (1) This schematic update omits the sequential sublayer structure and LayerNorm operations of the underlying Pre-LN Transformer blocks. We call \mathbf{h}^{(\ell)}\in\mathbb{R}^{d_{\mathrm{model}}} the layer- \ell post-residual stream: the residual stream after layer \ell has added its attention and MLPoutputs. In this work, all SAEvariants are trained and evaluated on the post-residual stream, not on the intermediate attention or MLPoutputs before they are added back into the residual stream. For autoregressive language models, the final prediction logits are obtained by projecting the last-layer post-residual stream through the unembedding matrix \mathbf{W}_{U}\in\mathbb{R}^{|\mathcal{V}|\times d_{\mathrm{model}}} : \mathbf{u}=\mathbf{h}^{(L)}\mathbf{W}_{U}^{\top}. (2) Embedding and unembedding weight tying is a standard language-model design choice ( 24 ; 17 ) . In the Generative Pre-trained Transformer 2 (GPT-2)-small checkpoint used here ( 25 ) , the embedding and unembedding matrices are tied ( \mathbf{W}_{U}=\mathbf{W}_{E} ). In the Llama-3.1-8B checkpoint used here ( 13 ) , they are not. For models with untied input embeddings and output unembeddings, the choice of anchor matrix is not unique. Input embeddings provide vocabulary-indexed residual directions near the model input, whereas unembedding directions may be more appropriate

Read the complete text