Semantic Convergence: Investigating Shared Representations Across Scaled LLMs

Daniel Son, Sanjana Rathore, Andrew Rufail, Adrian Simon, Daniel Zhang, Soham Dave, Cole Blondin, Kevin Zhu, Sean O’Brien · 2025

Read Semantic Convergence: Investigating Shared Representations Across Scaled LLMs by Daniel Son, Sanjana Rathore, Andrew Rufail, Adrian Simon, Daniel Zhang, Soham Dave, Cole Blondin, Kevin Zhu, Sean O’Brien (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22918.txt.

Introduction

Daniel Son and co-authors test whether two Gemma language models of unlike size carve the world into like inner features, in a paper from two thousand twenty-five. Sparse autoencoders pulled clean single-sense features from each model's stream. Matched features were then compared by two gauges.

Middle layers overlapped most, while first and last layers split apart. Word chunks with like sense also met the models alike in early side tests. The pattern backs a shared feature world across scale. That sharing could ground tools that move insight between models. Readers get size-proof hints of one inner map.

Catalog record

CREATORDaniel Son, Sanjana Rathore, Andrew Rufail, Adrian Simon, Daniel Zhang, Soham Dave, Cole Blondin, Kevin Zhu, Sean O’Brien
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-22918

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Semantic Convergence: Investigating Shared Representations Across Scaled LLMs Daniel Son, Sanjana Rathore, Andrew Rufail, Adrian Simon, Daniel Zhang, Soham Dave, Cole Blondin, Kevin Zhu, Sean O’Brien Abstract We investigate feature universality in Gemma-2 language models (Gemma-2-2B & Gemma-2-9B), asking whether models with a fourfold difference in scale still converge on comparable internal concepts. Using the sparse autoencoder (SAE) dictionary learning pipeline, we used pretrained SAEs on each model’s residual-stream activations, aligned the resulting monosemantic features via activation correlation, and compared the matched feature spaces with metrics such as SVCCA and RSA. Middle layers yield the strongest overlap, indicating that this is where both models most similarly represent concepts, while early and late layers show much less similarity. Preliminary experiments extending the analysis from single tokens to multi-token subspaces show that semantically similar subspaces tend to interact similarly with LLMs. These results offer further evidence that large language models carve the world into broadly similar, interpretable features despite size differences, reinforcing universality as a foundation for cross-model interpretability. 1 Introduction Large Language Models (LLMs) ( Achiam et al. 2023 ; Touvron et al. 2023 ; Guo et al. 2025 ) have demonstrated increasing reasoning abilities across many tasks ( Bubeck et al. 2023 ) . However, our understanding of the internal representations and computations that support this behavior remains limited ( Bereska and Gavves 2024 ) . Previous work ( Lan et al. 2024 ) has shown that models with the same tokenizer rely on similar internal representations and structures, indicating that universal feature spaces might exist. We define a feature as being universal if its activation corresponds to the same semantic concept regardless of model size or architecture. Universal feature spaces may be encoded across different layers or neurons in different models, but there would exist a sparse direction in each model’s activation space that consistently “lights up” on these concepts. Understanding universal feature spaces is a crucial step in learning if general rules govern how LLMs internally structure and use their nodes. This key would increase the generalizability of interpreting different LLMs and may accelerate LLM training efficiency as well as LLM safety ( Chughtai et al. 2023 ; Gurnee et al. 2024 ; Bricken et al. 2023 ) . Comparing features between LLMs is challenging because nodes in the model usually represent multiple features, rather than one specific feature. This is called polysemanticity ( Elhage et al. 2022 ) . In this paper, we build on the methods shown in Lan et al. 2024 that leverage Sparse Autoencoders (SAEs) to transform LLM node activations into lower dimensional spaces that are easier to interpret. The main advantage of using SAEs is that they have the ability to decompose the complex, polysemantic representations in an LLM into distinct features that can be interpreted more easily ( Cunningham et al. 2023 ; Bricken et al. 2023 ) . Then, representational space similarity metrics are used on these SAE features to check for similarities in the internal structure of the LLM. Although results for feature universality in Lan et al. 2024 were promising, only single token words, in a limited number of semantic subspaces, were tested for the semantic experiments. Furthermore, the experiments were only carried out against similar sized models, namely Pythia-70m with Pythia-160m ( Biderman et al. 2023 ) and Gemma-1-2B with Gemma-2-2B ( Team et al. 2024b ; Team et al. 2024a ) . Therefore, in this paper, we will further investigate the universality of feature spaces. In our experiments, we use models with a four fold size difference. Our results demonstrate that the similarity in internal feature representations remains across these models despite difference in complexity. Furthermore, in our semantic subspaces studies, we show that there are certain groups of overlapping concepts that the models internally represent similarly. This is another indication of feature universality. In summary, our contributions are the following: 1. Probe universality in multi-token semantic subspaces, including overlaps of related concepts, to see whether phrase-level and higher-order features align across models. 2. Quantify universality across a 4× model-size gap and compare similarity measures (e.g., SVCCA, RSA) to test how metric choice affects the result. Our results reveal that, despite the fourfold size difference, models share strongly aligned internal representations. In addition, we demonstrate that conceptually coherent semantic groups align. We also illustrate that models encode multi-token phrases across the layers, where phrases are represented more strongly than individual tokens in the earlier layers. Understanding whether different-sized language models develop similar internal representations has significant practical implications. If models trained independently converge to shared semantic features, this suggests the existence of a common representational structure, opening the door to transferable interpretability tools, cross-scale safety interventions ( Engels et al. 2025 ) , and more efficient model distillation pipelines ( Turc et al. 2019 ) . These insights could fundamentally reshape how we evaluate, interpret and design future language models. This result supports the idea that universality is a structural property of the Gemma family, not an accident of size or training noise. It gives practitioners a clear path to build and test interpretability tools on the lighter 2 B model before deploying them unchanged on the 9 B model. Similar mid-layer convergence has also been reported for the Pythia family (70 M → 160 M) by Lan et al. 2024 . Taken together with our Gemma results, this suggests that feature universality extends across at least two independent model families. This work opens up several branches of future research that we believe are worth studying. Training SAEs on multiple model layers can reveal internal representations that are not captured in a single layer. In addition, comparing the internal representations of SAEs trained on MLP layers may provide deeper insights about the universality of MLP features. These findings can accelerate AI reasoning and safety training ( Hendrycks et al. 2023 ) . Through understanding the similarities between models, and their differences, a more complete picture of how LLMs process, reason and understand natural language would be formed ( Lan et al. 2024 ) . Figure 1: Workflow of pairing rows with the highest correlated features between two models (Gemma-2-2B and Gemma-2-9B) and performing similarity tests to assess feature alignment. 2 Background Sparse Autoencoders . Sparse Autoencoders (SAEs) are a type of neural network used to learn efficient, sparse representations of input data ( Makhzani and Frey 2013 ) . Unlike other autoencoders, SAEs incorporate a sparsity constraint, typically an L1 penalty on the hidden layer activations or a KL divergence term, which pushes most hidden units to be inactive (i.e. any output values close to zero) for any input given. This leads to features that are more interpretable and disentangled. The aim is to discover a basis of features, similar to dictionary learning ( Olshausen and Field 1997 ) , where each feature activates for semantically meaningful concepts. Mathematically, an input x\in\mathbb{R}^{n} is given to the neural network which is reconstructed into \hat{x} using \hat{x}=W^{\prime}\sigma(Wx+b) , where W\in\mathbb{R}^{hxn} is the encoder weight matrix, b is the bias term, \sigma is a nonlinear activation function, and W^{\prime} is the decoder matrix, which often uses the transpose of the encoder weights. SAE training seeks to both encourage sparsity in

Read the complete text