Transferring Features Across Language Models With Model Stitching
Alan Chen, Jack Merullo, Alessandro Stolfo, Ellie Pavlick · 2025
Read Transferring Features Across Language Models With Model Stitching by Alan Chen, Jack Merullo, Alessandro Stolfo, Ellie Pavlick (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06609.txt.
Introduction
Small and large language models may learn much the same inner patterns, and Alan Chen and co-authors test that idea in work from twenty twenty-five. Their method maps the inner stream of one model onto the stream of another with a simple straight-line shift. That shift lets parts trained on one model move to the other.
Tests moved parts that pick out single traits, plus probes and steering tools, from small models to large ones. The moved parts kept much of their skill, and starting a large model with a moved part cut training costs by about half in one case. Trait by trait, some kinds of traits moved cleanly while others did not. The work hints at cheaper ways to train large models.
Catalog record
| CREATOR | Alan Chen, Jack Merullo, Alessandro Stolfo, Ellie Pavlick |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-06609
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Transferring Features Across Language Models With Model Stitching Alan Chen, Jack Merullo, Alessandro Stolfo, Ellie Pavlick Abstract In this work, we demonstrate that affine mappings between residual streams of language models is a cheap way to effectively transfer represented features between models. We apply this technique to transfer the weights of Sparse Autoencoders (SAEs) between models of different sizes to compare their representations. We find that small and large models learn similar representation spaces, which motivates training expensive components like SAEs on a smaller model and transferring to a larger model at a FLOPs savings. In particular, using a small-to-large transferred SAE as initialization can lead to 50% cheaper training runs when training SAEs on larger models. Next, we show that transferred probes and steering vectors can effectively recover ground truth performance. Finally, we dive deeper into feature-level transferability, finding that semantic and structural features transfer noticeably differently while specific classes of functional features have their roles faithfully mapped. Overall, our findings illustrate similarities and differences in the linear representation spaces of small and large models and demonstrate a method for improving the training efficiency of SAEs. 1 Introduction Large language models (LLMs) have continually proven to be surprisingly intricate next token predictors that become more complex yet predictably better with scale [ Kaplan et al. 2020 ] , leaving a desire to characterize and explain the LLM’s computations [ Saphra and Wiegreffe 2024 , Olah et al. 2020 ] . Despite increasing efforts to study the rich internal mechanisms and representations of LLMs, the full computations still remain opaque [ Sharkey et al. 2025 , Engels et al. 2024 ] . A popular perspective to view the internal computation of LLMs is through the lens of features, or functions of the input that serve a downstream purpose like predicting the next token or composing to form model circuits [ Olah et al. 2020 , Huben et al. 2024 ] . The Linear Representation Hypothesis (LRH) posits that these features are represented as directions in a high dimensional space [ Park et al. 2024 , Elhage et al. 2022 ] and sparse dictionary learning methods [ Olshausen and Field 1996 , Faruqui et al. 2015 , Serre 2006 ] such as Sparse Autoencoders (SAEs) have recently gained popularity for interpreting models through this lens [ Huben et al. 2024 , Bricken et al. 2023 , Gao et al. 2025 , Kissane et al. 2024 ] . A second hypothesis, Strong Model Universality [ Li et al. 2015 ] , predicts that good models learn the same data representations. While it is unlikely that the strongest versions of these hypotheses faithfully reflect how these models work (that is, every feature is represented as a direction and every feature should be represented universally across good models) [ Engels et al. 2025b , Csordás et al. 2024 , Wei et al. 2022 ] , there is significant evidence to support weaker versions of both hypotheses: linear features have been used to probe and intervene on model representations [ Zou et al. 2023 , Panickssery et al. 2023 , i.a.] and are the fundamental idea underlying SAEs. One form of evidence for universality is model stitching, which learns a transformation mapping the latent spaces of two models [ Lenc and Vedaldi 2015 , Bansal et al. 2021 ] . If the transformation is sufficiently simple, then it is claimed that the models encode information similarly. Other evidence includes recent work in “model diffing” [ Lindsey et al. 2024 ] using crosscoders, a variant of SAEs, and transferring SAEs between base and chat models [ Kissane et al. 2024 ] to study the effects of post-training. Our work relies on the ansatz that if two models represent enough features as directions in similarly organized spaces, we should be able to transfer interpretable linear features between them. We propose the use of model stitches as the mappings for learned representations between language models. Our contributions (Figure 1 ) can be summarized as follows: 1. We learn stitches to transfer SAEs (§ 3 ) trained on one model to another, which are used to initialize SAE training runs on larger models with those trained on smaller ones (§ 3.1 ), allowing for an 50% FLOPs savings. We also demonstrate that stitches can be used to transfer probes and steering vectors (§ 4 ). 2. The stitches are affine mappings trained on within-family model pairs in Pythia [ Biderman et al. 2023 ] , GPT2 [ Radford et al. 2019 ] , and Gemma-2 [ Team et al. 2024 ] . We find downstream metrics are preserved by the mappings, supporting weak universality (§ 2 ). 3. We perform a fine-grained analysis on feature transfer and analyze how well semantic and structural features transfer using the stitch (§ 5.1 ). We also find SAE features representing well-known universal functional features and note their transferability (§ 5.2 ). 2 Language Model Stitching Figure 1 : Overview of the main methodologies. (a) We train two affine mappings \mathcal{T}_{\uparrow,\downarrow} concurrently to map between the residual streams of two language models A and B . The mappings \mathcal{T}_{\uparrow,\downarrow} are then used to transfer (b) the weights of entire SAEs from A to B , which (c) give better initializations that save compute when training SAEs on B . The approximate “scaling law” for SAE training is shifted to the left when training from the transferred initialization, capturing the intuition that the transferred initialization saves the work of relearning shared features. More generally, the stitches can be used to transfer (d) arbitrary vectors (probes, steering vectors) between the residual stream spaces. We would like to learn a mapping from the residual stream of language model A to model B at some layers, such that computation can start in the layers of A and finish in B (see Figure 1 a). As notation, let \textbf{LM}^{\ell}(t)\in\mathbb{R}^{d_{\textbf{LM}}} denote the representation in model LM of input token(s) t which has hidden state dimension d_{\textbf{LM}} at layer \ell . Model stitching learns a mapping \mathcal{T} (the stitch ) between two model-layer pairs (A,\ell_{A}) and (B,\ell_{B}) . Informally, we would like \left[\mathcal{T}\circ A^{\ell_{A}}\right](t)\approx B^{\ell_{B}}(t) where \circ is function composition. The existence of such a mapping \mathcal{T} relies on at least weak universality, especially if \mathcal{T} preserves the hypothesis classes of model A and B . We are interested in the particular case when A and B are decoder-only language models from the same family (trained on the same data) but d_{B}\geq d_{A} . In this setup (visualized in Figure 1 a), we will consider the two stitching mappings \mathcal{T}_{\uparrow} , which maps “up” from A to B , and \mathcal{T}_{\downarrow} , which maps “down” from B to A . Furthermore, we will assume that both \mathcal{T}_{\uparrow} and \mathcal{T}_{\downarrow} are affine transformations: \displaystyle\mathcal{T}_{\uparrow}:\mathbb{R}^{d_{A}}\to\mathbb{R}^{d_{B}} \displaystyle,\quad h_{A}\mapsto h_{A}P_{\uparrow}+b_{\uparrow}, (1) \displaystyle\mathcal{T}_{\downarrow}:\mathbb{R}^{d_{B}}\to\mathbb{R}^{d_{A}} \displaystyle,\quad h_{B}\mapsto h_{B}P_{\downarrow}+b_{\downarrow}, (2) where h_{A} and h_{B} are activations from A and B , P_{\uparrow}\in\mathbb{R}^{d_{A}\times d_{B}} , b_{\uparrow}\in\mathbb{R}^{d_{B}} , P_{\downarrow}\in\mathbb{R}^{d_{B}\times d_{A}} , and b_{\downarrow}\in\mathbb{R}^{d_{A}} . Ideally, we would like \mathcal{T}_{\{\uparrow,\downarrow\}} to be faithful to the downstream objective (i.e., language modeling). In practice, training directly on the next-token prediction objective would involve backpropagating gradients over the back halves of A and B