Activation Transport Operators
Andrzej Szablewski, Marek Masiak · 2025
Read Activation Transport Operators by Andrzej Szablewski, Marek Masiak (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17540.txt.
Introduction
Szablewski and Masiak wrote in twenty twenty-five about tracing how features move inside transformer language models. Inside these models, a residual stream carries information between layers. Dictionary methods can locate features in that stream. Patching methods can reveal circuits that compute answers. How features travel along the stream was less studied, though. The authors propose linear maps, called Activation Transport Operators, between layers. They judge those maps in feature space using learned decoders.
Their operators can tell whether a feature was carried forward linearly. They can also spot features newly built by nonlinear computation. A transport efficiency score bounds how much of the stream moves linearly. Tests measured that share across layers in practice. The method is cheap, needing no retraining. It offers tools for safety checks and debugging of models.
Catalog record
| CREATOR | Andrzej Szablewski, Marek Masiak |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-17540
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Activation Transport Operators Andrzej Szablewski, Marek Masiak Abstract The residual stream mediates communication between transformer decoder layers via linear reads and writes of non-linear computations. While sparse-dictionary learning-based methods locate features in the residual stream, and activation patching methods discover circuits within the model, the mechanism by which features flow through the residual stream remains understudied. Understanding this dynamic can better inform jailbreaking protections, enable early detection of model mistakes, and their correction. In this work, we propose Activation Transport Operators (ATO), linear maps from upstream to downstream residuals k k layers later, evaluated in feature space using downstream SAE decoder projections. We empirically demonstrate that these operators can determine whether a feature has been linearly transported from a previous layer or synthesised from non-linear layer computation. We develop the notion of transport efficiency , for which we provide an upper bound, and use it to estimate the size of the residual stream subspace that corresponds to linear transport. We empirically demonstrate the linear transport, report transport efficiency and the size of the residual stream’s subspace involved in linear transport. This compute-light (no finetuning, < 50 <\!50 GPU-h) method offers practical tools for safety, debugging, and a clearer picture of where computation in LLMs behaves linearly. Our code is available at https://github.com/marek357/activation-transport-operators . 1 Introduction Transformer layers modify token-wise residual stream states through a sequence of attention and MLP updates Elhage et al. 2021 . Much of what can be read from these vectors is linear—decoders, probes, and logit-lens all apply affine maps—yet what gets written into the stream is the result of nonlinear mechanisms (LayerNorm, softmax attention, gating in MLPs) Razzhigaev et al. 2024 . Many interpretability tools focus either on locating where a behaviour “lives” or decoding what a representation “means” but they rarely study explicit operators that predict and reconstruct how specific features move from one site in the network to another. On the intervention side, variants of activation and path patching reliably identify layers, heads, and positions that are causally important for a behaviour Goldowsky-Dill et al. 2023 ; Kramár et al. 2024 . Ferrando and Voita 2024 present Information Flow Routes, which push further by constructing global, causally validated flow graphs for predictions, yet—like patching—it characterizes influential paths without yielding an explicit map that predicts downstream hidden states. On the decoding side, logit and tuned lenses nostalgebraist 2020 ; Belrose et al. 2025 , provide affine readouts from intermediate residuals into vocabulary space, and sparse autoencoders (SAEs) recover monosemantic features at scale Cunningham et al. 2023 . Furthermore, in their recent study, Lawson et al. 2025 use multi-layer SAEs to study layer similarity, suggesting some evidence of a split between feature transport and non-linear feature recomputation. Meanwhile, activation steering methods demonstrate powerful control via learned activation edits but focus on exogenous behaviour shaping rather than explaining endogenous feature flow Rodriguez et al. 2024 . This work aims to bridge attribution and representation analysis by introducing Activation Transport Operators (ATOs)—explicit, regularised linear maps that predict downstream residual vectors from upstream residuals. ATOs are learned from paired activations collected during ordinary forward passes. Crucially, ATOs are not a claim that the network is globally linear, but they serve as a test for local linear preservation of a specific feature between two sites in the stream (Figure 1 ). High predictive and causal scores indicate linear transport, while failure indicates downstream feature synthesis or nonlinear recomputation. Our core contributions are as follows: 1) we formally define Activation Transport Operators and empirically study our method using available LLMs and SAEs, evaluating it with per-feature predictive fidelity and causal ablation, and 2) we introduce the notion of transport efficiency, and show its link to the size of the communication subspace of the residual stream. Figure 1 : ATO predicts downstream residual stream vector. Using an SAE, we identify activated features. True and predicted residuals are projected onto SAE decoder vectors and compared. 2 Methodology We study downstream features in a decoder-only transformer through the lens of the residual stream. Let v_{l,i}\in\mathbb{R}^{d} denote the upstream residual vector at layer l and token position i . For a feature f identified at layer l{+}k by its downstream SAE decoder direction d_{f}^{(l+k)}\in\mathbb{R}^{d} , the feature is “observed” at (l{+}k,j) . Our objective is to test whether the downstream activation aligned with f can be linearly attributed to earlier residual states. To this end, we learn an affine, rank-constrained transport operator: T_{r}:\mathbb{R}^{d_{\text{model}}}\!\to\!\mathbb{R}^{d_{\text{model}}},\qquad\hat{v}_{l+k,j}\;=\;T_{r}\,v_{l,i}+b, where we rank-constrain the transport operator by computing the singular value decomposition: T_{r}=U_{r}S_{r}V_{r}^{\top} with rank r\leq{d_{\text{model}}} (and b\in\mathbb{R}^{d_{\text{model}}} ). Location pairs (l,i)\!\to\!(l{+}k,j) are sampled using explicit policies, which we refer to as j -policies . In this work, we use a single j -policy: same-token ( j{=}i ), which maps upstream to downstream for the same position in a sequence. However, in future work, we plan to explore more complex policies, such as attention-reader Top- K , delimiter-pair , and copy-target . The operator is fitted on many such pairs with ridge, lasso, or elasticnet regularisation. Importantly, evaluation is done in feature space rather than on raw residuals. We compare the downstream decoder projections: a_{\text{true}}\;=\;(d_{f}^{(l+k)})^{\top}v_{l+k,j},\qquad a_{\text{pred}}\;=\;(d_{f}^{(l+k)})^{\top}\hat{v}_{l+k,j}\;=\;(d_{f}^{(l+k)})^{\top}\!\left(T_{r}\,v_{l,i}+b\right) (1) using regression metrics (specifically, R^{2} and MSE). High agreement indicates that the component of the downstream state relevant to f is transported through a low-dimensional linear channel. On the other hand, poor agreement (despite reasonable upstream sources and policies) suggests the activation is synthesised locally by later non-linear computations. We causally validate the transport operators by ablating the upstream site (l,i) (i.e., zeroing or projecting out the upstream gate) and injecting the reconstructed vector \hat{v}_{l+k,j} at the target. Restoration of the feature projection and associated behaviour (e.g., structured-format correctness or continuation accuracy) provides direct evidence of linear transport along the learned operator. Additionally, we compare the results with the zero intervention , which involves completely ablating the downstream residual vector by setting it to zero ( Mohebbi et al. 2023 ; Olsson et al. 2022 ) . We include this comparison to quantify the maximum corruption we can introduce to the residual stream, thereby measuring the model error (e.g. perplexity increase) if the residual stream contains no information at layer l{+}k . We expect this to be significantly larger than the error induced by transport operators. Transport efficiency To better understand the process of feature transport, we seek to find the upper bound for R^{2} of our rank- r transport operator. Hence, we define the R^{2}_{\text{ceiling}} as the maximal R^{2} value achievable by any linear predictor at rank r . In this analysis, we shift our focus to the task of predicting downstream residual stream vectors, stacked in matrix Y\in\mathbb{R}^{N\times d_{\text{model}}} from upstream residual stream vectors, stacked in matrix X\in\mathbb{R}^{N\times d_{\text{model}}} . Assuming zero-mean, the ceiling for transport efficiency at rank r is given by: R^{2}_{\text{ceiling}}(r,\,Y)\;=\;\frac{1}{d_{\text{model}}}\sum_{i=1}^{r}\rho_{i}^{2} , where \rho_{i}^{2} are the squared canonical correlations. In Appendix A we rigorously derive this upper bound. Therefore, we can define the transport efficiency as: \text{Eff}=\tilde{R^{2}}(r,\hat{Y}_{T})/R^{2}_{\text{ceiling}}(r,Y)\in\left[0,1\right] , where \tilde{R^{2}}(r,\hat{Y}_{T}) is the R^{2} metric of rank- r -ATO-predicted downstream residual vectors in whitened Y space . We need to transform the ATO predictions to the whitened Y space to allow for apples–to–apples comparison of explained variance. Transport efficiency plateaus when