Can Cross-Layer Transcoders Replace Vision Transformer Activations? An Interpretable Perspective on Vision
Gerasimos Chatzoudis, Konstantinos D. Polyzos, Zhuowei Li, Difei Gu, Gemma E. Moran, Hao Wang, Dimitris N. Metaxas, [6pt] Rutgers University · 2026
Read Can Cross-Layer Transcoders Replace Vision Transformer Activations? An Interpretable Perspective on Vision by Gerasimos Chatzoudis, Konstantinos D. Polyzos, Zhuowei Li, Difei Gu, Gemma E. Moran, Hao Wang, Dimitris N. Metaxas, [6pt] Rutgers University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13304.txt.
Introduction
Chatzoudis and six colleagues test whether Cross-Layer Transcoders can stand in for Vision Transformer activations in an interpretable way. Sparse autoencoders work layer by layer and miss cross-layer structure, so the authors rebuild each post-MLP activation from sparse embeddings of earlier layers. Trained on CLIP vision models across three datasets, the transcoders reconstruct activations faithfully and preserve zero-shot accuracy. Their layer scores show the final representation rests on a small set of dominant terms.
Catalog record
| CREATOR | Gerasimos Chatzoudis, Konstantinos D. Polyzos, Zhuowei Li, Difei Gu, Gemma E. Moran, Hao Wang, Dimitris N. Metaxas, [6pt] Rutgers University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65858 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.13304
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Can Cross-Layer Transcoders Replace Vision Transformer Activations? An Interpretable Perspective on Vision Gerasimos Chatzoudis, Konstantinos D. Polyzos, Zhuowei Li, Difei Gu, Gemma E. Moran, Hao Wang, Dimitris N. Metaxas, [6pt] Rutgers University Abstract Understanding the internal activations of Vision Transformers (ViTs) is critical for building interpretable and trustworthy models. While Sparse Autoencoders (SAEs) have been used to extract human-interpretable features, they operate on individual layers and fail to capture the cross-layer computational structure of Transformers, as well as the relative significance of each layer in forming the last-layer representation. Alternatively, we introduce the adoption of Cross-Layer Transcoders (CLTs) as reliable, sparse, and depth-aware proxy models for MLP blocks in ViTs. CLTs use an encoder–decoder scheme to reconstruct each post-MLP activation from learned sparse embeddings of preceding layers, yielding a linear decomposition that transforms the final representation of ViTs from an opaque embedding into an additive, layer-resolved construction that enables faithful attribution and process-level interpretability. We train CLTs on CLIP ViT-B/32 and ViT-B/16 across CIFAR-100, COCO, and ImageNet-100. We show that CLTs achieve high reconstruction fidelity with post-MLP activations while preserving and even improving, in some cases, CLIP zero-shot classification accuracy. In terms of interpretability, we show that the cross-layer contribution scores provide faithful attribution, revealing that the final representation is concentrated in a smaller set of dominant layer-wise terms whose removal degrades performance and whose retention largely preserves it. These results showcase the significance of adopting CLTs as an alternative interpretable proxy of ViTs in the vision domain. 1 Introduction Figure 1 : Overview of the Cross-Layer Transcoder (CLT) framework. Left : Each CLT encodes LN2 activations into sparse codes z_{\ell} and reconstructs MLP outputs y_{\ell} via triangular decoders. Middle : During inference, CLTs replace MLPs across layers, preserving zero-shot performance. Right : Using CLTs as an interpretable proxy for ViTs to understand the cross-layer contributions of different token types and identify the most significant layers in shaping the ViT’s final representations. Foundation Models (FMs) have shown strong generalization performance in diverse tasks ranging from classification to open-ended generation ( 28 ; 18 ; 36 ; 21 ; 1 ) . Despite their empirical success, these models remain largely opaque, limiting interpretability as well as controllability and reliability in practice. Particularly on the vision domain, understanding the internal representations of the widely-used Vision Transformers (ViTs) remains an open challenge for building interpretable, controllable, and verifiable models. Although existing approaches, including Sparse Autoencoders 19 ; 32 ; 5 have aimed to show that transformer activations can be organized into human-interpretable components, they operate locally , learning features only within a single layer. Consequently, they fall short in capturing cross-layer interdependencies or the relative contribution of each layer to the final-layer representation, providing limited insight into how information is transformed across network depth. Aiming to advance interpretable vision models and inspired by their use in the language domain, we propose a novel interpretable perspective on vision by leveraging Cross-Layer Transcoders (CLTs). Specifically, our goal is to judiciously integrate CLTs as an alternative framework for analyzing the internal structure of transformer representations within Vision Transformers (ViTs). CLTs aim to reconstruct the post-MLP activations at a target layer from sparse features computed in earlier layers enabling a directed, cross-layer decomposition of each representation. This allows for a proper assessment of the contribution of each source layer to a given target layer. When CLTs are accurate enough to replace the original MLP blocks, the resulting CLT-based ‘replacement’ model can serve as a reliable proxy for analyzing the original transformer without compromising the ViT model performance on the downstream task. While CLTs have been used to identify attribution graphs in Large Language Models (LLMs) 2 , to the best of our knowledge their proper adoption for vision models as interpretable alternatives has not been explored yet. Unlike autoregressive language models in the language domain, where all tokens share a uniform sequential structure, ViTs operate over spatially structured patch tokens with additional degrees of freedom, including varying patch granularity, two-dimensional spatial dependencies, and, in some ViTs, a global [CLS] token that serves a fundamentally different computational role. These fundamental differences of the language and vision domains naturally render the practical utility of CLTs to the vision domain a distinct and nontrivial question that is yet to be explored. To that end, in this paper we investigate the practical utility and benefits of CLTs in ViTs by addressing the following open research questions: RQ1: Functional Replacement. Can CLTs functionally replace MLP blocks in Vision Transformers as an alternative interpretable proxy ? We aim to evaluate whether CLTs can faithfully reconstruct post-MLP activations from sparse features of earlier layers, and whether such replacements preserve downstream classification performance under different sparsity schemes and replacement strategies within CLTs. RQ2: Interpretable Cross-Layer Contribution. Can CLTs provide faithful attribution as well as process-level interpretability? We aim to investigate whether the sparse, depth-ordered structure of CLTs supports meaningful interpretation of internal ViT representations by quantifying layer-wise influence using cross-layer contribution scores. Specifically, our goal is to provide both quantitative and example-based evidence of how different layers shape the final representation, yielding interpretable cross-layer contributions. Driven by these open research questions, the contributions of the present work can be summarized as follows: • CLTs for Vision. We investigate the effectiveness of Cross-Layer Transcoders in Vision Transformers, enabling sparse, cross-layer reconstruction of post-MLP activations from earlier layers. • Accurate MLP Replacement in key regimes. CLTs can replace MLP blocks, especially in later layers or for [CLS] tokens across all layers, preserving and even improving in some cases zero-shot classification performance. Consequently, CLTs serve as a reliable proxy for the original ViT to investigate how earlier layers contribute across depth of the model. • Interpretability via Cross-Layer Attribution. Projection-based contribution scores show that patch tokens exhibit strongly diagonal-dominant attribution, with each layer primarily explaining its own post-MLP output, while the [CLS] token draws credit broadly across depth, aggregating information from many preceding layers. • Faithful attribution reveals concentrated credit across depth. Ablation experiments demonstrate that the final-layer representation is predominantly shaped by a small subset of source layers: retaining only the top-4 out of 12 layers recovers original model’s accuracy, while removing the single highest-scored layer causes substantial degradation. This corroborates that the projection-based scores faithfully identify the layers that are most significant in forming the output representation. 2 Related Work Mechanistic Interpretability and Sparse Autoencoders. A wide range of methods have been proposed to interpret vision models, including feature visualization ( 31 ; 37 ; 27 ) and network dissection ( 3 ; 25 ) . More recently, Mechanistic Interpretability has emerged as a systematic approach to analyzing and understanding neural networks ( 12 ; 26 ) . A central challenge in this area is the presence of polysemantic neurons, i.e., units that respond to multiple, seemingly unrelated inputs, arising from superposition. Superposition is the phenomenon where networks encode more features than the available dimensions allow, forcing different concepts to share the same activations ( 11 ) . Recent efforts have leveraged SAEs to uncover interpretable features within LLMs ( 34 ; 8 ; 14 ) . Sparse Autoencoders (SAEs) have been employed to alleviate superposition by learning sparse, overcomplete representations of internal model activations via