Measuring the Representational Alignment of Neural Systems in Superposition
Sunny Liu, Habon Issa, André Longon, Liv Gorton, Meenakshi Khosla, David Klindt · 2026
Read Measuring the Representational Alignment of Neural Systems in Superposition by Sunny Liu, Habon Issa, André Longon, Liv Gorton, Meenakshi Khosla, David Klindt (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00208.txt.
Introduction
Liu and six colleagues show that alignment metrics, similarity analysis, kernel methods, linear regression track activity readings rather than hidden feature content. When systems encode more feature types than neurons through compression, in superposition, these metrics follow projection Gram matrices instead of latent feature sets. Two networks with same feature content can look less alike than networks sharing part of their feature set. Training supervised TopK sparse autoencoders built for solvable compressed sensing brings back alignment on regained latents, extending to unsupervised and ready-made vision and language models.
Catalog record
| CREATOR | Sunny Liu, Habon Issa, André Longon, Liv Gorton, Meenakshi Khosla, David Klindt |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35309 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.00208
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Measuring the Representational Alignment of Neural Systems in Superposition Sunny Liu, Habon Issa, André Longon, Liv Gorton, Meenakshi Khosla, David Klindt Abstract Comparing the internal representations of neural networks is a central goal in both neuroscience and machine learning. Standard alignment metrics operate on raw neural activations, implicitly assuming that similar representations produce similar activity patterns. However, neural systems frequently operate in superposition , encoding more features than they have neurons via linear compression. We derive closed-form expressions showing that superposition systematically deflates Representational Similarity Analysis, Centered Kernel Alignment, and linear regression, causing networks with identical feature content to appear dissimilar. The root cause is that these metrics are dependent on cross-similarity between two systems’ respective superposition matrices, which under assumption of random projection usually differ significantly, not on the latent features themselves: alignment scores conflate what a system represents with how it represents it. Under partial feature overlap, this confound can invert the expected ordering, making systems sharing fewer features appear more aligned than systems sharing more. Crucially, the apparent misalignment need not reflect a loss of information; compressed sensing guarantees that the original features remain recoverable from the lower-dimensional activity, provided they are sparse. We therefore argue that comparing neural systems in superposition requires extracting and aligning the underlying features rather than comparing the raw neural mixtures. 1 Introduction Figure 1: Illustration of core idea. Left) Superposition: Two neural networks share an identical set of latent features ( Z_{a}=Z_{b} ), but compress them (red arrows) via different projection matrices, yielding distinct neural activations Y_{a}\neq Y_{b} . Computing alignment over these raw activations leads to artificially low representational similarity. Middle) Linear regression: Assuming perfect latent recovery, the maximum pairwise correlation between latent activations is 1.0 , and will be greater than the correlation between raw neural activations. Right) Representational similarity analysis: RSA first computes pairwise (dis)similarity matrices of neural responses, then correlates these matrices to produce an alignment score. As with linear regression, the RSA score for perfectly recovered latents is 1.0 , and greater than the RSA score over neural activations. Superposition. Superposition posits that neural networks linearly encode more features than they have neurons, distributing features across overlapping neural codes [ 27 , 9 , 17 ] . Formally, if z\in\mathbb{R}^{n} denotes a vector of latent features and y\in\mathbb{R}^{m} the neural response, a system in superposition computes y=Az where A\in\mathbb{R}^{m\times n} with m<n . To illustrate, consider the left panel of Figure 1 : a six-dimensional latent vector z is linearly projected into three-dimensional neural responses for two systems, y_{a} and y_{b} . Although both systems encode the same features, their projection matrices differ, producing distinct neural activity patterns. Superposition typically gives rise to mixed selectivity , or polysemanticity , where individual neurons respond to multiple unrelated features [ 24 , 2 ] , though some neurons may remain selective to a single feature, i.e., clean selectivity or monosemanticity . Importantly, while this compression is lossy in general, compressed sensing theory guarantees that the original features can be perfectly recovered from the lower-dimensional neural activity, provided the features are sufficiently sparse and the projection satisfies certain conditions [ 8 ] (see Section 2.1 ). Thus, information is scrambled and distributed but not destroyed, meaning that a neural system can still access it [ 1 , 13 , 11 ] . In this work: We assume superposition and ask: what are the consequences for representational alignment? Representational alignment. A central goal in both neuroscience and machine learning is to quantitatively compare the internal representations of different neural systems [ 19 , 18 , 28 ] . Standard practice is to record neural responses from two systems to a shared set of stimuli, then apply an alignment metric to quantify their similarity. The most widely used metrics include Representational Similarity Analysis (RSA) [ 19 ] , which correlates pairwise dissimilarity matrices; Centered Kernel Alignment (CKA) [ 18 ] , which compares kernel matrices of neural responses; and linear regression, which measures how well one representation can be linearly predicted from the other. These metrics have yielded insights into shared structure between artificial and biological visual systems [ 29 , 15 , 4 , 16 , 6 , 22 ] and across language models [ 26 ] . A common empirical finding is that measured alignment tends to increase with model size [ 18 , 14 , 23 ] . Yet neural networks with the highest alignment scores are not always the most behaviorally similar, leading to a puzzling gap between alignment and performance [ 25 ] . Notably, all of these metrics operate on raw neural activations (e.g., the distinct neural activity patterns y_{a} and y_{b} in Figure 1 ). If two systems solve the same task using the same features but arrange them differently across neurons, their behavior may be identical while their neural responses diverge. This raises a fundamental question: do standard alignment metrics faithfully capture the shared computational structure of neural systems, or are they confounded by properties of the neural code itself? Alignment under superposition. We propose that superposition is a key confound for alignment metrics. When two networks encode the same set of latent features but mix them differently across neurons (as is inevitable given different initializations, architectures, or training runs) their raw neural activations will differ even though their underlying feature content is identical (Figure 1 , left). Because metrics like RSA and CKA operate on pairwise similarities of neural responses, they are directly affected by how features are mixed: the greater the compression (i.e., the more features are packed into fewer neurons), the more distorted these pairwise similarities become, and the lower the measured alignment. This creates a systematic bias: higher-dimensional models may appear more aligned simply because they can represent features with less superposition, not because they share more features. This hypothesis is consistent with recent empirical evidence showing that larger models are more aligned [ 10 ] and that disentangling superposition can increase alignment [ 20 ] . Crucially, this deflation of alignment does not reflect a genuine loss of shared information. If the conditions for compressed sensing are satisfied, the original high-dimensional features remain fully recoverable from the compressed neural activity [ 8 ] . Two networks may thus have distinct, distorted “views” in their raw neural space while remaining perfectly aligned in their latent feature space. This distinction becomes especially important when comparing systems of different sizes, or when asking how many features two systems truly share. Contributions. In this work, we make the following contributions: 1. Analytic theory. We derive closed-form expressions showing how superposition deflates RSA, CKA with linear kernel, and linear regression (Section 3 ). In each case, alignment depends on the Gram matrices G=A^{\mathsf{T}}A of the projection matrices rather than on the latent features themselves, revealing the precise mechanism by which superposition confounds alignment. 2. Simulations under identical features. We validate our analytic predictions through numerical simulations, confirming that alignment decreases monotonically with increasing superposition compression even when two systems encode the exact same features (Section 4.1 ). 3. Simulations under partial feature overlap. We extend our analysis to the realistic setting where two systems share only a subset of features. We show that