Polysemy of Synthetic Neurons Towards a New Type of Explanatory Categorical Vector Spaces
Michael Pichat 1,2,4 , William Pogrund 1,5 , Paloma Pichat 1,3 , Judicael Poumay 1 , Armanouche Gasparian 1 , Samuel Demarchi 1,4 , Martin Corbet 1,2 , Alois Georgeon 1,2 , Michael Veillet-Guillem · 2025
Read Polysemy of Synthetic Neurons Towards a New Type of Explanatory Categorical Vector Spaces by Michael Pichat 1,2,4 , William Pogrund 1,5 , Paloma Pichat 1,3 , Judicael Poumay 1 , Armanouche Gasparian 1 , Samuel Demarchi 1,4 , Martin Corbet 1,2 , Alois Georgeon 1,2 , Michael Veillet-Guillem (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-07831.txt.
Introduction
Michael Pichat and co-authors propose a new view of polysemy in artificial neurons in a 2025 paper. Single neurons in language models often respond to many unrelated features. The standard account blames superposition: too many features packed into too few dimensions of the latent space.
The authors instead define a neuron geometrically as a categorical vector space. Its basis directions come from sub dimensions extracted from neurons in the previous layer. An attention process inside the neuron then selects a critical zone where those categories overlap. That zone, they argue, is more homogeneous and explains how the model uses the neuron efficiently.
Catalog record
| CREATOR | Michael Pichat 1,2,4 , William Pogrund 1,5 , Paloma Pichat 1,3 , Judicael Poumay 1 , Armanouche Gasparian 1 , Samuel Demarchi 1,4 , Martin Corbet 1,2 , Alois Georgeon 1,2 , Michael Veillet-Guillem |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-07831
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Polysemy of Synthetic Neurons Towards a New Type of Explanatory Categorical Vector Spaces Michael Pichat 1,2,4 , William Pogrund 1,5 , Paloma Pichat 1,3 , Judicael Poumay 1 , Armanouche Gasparian 1 , Samuel Demarchi 1,4 , Martin Corbet 1,2 , Alois Georgeon 1,2 , Michael Veillet-Guillem Abstract The poly-semantic nature of synthetic neurons in artificial intelligence language models is currently understood as the result of a necessary superposition of distributed features within the latent space. We propose an alternative approach, geometrically defining a neuron in layer n n as a categorical vector space, with a non-orthogonal basis, composed of categorical sub-dimensions extracted from preceding neurons in layer n − 1 n-1 . This categorical vector space is structured by the activation space of each neuron and enables, via an intra-neuronal attention process, the identification and utilization of a critical categorical zone for the efficiency of the language model—more homogeneous and at the "intersection" of these different categorical sub-dimensions. 1 Theoretical Context 1.1 Neuronal Activations and the Structure of the Vector Space and Semantic Encoding The organization of semantic representations in large language models (LLMs) relies on a specific structuring of the vector space, shaped by neuronal activations. These activations, originating from Feed-Forward Network (FFN) blocks, do not merely transmit signals through the network : they actively contribute to the construction and organization of the semantic concepts learned by the neural network [ 180 , 182 ] . The contribution of each neuron to the structuring of the vector space depends on the intensity of its activation, which is generally proportional to the absolute value of its activation and the L2 norm of the corresponding vector [ 180 ] . Positive and negative activations segment the vector space into distinct regions : the former are directly incorporated into the residual stream and project their values towards the model’s vocabulary, while the latter influence the weighting of semantic representations differently [ 180 ] . This structuring is subject to internal regularization constraints, particularly Magnitude Consistency, according to which activations within the same layer tend to exhibit a homogeneous norm [ 181 ] . This property suggests that activations should not be understood as independent points in space but rather as oriented vectors. The activation space at the individual neuron level can thus be conceptualized as a (d-1)-dimensional hypersphere, where directional adjustments allow modifications to semantic representations without altering the overall stability of the vector space [ 181 ] . Empirical findings support the idea that the encoding of semantic concepts is based on this structured organization of activations. The targeted manipulation of neuronal activations allows direct control over the semantic entropy of the model’s generations : by bounding certain activations between specific values (clamping), it is possible to directly modulate the probability distribution of generated tokens, thereby steering the model’s output toward semantically determined content [ 182 ] . Advanced techniques, such as Householder Pseudo-Rotation (HPR), facilitate these adjustments by modifying the orientation of neuronal activations while preserving their norm, ensuring a coherent transformation of the vector space [ 181 ] . This structuring extends to multilingual models, where neuronal activations vary depending on the language of the processed text. Multilingual LLMs exhibit specific linguistic regions, where distinct sets of neurons are activated based on the input language. The targeted deactivation of these regions results in a significant degradation of performance in the corresponding language while leaving others unaffected, suggesting an effective segmentation of the vector space by language [ 118 ] . Simultaneously, these models align the representations of similar semantic concepts across languages within a common latent space ( Lingua Franca ), facilitating the transfer of linguistic capabilities [ 118 ] . This organization evolves with model training and scaling. As the model grows in size, linguistic regions tend to fragment, while semantic alignment strengthens, indicating a convergence towards a more unified representation of concepts [ 118 ] . A similar structuring is observed in multimodal models (MLLMs), where neuronal activations specialize according to the input modality. Neuron attribution methods, such as NAM (Neuron Attribution Method), allow the identification of neuron subsets dedicated to textual inputs (T-neurons) and visual inputs (I-neurons), revealing a clear separation of activations by modality [ 184 ] . Neuronal activations also influence the contextual coherence of LLMs’ generations. Certain neurons dynamically adjust their activations to maintain semantic stability within a given context, as evidenced by a significant correlation between activation coherence and the semantic complexity of inputs [ 186 ] . Moreover, these activations reflect semantic proximity between words more accurately than simple statistical co-occurrence. For instance, synonyms produce more similar neuronal activations than words that merely share a common context of occurrence, highlighting the role of activations in the semantic organization of representations [ 187 ] . All these observations suggest that neuronal activations constitute structuring functional units in the organization of the vector space and the encoding of semantic concepts in LLMs. 1.2 Polysemy of Neurons and Superposition A series of studies postulate that deep language models exploit a superposition dynamic to encode a greater number of features than the available dimensions in these models. This phenomenon relies on the use of distributed and quasi-orthogonal representations in high-dimensional latent spaces, enabling efficient information compression [ 215 ] . One of the notable effects of this organization is the emergence of poly-semantic neurons, i.e., neurons activated by conceptually distinct inputs. Contrary to the intuitive idea of a one-to-one correspondence between a neuron and a feature, language models do not assign a specific characteristic to a single neuron. Instead, they represent them in a distributed manner within a linear subspace of the layer’s residual stream rather than in a single neuron [ 214 ] . These features can be extracted through linear projections, revealing that information is both compressed and spread across multiple neurons. This superposition is believed to result from a structural constraint. Models must store more information than they have neurons, which forces them to organize their activations compactly [ 12 ] . One observed mechanism is the use of antipodal pairs, where a single neuron encodes two opposing concepts to maximize activation differentiation [ 215 ] . A consequence of this superposition is the emergence of poly-semantic neurons, empirically observed in the MLP layers of transformers, where some neurons respond simultaneously to highly different inputs. A single neuron may be activated by both images of dogs and the concept of democracy, complicating its interpretation [ 188 ] . Brickens et al. (2023) [ 19 ] suggest that this polysemy is not arbitrary but results from the shared use of neuronal resources and the distributed structuring of activations. Rather than strict specialization, each neuron is designed to encode multiple features simultaneously, generating a semantically complex distribution of activations. This organization follows precise geometric principles, where representations emerge from the linear combination of multiple feature directions. Mathematically, superposition relies on structuring the activation vector space to minimize interference between encoded representations. An adaptation of the Johnson-Lindenstrauss lemma to neural networks suggests that it is possible to encode a large number of features k in a space of dimension d , with k\gg d , as long as the dot product between their representations