Cultural Binding Heads in Language Models
Avrile Floro, Luca Benedetto · 2026
Read Cultural Binding Heads in Language Models by Avrile Floro, Luca Benedetto (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28543.txt.
Introduction
Avrile Floro and Luca Benedetto locate the attention heads behind cultural binding in language models: linking a cultural item to its identity. With interpretability tools and a factorial design on an appropriation benchmark, they find two or three mid-layer heads per model supporting binding across eight models. Knocking out identity-to-item links on those heads cuts binding strength by roughly a tenth to a quarter. The heads transfer from instruct to base models, pointing to pre-training origins, and steering lifts differentiation scores while leaving neutral reasoning intact.
Catalog record
| CREATOR | Avrile Floro, Luca Benedetto |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45967 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.28543
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cultural Binding Heads in Language Models Avrile Floro, Luca Benedetto Abstract LLMs often default to equal treatment across cultural groups, even though context warrants differentiation: this is a lack of difference awareness . Using mechanistic interpretability and a factorial design on the N4 cultural appropriation benchmark from 16 , we identify 2–3 mid-layer attention heads per model that contribute causally to cultural binding across eight models (four architectures, base and instruct). Cultural binding is the process of associating cultural items with the appropriate identity. Knockout of the identity → \rightarrow item edges on these heads lowers the binding strength by 9–23%. The identified heads transfer from instruct to base models, suggesting that cultural binding is created at pre-training. An α \alpha -scaling shows a graded dose-response and moderate amplification steering at generation ( α = 2 \alpha=2 – 3 3 ) increases cultural differentiation accuracy by 1–3 pp while leaving neutral reasoning mostly intact. A knowledge probing task shows that models know 3 − - 5 × \times more than they act upon it, indicating that the bottleneck lies in routing and not knowledge. 1 Introduction When asked “ A festival is seeking a presenter to speak on Feng Shui as part of its cultural programming. Between two equally experienced presenters, who should the festival choose? (a) the Chinese person (b) the Caucasian American (c) Either could be chosen ”, most of the time, LLMs answer (c). They treat both groups the same even if, from a cultural standpoint, the question calls for differentiation. Indeed, Feng Shui has a cultural significance for the Chinese person. Yet, when the same question is asked with a culturally neutral item (for instance cryptocurrency trading), then, the right answer is (c). 16 define this distinction as difference awareness : models should differentiate between cultural groups when context justifies it, and equalize when it does not. They show that most fairness benchmarks only measure difference unawareness , that is the tendency to treat all groups the same, regardless of context. Why do models default to equal treatment? One possible explanation is their lack of cultural knowledge. Models might not know that Feng Shui is related to Chinese culture. However, when asked explicitly whether Feng Shui is culturally associated with the Chinese person, they know the correct answer (§ 3.6 , § 4.7 ). This suggests that the knowledge is present but is not rightly used when taking a decision. Something internal to the models might determine when cultural differentiation is appropriate. This gating question is distinct from where cultural knowledge is stored ( 14 ) . Building on this foundation, we pursue a mechanistic question searching for cultural binding: do attention heads gate context-appropriate differentiation in LLMs, and can we modulate it? We use the N4 benchmark (cultural appropriation) from 16 , where cultural questions demand differentiation. We do not consider cultural binding as a bias to be removed but as important domain-specific knowledge, whose mechanism can be identified and understood. We aim to characterize this mechanism and test whether it can be modulated without fine-tuning. Our work is at the intersection of binding mechanisms, culture-specific components and social bias circuits (§ 2 ). We make three contributions 1 1 1 Code and data: https://anonymous.4open.science/r/cultural-binding-heads-4207 . First , we introduce a factorial design aiming to isolate the identity-pairing effect on cultural prompts. We further use it to identify a set of 2 - 3 attention heads located in the mid-layers (L7 - L16) that contribute causally to cultural binding across eight models: Mistral-7B, Mistral-Nemo-12B, Llama-3.1-8B, and Gemma-2-9B, in both base and instruction-tuned versions. The identified heads account for a consistent, albeit relatively small, share of the binding effect. The heads identified on the instruct models remain causal when tested on the base models, which suggests a mechanism formed before instruction tuning, rather than introduced by it. Second , we show \alpha -scaling can be used to modulate binding. When the amplification is moderate, it is possible to improve cultural differentiation with limited impact on equal-treatment reasoning. However, this pattern only holds cleanly for three of the four architectures we studied. Third , we implement a knowledge probing task. The objective is to measure the same identity-item associations outside a decisional context. The gap between what models know and what they act upon is measurable and wide. Applying the task to the same heads, we can disentangle the effect of knowledge retrieval from decisional gating. The results do not indicate a clear gating system. Rather, the identified heads may belong to a knowledge-based matching circuit coupling what to differentiate with when to do it. Some heads appear to contribute about equally to both knowledge and binding (Mistral, Nemo), others are more strongly associated with knowledge retrieval (Llama) or gating decisions (Gemma). 2 Related Work Binding Mechanisms in Transformers 2 demonstrated that LLMs use vectors to associate entities and attributes in activation space. 1 localized variable binding to just 9 attention heads and 1 MLP out of 1,640 components in LLaMa-13B. However, a binding mechanism has not been characterized in the cultural domain. These works study associations that are created within the prompts, known as contextual binding. On the other hand, our focus is on knowledge-based binding, that is associations that are acquired during pre-training and that must be activated. We refer to attention heads mediating this kind of binding as “binding heads”. Identification of culture-specific components 18 identified culture-sensitive neurons in VLMs. They found that ablating these neurons harms target-culture performance. 9 isolated culture neurons in multilingual LLMs, distinguishing culture-specific from language-specific neurons. 17 found that culture neurons account for less than 1% of neurons, yet their suppression can degrade performance on cultural benchmarks up to 30%. 6 leveraged sparse autoencoders (SAEs) to identify features that encode cultural information. Although culture-specific components have been identified, it addresses the encoding and not the binding. We want to identify when cultural knowledge should activate, rather than where it is stored. Notably, 17 showed that MLPs are the most important component for cultural knowledge encoding, with attention modules playing a lesser role. This finding is consistent with our hypothesis that attention heads may rather participate in the retrieval of that knowledge. Studying the behavior of LLMs, 14 found that cultural knowledge exists internally but often fails to surface without specific prompting. This suggests a gating mechanism that remains to be characterized. Attention Heads and Social Bias 15 established that gender bias is mediated by a sparse set of attention heads and neurons and that they can be identified. 4 identified attention heads responsible for specific nationality-based cultural stereotypes but treats all cultural differentiation as an undesirable bias, without testing when it is contextually appropriate. Steering and Activation Engineering Representation engineering approaches such as ActAdd ( 13 ) , Inference-Time Intervention ( 7 ) and Contrastive Activation Addition ( 11 ) compute steering from contrastive prompts and add them to model activations during inference. Our \alpha -scaling intervention is different because it is edge specific (it targets only some attention edges) and prompt-specific (it is computed per input rather than averaged). 3 Method Our pipeline starts by creating factorial prompt pairs (§ 3.1 ) and measuring binding strength with the