Brain–LLM Alignment Tracks Training Data, Not Typology
Dongxin Guo, Jikun Wu, Siu Ming Yiu · 2026
Read Brain–LLM Alignment Tracks Training Data, Not Typology by Dongxin Guo, Jikun Wu, Siu Ming Yiu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23032.txt.
Introduction
Guo, Wu, and Yiu test whether brain-language model alignment generalizes across languages. They use fMRI from 112 participants in English, Chinese, and French, plus seven language models. Their central finding is that training-language dominance drives alignment, not English itself. A Chinese-dominant model matched to LLaMA-2-7B reversed the gradient. It aligned strongest with Chinese brains and worst with English. Typological distance also covaries with alignment loss. Syntax regions show steeper gradients than lexico-semantic regions, and tokenization fertility explains much of the shift in optimal encoding layer.
Catalog record
| CREATOR | Dongxin Guo, Jikun Wu, Siu Ming Yiu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59990 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.23032
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Brain–LLM Alignment Tracks Training Data, Not Typology Dongxin Guo, Jikun Wu, Siu Ming Yiu Abstract Brain–LLM alignment is well established in English, yet the brain’s language network is neuroanatomically universal across languages. Does alignment also generalize cross-linguistically, and what governs the variation? We test this using fMRI data from 112 participants across English, Chinese, and French (the Le Petit Prince corpus) and seven LLMs spanning English-dominant, Chinese-dominant, and multilingual architectures. Our central finding is that training-language dominance, not an inherent property of English, drives the alignment pattern: a Chinese-dominant model (Baichuan2-7B), architecture-matched to LLaMA-2-7B, reverses the gradient entirely, aligning best with Chinese brains and worst with English. Beyond training dominance, formal typological distance independently covaries with alignment degradation, syntax-associated brain regions (IFG) show 2.3 × 2.3\times steeper typological gradients than lexico-semantic regions (PTL), and tokenization fertility accounts for ∼ 60 {\sim}60 % of a cross-linguistic shift in optimal encoding layer. These results reveal that the apparent “English advantage” in brain–LLM alignment is an artifact of training data composition, while the remaining variation reflects genuine typological structure concentrated in syntactic processing. 1 Introduction The brain’s language network (a set of left-lateralized frontal and temporal regions) constitutes a functionally universal system, activating with remarkably conserved topography across 45 languages from 12 families ( 44 ; 22 ) . This universality generates a foundational question for cognitive science: if the neural hardware for language is shared, do the computational representations it builds also converge across typologically diverse languages? And if so, what factors (typological structure, training experience, or representational depth) modulate the degree of convergence? Large language models (LLMs) provide a powerful tool for investigating this question. Encoding models that predict neural activity from LLM representations have revealed striking alignment between transformer representations and human brain responses ( 63 ; 27 ; 10 ) , with the best models approaching the noise ceiling of fMRI data ( 75 ; 3 ) . However, this alignment has been established almost exclusively with English data ( 74 ) , creating a critical blind spot for understanding the universality of language representation. 17 recently demonstrated that multilingual encoding models transfer zero-shot across 21 languages, confirming that a shared meaning component underlies brain–LLM alignment. However, their study leaves key gaps: no formal typological distance metrics, only 2–3 participants per language in Study II (precluding voxel-wise analysis), exclusively multilingual models tested, and {\sim} 4.5 minutes of stimuli compared to our {\sim} 100 minutes of The Little Prince . Construction grammar (CxG) provides a principled theoretical framework for predicting where cross-linguistic alignment should vary. CxG holds that linguistic knowledge consists of form–function pairings (constructions) at all levels of abstraction ( 25 ; 16 ; 8 ) . CxG predicts that cross-linguistic variation resides primarily in constructional (syntactic-functional) representations, while core semantic content is more universal ( 24 ) . This generates a testable neural prediction: brain regions associated with syntactic-constructional processing should show larger typological distance effects than regions associated with lexico-semantic processing. However, we note upfront that this prediction is also derivable from non-CxG theories that distinguish syntax from semantics ( 43 ) ; we discuss CxG-specific evidence requirements in § 6 . Why the result is non-trivial. Three prima facie hypotheses would predict outcomes incompatible with the pattern we report. First, if the language network’s functional universality across 45 languages ( 44 ) extends to representational format, alignment should depend on what is represented rather than which language dominates the model, predicting comparable alignment across all model–language pairs. Second, if alignment primarily reflects shared feature spaces emerging from sufficiently rich linguistic exposure ( 2 ) , English-dominant models trained on \sim 2T tokens ( \sim 90% English) could in principle align with Chinese brains as well as a Chinese-dominant model trained on far less. Third, typological-distance-based accounts predict that alignment tracks structural similarity between training and target languages, independent of training proportion. Distinguishing training-language dominance from these alternatives requires architecture- and scale-matched models that vary primarily in training-language composition: the controlled comparison Baichuan2-7B affords against LLaMA-2-7B. We address these gaps with five advances: (i) formal typological distance metrics as quantitative predictors; (ii) a Chinese-dominant LLM (Baichuan2-7B) to disentangle the training-data confound; (iii) tokenization fertility analysis; (iv) region-specific typological gradient analysis; and (v) noise-ceiling-normalized comparisons throughout. Our contributions are: 1. First quantitative demonstration that formal typological distance covaries with brain encoding performance. In mixed-effects models controlling for training data proportion, Grambank distance is associated with alignment degradation for language-dominant models ( \beta=-0.41 ). With three languages providing limited degrees of freedom for the language-level predictor, we treat this as a well-supported descriptive pattern establishing a hypothesis to be tested across \geq 10 languages; a cluster bootstrap at the language level yields a wider confidence interval (see § 4.2 ). 2. Disentangling training dominance from typological distance via controlled comparison. Baichuan2-7B (Chinese-dominant) reverses the alignment gradient —the systematic pattern by which encoding performance for a given model decreases as the listener’s language diverges from the model’s dominant training language. Baichuan2-7B performs best for Chinese ( \tilde{r}=.85 ) and substantially lower for non-dominant languages ( \tilde{r}_{\text{EN}}=.59 , \tilde{r}_{\text{FR}}=.54 ). This provides the first controlled demonstration with architecture- and scale-matched models that training language is the primary driver of this gradient. 3. Cross-linguistic layer dynamics with partial resolution of the Chinese shift. The intermediate layer advantage peaks 1.8 layers later for Chinese ( d=0.92 ). Tokenization fertility (the average number of subword tokens produced per orthographic word; 61 ) reveals that Chinese has a fertility of 2.4 tokens per word under XLM-R’s tokenizer versus 1.4 for English ( 1.7\times higher); controlling for fertility attenuates {\sim}60 % of the shift (95% CI: [42%, 76%]), though collinearity with information density means this is an upper bound on fertility’s contribution. 4. Region-specific neural gradient consistent with syntax–semantics dissociation. IFG shows a 2.3\times steeper typological gradient than PTL (language-level bootstrap 95% CI: [1.4, 3.8]). This pattern is consistent with CxG’s prediction that structural variation is constructional ( 25 ) , but is also predicted by generic accounts distinguishing syntax from semantics, as well as IFG’s role in cognitive control for non-dominant language processing ( 28 ) . We discuss what CxG-specific evidence would require (§ 6 ). 2 Background and Theoretical Motivation 2.1 The Universal Language Network The language network comprises interconnected regions in left frontal and temporal cortex that respond selectively to linguistic input across modalities ( 21 ; 22 ) . These regions are functionally dissociable from domain-general systems ( 7 ) and are conserved across 45 languages from 12 families ( 44 ) . Studies of polyglots further show that all languages activate the same network ( 45 ; 57 ) . Cross-linguistic differences in syntactic processing have been documented at the behavioral level ( 6 ) , but the extent to which these differences manifest in the language network’s alignment with computational models remains unknown. 2.2 Brain–LLM Alignment The alignment between transformer representations and human brain activity has been established through encoding models ( 63 ; 10 ; 27 ) . 75 provided causal evidence for shared representational structure by driving and suppressing the language network using LLM-generated stimuli. 10 identified the intermediate layer advantage: middle transformer layers best predict brain