Different types of syntactic agreement recruit the same units within large language models

Daria Kryvosheieva, Andrea de Varda, Evelina Fedorenko, Greta Tuckute · 2025

Read Different types of syntactic agreement recruit the same units within large language models by Daria Kryvosheieva, Andrea de Varda, Evelina Fedorenko, Greta Tuckute (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03676.txt.

Introduction

Daria Kryvosheieva and colleagues locate grammar inside large language models and ask whether agreement rules of each kind share hardware. Subject-verb, pronoun, and determiner agreement all police the same sentence marks. Their 2025 study borrows functional localization from brain science to find the units behind sixty-seven syntactic phenomena.

Across seven open-weight models, the units tuned to syntax were reused again and again and truly backed performance. Different rule types drew on shared unit sets, a sign that agreement is a real working category for the models, not a made-up label. The pattern held in Russian and Chinese too. Among fifty-seven languages, languages closer in structure shared more subject-verb units.

Catalog record

CREATORDaria Kryvosheieva, Andrea de Varda, Evelina Fedorenko, Greta Tuckute
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-03676

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Different types of syntactic agreement recruit the same units within large language models Daria Kryvosheieva, Andrea de Varda, Evelina Fedorenko, Greta Tuckute Abstract Large language models (LLMs) can reliably distinguish grammatical from ungrammatical sentences, but how grammatical knowledge is represented within the models remains an open question. We investigate whether different syntactic phenomena recruit shared or distinct components in LLMs. Using a functional localization approach inspired by cognitive neuroscience, we identify the LLM units most responsive to 67 English syntactic phenomena in seven open-weight models. These units are consistently recruited across sentences containing the phenomena and causally support the models’ syntactic performance. Critically, different types of syntactic agreement (e.g., subject-verb, anaphor, determiner-noun) recruit overlapping sets of units, suggesting that agreement constitutes a meaningful functional category for LLMs. This pattern holds in English, Russian, and Chinese; and further, in a cross-lingual analysis of 57 diverse languages, structurally more similar languages share more units for subject-verb agreement. Taken together, these findings reveal that syntactic agreement---a critical marker of syntactic dependencies---constitutes a meaningful category within LLMs’ representational spaces. 1 1 1 Code and data available via github.com/dariakryvosheieva/syntax-units 1 Introduction Large language models (LLMs) can now generate well-formed sentences that are often indistinguishable from those produced by humans ( Jones and Bergen 2024 ; Jones and Bergen 2025 ) . Ample evidence suggests that this generative capacity is supported by syntactic generalization—the models’ ability to apply grammatical constraints in new contexts (e.g., An et al. 2019 ; Futrell et al. 2019 ; Gulordava et al. 2018 ; Wilcox et al. 2018 ; Warstadt et al. 2019 ; though see Marvin and Linzen 2018 ; McCoy et al. 2020 for evidence of systematic limitations). However, it remains unclear how grammatical rules are represented and implemented within the models. For example, does applying a particular rule consistently engage the same subset of the model? Do different rules recruit the same model units? In other words, is there a subset of the model that performs syntactic computations across grammatical phenomena, or are different rules instead instantiated in distinct parts of the model? And is syntactic processing implemented in the same units across different languages? In NLP, such “how” questions are increasingly tackled through mechanistic interpretability approaches ( Mueller et al. 2024 ) . Two main approaches dominate this line of work ( Rai et al. 2024 ; Wang et al. 2025 ) : one focuses on features , i.e., identifying human-interpretable properties encoded in model representations; the other focuses on circuits , i.e., tracing the paths and components in the computation graph that implement specific behaviors. In this paper, we adopt the feature-based approach, and in particular, we draw inspiration from a common strategy in cognitive neuroscience: functional localization. This approach ( Saxe et al. 2006 ) aims to isolate regions of the brain that support particular cognitive capacities: for example, to identify brain regions that process faces, a contrast between faces and non-face objects may be used, and to identify brain regions that process words and syntactic structure, a contrast between sentences and lists of non-words may be used ( Fedorenko et al. 2010 ) . Recent work has shown that functional localization can be applied to LLMs to identify specialized sets of units: AlKhamissi et al. 2025 adapted standard neuroimaging ‘localizer’ contrasts, like those above, to LLMs, identifying the top- k units that best distinguish between language (sentences) and control stimuli (non-word lists). They then showed that ablating these units impairs language performance more than ablating the same number of non-language-selective units, demonstrating parallels to lesion studies in humans. Here, we apply a similar approach to a narrower domain of language processing—the processing of syntactic structure—to illuminate the architecture underlying LLMs’ grammatical competence. Our study makes the following main contributions: • Syntax-responsive units. We identify units in seven open-weight LLMs that are engaged in each of 67 syntactic phenomena, generalize across sentences containing that phenomenon, and are causally implicated in model behavior for the phenomenon. • Agreement as a functional category. Unlike some syntactic phenomena, different types of syntactic agreement in English (subject-verb, anaphor, and determiner-noun agreement) recruit overlapping units, suggesting that these phenomena draw on shared resources within LLMs. • Cross-linguistic agreement overlap. The pattern replicates in Russian and Chinese: different types of agreement again draw on overlapping units. In addition, agreement-responsive units show partial overlap across languages, and in an analysis of 57 languages, the extent of this cross-lingual overlap increases with syntactic similarity—more similar languages share more units for agreement. 2 Related work Previous work has shown that LLMs are sensitive to diverse aspects of syntactic structure, such as number and gender agreement, verb argument structure, and syntactic dependency structure, assigning lower probabilities to ungrammatical sentence variants ( Gulordava et al. 2018 ; An et al. 2019 ; Wilcox et al. 2018 ; Warstadt et al. 2019 ; Linzen et al. 2016 ; Gauthier et al. 2020 ) . These studies treat LLMs as “behavioral” participants, probing their syntactic expectations through surprisal in controlled minimally different sentence pairs. This approach has revealed interesting generalizations, but it leaves open the question of how grammatical ability is instantiated within a model. Addressing this question requires examination of the model’s internal representations. Model interpretability work has investigated how syntactic information is represented within LLMs. Some early studies showed that syntax-related information is encoded in the intermediate layers of language models, as revealed by classifiers trained to recover syntactic labels from hidden states ( Belinkov et al. 2017 ; Tenney et al. 2019 ; Jawahar et al. 2019 ) . Other studies have examined the geometry of embedding spaces, showing that syntactic dependency structure can be recovered from representational distances. In particular, Hewitt and Manning 2019 introduced an approach (‘structural probe’) that reveals that entire parse trees are implicitly encoded in model representations. Also leveraging the geometry of the embedding space, Starace et al. 2023 found that part-of-speech and dependency information are jointly represented. More recent work has moved from distributed representations to identifying sparse, functionally meaningful components. Lakretz et al. 2019 ; Lakretz et al. 2021 used targeted ablations in LSTMs to identify model units that are responsible for number agreement. Complementing these findings, Mueller et al. 2022 applied counterfactual interventions to neuron activations to study how models encode agreement dependencies, and Boguraev et al. 2025 used causal interventions to characterize shared mechanisms across filler-gap constructions. Marks et al. 2024 and Lepori et al. 2023 isolated minimal subgraphs within models—so-called sparse feature circuits—that support subject-verb agreement. Using a feature-based approach, Durrani et al. 2020 identified subsets of units predictive of performance on various syntactic tasks, such as part-of-speech tagging and chunking a text into constituents. Duan et al. 2025 introduced a syntactic selectivity index (SSI), which quantifies how strongly a model unit differentiates grammatical versus ungrammatical sentences for a given syntactic phenomenon relative to other phenomena based on activation magnitude. They then tracked how these high-SSI units emerge over the course of training, and showed that ablating high-SSI units increases perplexity on grammatical sentences. Prior work on multilingual models has shown that different languages rely on shared representations of syntactic structure. At the level of output probabilities, Michaelov et al. 2023 and Arnett et al.

Read the complete text