Linguistic Generalizations are not Rules: Impacts on Evaluation of LMs
Leonie Weissweiler, Kyle Mahowald, Adele E. Goldberg, Princeton University, [email protected] · 2025
Read Linguistic Generalizations are not Rules: Impacts on Evaluation of LMs by Leonie Weissweiler, Kyle Mahowald, Adele E. Goldberg, Princeton University, [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13195.txt.
Introduction
Leonie Weissweiler, Kyle Mahowald, and Adele Goldberg argue in 2025 that tests of language models rest on a flawed view of language. Many tests assume that grammar works as a set of strict symbolic rules, and that a model which breaks them fails to understand language as people do. The authors say natural language does not work that neatly.
New sentences, they argue, are built from flexible patterns that depend on context, frequency, and use. A model that misses a strict rule may reflect that flexible nature rather than a simple flaw. Readers are urged to design new tests that probe rich, graded patterns in language instead of rule obedience alone.
Catalog record
| CREATOR | Leonie Weissweiler, Kyle Mahowald, Adele E. Goldberg, Princeton University, [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-13195
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Linguistic Generalizations are not Rules: Impacts on Evaluation of LMs Leonie Weissweiler, Kyle Mahowald, Adele E. Goldberg, Princeton University, [email protected] Abstract Linguistic evaluations of how well LMs generalize to produce or understand language often implicitly take for granted that natural languages are generated by symbolic rules. According to this perspective, grammaticality is determined by whether sentences obey such rules. Interpretation is compositionally generated by syntactic rules operating on meaningful words. Semantic parsing maps sentences into formal logic. Failures of LMs to obey strict rules are presumed to reveal that LMs do not produce or understand language like humans. Here we suggest that LMs’ failures to obey symbolic rules may be a feature rather than a bug, because natural languages are not based on neatly separable, compositional rules. Rather, new utterances are produced and understood by a combination of flexible, interrelated, and context-dependent constructions . Considering gradient factors such as frequencies, context, and function will help us reimagine new benchmarks and analyses to probe whether and how LMs capture the rich, flexible generalizations that comprise natural languages. 1 Introduction How well do large Language Models (LMs) generalize beyond their training data? Much work on this question has presumed that generalizations require symbolic rules for syntax and semantics that generate acceptable new forms and compositional meanings. Rules are invoked to explain that if you learn a new modifier (‘blonky’) and a new count noun (‘gravimin’), a compositional rule could predict that ‘a blonky gravimin’ is a gravimin that is blonky. In what follows, we use “rule” to refer to context-free generalizations that contain variables, to be instantiated by any instance of a general type, uninfluenced by frequency, similarity, or context Pinker (1999) . Our focus here is on the use of a strict algebraic conception of rules, which we argue, underlies certain approaches to NLP evaluation, even though the notion of a rule is used variably in linguistics today, with several frameworks incorporating functional and/or frequency-based attributes into representations ( Bresnan et al., 2007 ; Brehm et al., 2022 ; O’Donnell, 2015 , e.g.,) , Because early statistical models (e.g., n -gram or Markov models) seemed unable to generalize fully or capture non-local dependencies Chomsky (1957) , early on, rules seemed to many to be the only game in town for human language. After all, if a standard bigram model hadn’t seen ‘blonky gravimin’ before, it would be unable to form a representation of it. Influential thinkers argued that neural networks, which did not involve rules, would never be appropriate models of human cognition for this reason Fodor and Pylyshyn (1988) ; Pinker and Prince (1988) ; Marcus (1998) ; Fodor and Lepore (2002) ; Marcus (2001) ; Calvo and Symons (2014) . However, current LMs arose from statistical, distributional parallel models Mikolov et al. (2013) ; Rumelhart et al. (1986) rather than rule-based natural language technologies. They do not rely on hard-coded rules, yet their ability to produce coherent, naturalistic language and respond appropriately is unparalleled by purely symbolic systems Piantadosi (2024) ; Goldberg (2024) ; Weissweiler et al. (2023) ; Hofmann et al. (2025) . GPT-4o, for example, not only recognizes ‘a blonky gravimin’ as a noun phrase, it explicitly offers several naturalistic interpretations, e.g., ‘A person or act that awkwardly and absurdly pretends to be serious.’ Nonetheless, an assumption that generalizations are equivalent to rules continues to motivate many evaluations of syntax, meaning, and their compositional combination: e.g., Natural Language Inference Bowman et al. (2015) , Semantic Parsing Palmer et al. (2005) ; Reddy et al. (2017) , tests of binary grammatical acceptability Warstadt et al. (2019) ; Dentella et al. (2023) and rule-based compositionality Kim and Linzen (2020) . Together, such tasks made up more than half of the GLUE benchmark Wang et al. (2018) , created to evaluate language models on their skill at being “general, flexible, and robust.” Lackluster performance on rule-based tasks in the early days of LMs was taken to imply that the models did not use language the way people do and were instead merely imitating shallow surface patterns Bender and Koller (2020) ; Kim and Linzen (2020) ; Weißenhorn et al. (2022) ; Bolhuis et al. (2023) . In a survey of 79 NLP researchers, McCurdy et al. (2024) reported that 87% believed LMs were not sufficiently compositional and a sizable proportion (39%) believed explicit discrete symbolic rules were required. Evaluations of LMs’ early challenges with algebraic or logical rules did expose certain shortcomings in their ability to reason abstractly and solve math problems ( Mahowald et al., 2024 , see e.g., ) . At the same time, LM’s concurrent ability to produce and respond to natural languages naturalistically is hard to overstate ( Coil and Shwartz, 2023 , e.g.,) . Mastering a natural language requires mastering a network of hundreds of thousands of context-dependent, gradient, flexible schemata ( constructions , see § 5 ), which often contain ‘slots’ that constrain their fillers and how those fillers are interpreted. Constrained slots allow for new combinations, flexibly adapted in context. For instance, the phrase ’<time period> ago’ can coerce a temporal interpretation of filler phrases that do not designate time periods (e.g., ‘three rest stops ago’). Rather than rule-based compositionality, composition-by-construction allows constructions to contribute meaningfully to interpretation in ways that range from abstract to quite narrow and specific. Therefore, for LMs to use language like humans, they require interpretations that are far richer than rules can provide for thousands of collocations, conventional metaphors, idioms, and context-dependent interpretations. Even abstract grammatical patterns also regularly convey semantic and/or pragmatic information that restrict their contexts of use and interpretations. Since different languages and dialects provide speakers with different networks of constructions (ConstructionNets), cross-linguistic differences can be captured naturally. We suggest that rule-based evaluations have been over-emphasized in the domain of natural language production and comprehension. Our goal is to emphasize the importance of recognizing context, frequencies, meaning and other gradient functional factors in modern evaluations of natural language. We do not argue that no categorical rule exists in any language. If a categorical rule is needed, it can be treated as the limiting case, a fully abstract construction Jackendoff (2002) . For instance, Jackendoff (2002) proposes a symbolic Verb + Particle rule for the syntax of English complex verbs. At the same time, the meanings of individual verb plus particle combinations are far from compositional by any general rule (e.g., one can look up a number or look down on someone but not ?look up on someone nor ?look down a number ). Here we advocate for an increased focus on the extent to which and how LMs manage to produce and comprehend human-like natural languages in all their context-specificity and complexity. Many of our theoretical points are not new, particularly in the domain of morphology. Neural network researchers have continuously argued in favor of a single representational system and against the usefulness of rules in the domain of words and inflectional morphology ( Rumelhart et al., 1986 ; Rogers and McClelland, 2004 ; Elman, 2009 ; Christiansen and Chater, 1999 ; MacDonald et al., 1994 ; McClelland, 2015 , e.g.,) . While early work in Artificial Intelligence relied on algebraic rules Minsky and Papert