Child-Directed Language Does Not Consistently Boost Syntax Learning in Language Models
Francesca Padovani, Jaap Jumelet, Yevgen Matusevych, Arianna Bisazza · 2025
Read Child-Directed Language Does Not Consistently Boost Syntax Learning in Language Models by Francesca Padovani, Jaap Jumelet, Yevgen Matusevych, Arianna Bisazza (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23689.txt.
Introduction
Francesca Padovani, Jaap Jumelet, Yevgen Matusevych, and Arianna Bisazza test a claim about how children learn grammar, in a paper published in 2025. Earlier work found that models trained on speech aimed at children learned syntax about as well as models fed far more adult text. That hinted that child-directed speech might be special teaching material.
The team trained models on child-directed text and on encyclopedia text in English, French, and German, using two training styles. On grammar test pairs, the child-directed models won only sometimes and usually lost. The authors also found flaws in older test sets and built a new one that balances word frequency. With fair tests, child-directed training gave no steady grammar edge. They urge care with frequency effects in such studies.
Catalog record
| CREATOR | Francesca Padovani, Jaap Jumelet, Yevgen Matusevych, Arianna Bisazza |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-23689
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Child-Directed Language Does Not Consistently Boost Syntax Learning in Language Models Francesca Padovani, Jaap Jumelet, Yevgen Matusevych, Arianna Bisazza Abstract Seminal work by Huebner et al. (2021) showed that language models (LMs) trained on English Child-Directed Language (CDL) can reach similar syntactic abilities as LMs trained on much larger amounts of adult-directed written text, suggesting that CDL could provide more effective LM training material than the commonly used internet-crawled data. However, the generalizability of these results across languages, model types, and evaluation settings remains unclear. We test this by comparing models trained on CDL vs. Wikipedia across two LM objectives (masked and causal), three languages (English, French, German), and three syntactic minimal-pair benchmarks. Our results on these benchmarks show inconsistent benefits of CDL, which in most cases is outperformed by Wikipedia models. We then identify various shortcomings in previous benchmarks, and introduce a novel testing methodology, FIT-CLAMS, which uses a frequency-controlled design to enable balanced comparisons across training corpora. Through minimal pair evaluations and regression analysis we show that training on CDL does not yield stronger generalizations for acquiring syntax and highlight the importance of controlling for frequency effects when evaluating syntactic ability. 1 1 1 Code and data are available at https://github.com/fpadovani/childes_vs_wiki . 1 Introduction The prevailing view in language acquisition research has long held that child-directed language (CDL) is inherently more effective than adult-directed language (ADL) for supporting first language development Ferguson (1964) ; Schick et al. (2022) . This has led to the assumption that the way caregivers speak to children is tailored to their developmental needs and functional for efficient language learning. Motivated by this long-standing assumption, recent computational modeling research has investigated how training on CDL vs. ADL affects syntactic learning and generalization in neural network-based language models (LMs) Feng et al. (2024) ; Mueller and Linzen (2023) ; Yedetore et al. (2023) . Notably, Huebner et al. (2021) showed that BabyBERTa, a masked LM trained on 5M tokens of child-directed speech transcripts 2 2 2 Throughout this paper, we use the term CDL specifically to refer to transcripts of child-directed speech. , achieves the level of syntactic ability similar to that of a much larger RoBERTa model trained on 30B tokens of ADL Zhuang et al. (2021) . Despite these encouraging findings, several issues complicate direct comparisons between CDL and ADL in LM training, including the variability in training setups Cheng et al. (2023) ; Feng et al. (2024) ; Qin et al. (2024) and evaluation benchmarks across studies ( Warstadt et al., 2020 ; Huebner et al., 2021 ; Mueller et al., 2020 ) , as well as the frequent focus on coarse-grained accuracy scores averaged over many syntactic paradigms. Moreover, recent work by Kempe et al. (2024) reveals that the evidence for the facilitatory role of CDL in child language acquisition is scarce and specific to narrow domains, such as prosody and register discrimination, raising concerns about its generalizability. In this light, we believe it is crucial to carefully re-evaluate the benefits of CDL for LM training. To better understand the specific effects of CDL as training input, we systematically compare LMs trained on CHILDES vs. Wikipedia across two architectures (RoBERTa and GPT-2) and three languages (English, French, and German) using four different benchmarks of minimal pairs. Crucially, we control for lexical frequency effects by introducing FIT-CLAMS , a Frequency-Informed Testing (FIT) methodology, which we apply to the CLAMS benchmark Mueller et al. (2020) . The resulting evaluation set consists of minimal pairs balanced for subject and verb frequency in the training data, to disentangle true syntactic generalization from mere reliance on high-frequency lexical items present in the training data. We also perform a regression analysis to assess the impact of the distributional properties of CDL and ADL on the models’ confidence in predicting grammaticality. Our results challenge the presumed advantage of CDL for syntax learning in LMs, showing that it is, in fact, often outperformed by ADL. These findings underscore the need for a more nuanced understanding of when and how CDL may be beneficial, going beyond the mere adoption of CDL as training material—for instance, as a foundation to explore alternative learning paradigms that more closely mirror the interactive, contextual, and multimodal nature of human language acquisition Beuls and Van Eecke (2024) ; Stöpler et al. (2025) . 2 Related Work An ongoing debate in computational linguistics concerns whether CDL offers a measurable advantage over ADL in supporting the acquisition of formal linguistic knowledge in language models. The literature reports conflicting results: some highlight CDL’s benefits for grammatical learning and inductive bias, others find little or no advantage. Among the studies supporting the benefits of CDL, a prominent example is Huebner et al. (2021) . Their study shows that LMs trained on CHILDES MacWhinney and Erlbaum (2000) , a database containing transcripts of child–adult conversations, achieve higher average accuracy on Zorro, a minimal pair benchmark designed by Huebner et al. (2021) , compared to models trained on Wikipedia, when strictly controlling for dataset size and model configuration. An even better accuracy is achieved by LMs trained on written language adapted for children, such as AO-Newsela Xu et al. (2015) . Salhan et al. (2024) report similar results in a cross-linguistic setting involving French, German, Chinese, and Japanese. Across all four languages, their baseline RoBERTa-small model trained on CHILDES outperforms models trained on a size-matched Wikipedia corpus when evaluated on minimal-pair benchmarks available for each language. Mueller and Linzen (2023) further support the benefits of CDL by showing that pretraining LMs on simpler input promotes hierarchical generalization in question formation and passivization tasks, even with significantly less data than required by models trained on more complex sources like Wikipedia. Finally, You et al. (2021) leverage a non-contextualized word embedding model (Word2Vec by Mikolov, Chen, Corrado, and Dean (2013) ) to show that CDL is optimized for enabling semantic inference through lexical co-occurrence even in the absence of syntactic cues, suggesting that early meaning extraction in humans may be supported by surface-level regularities. In contrast to studies highlighting the advantages of CDL, Feng et al. (2024) report that models trained only on CDL underperform those trained on ADL datasets with higher structural variability and complexity (e.g., Wikipedia, OpenSubtitles, BabyLM Challenge dataset) in both syntactic tasks (like the ones in Zorro) and semantic tasks measuring word similarity. A similar result is reported by Bunzeck et al. (2025) , who focus on German language models: while lexical learning tends to improve with the simpler, fragmentary language constructions typical of CDL, syntactic learning benefits from more structurally complex input. Yedetore et al. (2023) further challenge the benefits of CDL by demonstrating that both LSTMs and Transformers trained on CDL input fail to acquire hierarchical rules in yes/no question formation, instead relying on shallow linear generalizations. Finally, going beyond text-based LMs, Gelderloos et al. (2020) train their models on unsegmented speech data using a semantic grounding task and find that whilst child-directed speech may facilitate early learning, models trained on adult-directed speech ultimately generalize more effectively. In light of such conflicting findings, our study offers a systematic reassessment of the impact of CDL on syntax learning across two model architectures, three languages and multiple benchmarks, including