What Kind of Language is Easy to Language-Model Under Curriculum Learning?
2026
Read What Kind of Language is Easy to Language-Model Under Curriculum Learning? (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26844.txt.
Description
El-Naggar, Kuribayashi and Briscoe ask which languages are easy for language models to learn when training follows a curriculum, starting from simple sentences rather than random order. Languages range from very common feature combinations to rare or impossible ones, and earlier work tested whether model biases alone reproduce those typological patterns. Adding a simple curriculum variant to existing experiments, they find the training order substantially shifts the models' apparent biases. The learning scenario, not just the model's built-in tendencies, thus shapes which language patterns emerge.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29586 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.26844