What Kind of Language is Easy to Language-Model Under Curriculum Learning?

2026

Read What Kind of Language is Easy to Language-Model Under Curriculum Learning? (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26844.txt.

Description

El-Naggar, Kuribayashi and Briscoe ask which languages are easy for language models to learn when training follows a curriculum, starting from simple sentences rather than random order. Languages range from very common feature combinations to rare or impossible ones, and earlier work tested whether model biases alone reproduce those typological patterns. Adding a simple curriculum variant to existing experiments, they find the training order substantially shifts the models' apparent biases. The learning scenario, not just the model's built-in tendencies, thus shapes which language patterns emerge.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29586
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.26844

Browse the full library · About the Tower of Babel