Baby Scale: Investigating Models Trained on Individual Children’s Language Input

Steven Y. Feng, Alvin W.M. Tan, Michael C. Frank · 2026

Read Baby Scale: Investigating Models Trained on Individual Children’s Language Input by Steven Y. Feng, Alvin W.M. Tan, Michael C. Frank (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29522.txt.

Description

Feng and co-authors train language models on single children's language input at baby scale. Human children learn from far less data than modern models need. They use transcripts from the BabyView dataset, filmed at ages six to 36 months. Models trained per child scaled well on grammar tasks. Scaling lagged on semantic and world knowledge tasks. Results varied a lot between children. Input quality tracked a mix of word patterns and interaction traits. Model word scores also matched how children learn those words.

Catalog record

CREATORSteven Y. Feng, Alvin W.M. Tan, Michael C. Frank
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE91950
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.29522

Browse the full library · About the Tower of Babel