Language Models Largely Exhibit Human-like Constituent Ordering Preferences
Ada Defne Tur, Gaurav Kamath, Siva Reddy · 2025
Read Language Models Largely Exhibit Human-like Constituent Ordering Preferences by Ada Defne Tur, Gaurav Kamath, Siva Reddy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-05670.txt.
Description
Tur, Kamath, and Reddy test if language models share human tastes for phrase order in English, in a paper from twenty twenty-five. English word order is rigid, but larger phrases can often swap places. A leading theory ties swap choices to phrase weight, meaning length or complexity. The team asks whether models show the same bias as people.
They test varied models on four swap types, from heavy phrase shift to double prepositional phrases. Models match human tastes on most types. Particle movement is the odd case, where models act against expectations. Overall alignment suggests models absorb subtle ordering biases from text. Results inform theories of when shifts occur in human language and in machines.
Catalog record
| CREATOR | Ada Defne Tur, Gaurav Kamath, Siva Reddy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-05670