Language Models Largely Exhibit Human-like Constituent Ordering Preferences

Ada Defne Tur, Gaurav Kamath, Siva Reddy · 2025

Read Language Models Largely Exhibit Human-like Constituent Ordering Preferences by Ada Defne Tur, Gaurav Kamath, Siva Reddy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-05670.txt.

Description

Tur, Kamath, and Reddy test if language models share human tastes for phrase order in English, in a paper from twenty twenty-five. English word order is rigid, but larger phrases can often swap places. A leading theory ties swap choices to phrase weight, meaning length or complexity. The team asks whether models show the same bias as people.

They test varied models on four swap types, from heavy phrase shift to double prepositional phrases. Models match human tastes on most types. Particle movement is the odd case, where models act against expectations. Overall alignment suggests models absorb subtle ordering biases from text. Results inform theories of when shifts occur in human language and in machines.

Catalog record

CREATORAda Defne Tur, Gaurav Kamath, Siva Reddy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-05670

Browse the full library · About the Tower of Babel