Evaluating Pragmatic Reasoning in Large Language Models: Evidence from Scalar Diversity
Ye-eun Cho · 2026
Read Evaluating Pragmatic Reasoning in Large Language Models: Evidence from Scalar Diversity by Ye-eun Cho (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09042.txt.
Description
Ye-eun Cho asks how word models take hints where some can mean not all. She asks if the test way sways the call. Calls asked in words can stray from a model's own odds spread. That gap clouds claims of skill. In a set design, Cho sets straight odds reads by the side of word asked calls. She runs both cross more than one model and set up. The graded strength of such hints is the gauge.
No way wins in a firm way. Acts swing with model line, prompt style, and task form. Graded hint slopes show in set model and state pairs just. Hint skill, she holds, is born of odds and task frame in play. Test design shapes the claims folks will make.
Catalog record
| CREATOR | Ye-eun Cho |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.09042