Large Language Models and Impossible Language Acquisition: “False Promise” or an Overturn of our Current Perspective towards AI
Ziyan Wang, Longlong Ma, [1ex] Xicheng Academy, Beijing · 2026
Read Large Language Models and Impossible Language Acquisition: “False Promise” or an Overturn of our Current Perspective towards AI by Ziyan Wang, Longlong Ma, [1ex] Xicheng Academy, Beijing (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08437.txt.
Description
Chomsky famously dismissed large language models as pattern predictors unable to grasp impossible languages the way humans supposedly cannot learn them. Ziyan Wang and Longlong Ma test that critique with experiments on GPT-2 small and LSTM models, training on English transformed into impossible variants by reversal and parity-based negation. Their arXiv paper blends linguistics literature with new empirical work.
GPT-2 small learns natural language faster and better than the impossible variants, with reversal showing the largest gap, while LSTMs show little difference. The authors are careful: each condition ran only once, so the results are descriptive and cannot support formal statistical claims. Readers get a nuanced update to a famous debate, plus a proposal to move from rationalist to functionalist frames.
Catalog record
| CREATOR | Ziyan Wang, Longlong Ma, [1ex] Xicheng Academy, Beijing |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-08437