Cognitive Foundations for Reasoning and Their Manifestation in LLMs
Priyanka Kargupta, Shuyue Stella Li, Haocheng Wang, Jinu Lee, Shan Chen, Orevaoghene Ahia, Dean Light, Thomas L. Griffiths, Max Kleiman-Weiner, Jiawei Han, Asli Celikyilmaz, Yulia Tsvetkov · 2025
Read Cognitive Foundations for Reasoning and Their Manifestation in LLMs by Priyanka Kargupta, Shuyue Stella Li, Haocheng Wang, Jinu Lee, Shan Chen, Orevaoghene Ahia, Dean Light, Thomas L. Griffiths, Max Kleiman-Weiner, Jiawei Han, Asli Celikyilmaz, Yulia Tsvetkov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-16660.txt.
Description
Priyanka Kargupta and eleven co-authors ask why large language models solve hard problems yet fail on easier variants, suggesting their reasoning works very differently from human reasoning. They distill cognitive science into a taxonomy of 28 cognitive elements, from reasoning invariants and metacognitive controls to representations and transformation operations.
With that vocabulary they score nearly two hundred thousand reasoning traces from eighteen models across text, vision, and audio. Human think-aloud traces are scored too. Models underuse the elements that correlate with success and collapse into rigid step-by-step processing on ill-structured problems, while humans lean on abstraction. Test-time guidance that scaffolds the successful structures improved performance by up to about two thirds on complex problems. The models own the skills but do not deploy them unprompted.
Catalog record
| CREATOR | Priyanka Kargupta, Shuyue Stella Li, Haocheng Wang, Jinu Lee, Shan Chen, Orevaoghene Ahia, Dean Light, Thomas L. Griffiths, Max Kleiman-Weiner, Jiawei Han, Asli Celikyilmaz, Yulia Tsvetkov |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 117 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-16660