Cognitive Foundations for Reasoning and Their Manifestation in LLMs

Priyanka Kargupta, Shuyue Stella Li, Haocheng Wang, Jinu Lee, Shan Chen, Orevaoghene Ahia, Dean Light, Thomas L. Griffiths, Max Kleiman-Weiner, Jiawei Han, Asli Celikyilmaz, Yulia Tsvetkov · 2025

Read Cognitive Foundations for Reasoning and Their Manifestation in LLMs by Priyanka Kargupta, Shuyue Stella Li, Haocheng Wang, Jinu Lee, Shan Chen, Orevaoghene Ahia, Dean Light, Thomas L. Griffiths, Max Kleiman-Weiner, Jiawei Han, Asli Celikyilmaz, Yulia Tsvetkov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-16660.txt.

Description

Priyanka Kargupta and eleven co-authors ask why large language models solve hard problems yet fail on easier variants, suggesting their reasoning works very differently from human reasoning. They distill cognitive science into a taxonomy of 28 cognitive elements, from reasoning invariants and metacognitive controls to representations and transformation operations.

With that vocabulary they score nearly two hundred thousand reasoning traces from eighteen models across text, vision, and audio. Human think-aloud traces are scored too. Models underuse the elements that correlate with success and collapse into rigid step-by-step processing on ill-structured problems, while humans lean on abstraction. Test-time guidance that scaffolds the successful structures improved performance by up to about two thirds on complex problems. The models own the skills but do not deploy them unprompted.

Catalog record

CREATORPriyanka Kargupta, Shuyue Stella Li, Haocheng Wang, Jinu Lee, Shan Chen, Orevaoghene Ahia, Dean Light, Thomas L. Griffiths, Max Kleiman-Weiner, Jiawei Han, Asli Celikyilmaz, Yulia Tsvetkov
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE117 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-16660

Browse the full library · About the Tower of Babel