Large Language Models Show Signs of Alignment with Human Neurocognition During Abstract Reasoning
Christopher Pinier, Sonia Acuña Vargas, Mariia Steeghs-Turchina, Dora Matzke, Claire E. Stevenson, Michael D. Nunez · 2025
Read Large Language Models Show Signs of Alignment with Human Neurocognition During Abstract Reasoning by Christopher Pinier, Sonia Acuña Vargas, Mariia Steeghs-Turchina, Dora Matzke, Claire E. Stevenson, Michael D. Nunez (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-10057.txt.
Introduction
Christopher Pinier and co-authors ask whether large language models reason about abstract patterns in ways that echo the human brain. They set people and eight open models the same pattern-completion task. Brain waves were recorded from the human players as they worked.
Only the largest models, near seventy billion parameters, matched human accuracy. Two of them also mirrored the human pattern of which pattern types feel hard. Every model sorted the pattern classes into distinct inner clusters, and the sorting sharpened as task skill rose. Model inner shapes lined up modestly with frontal brain signals tied to the task. They did not line up with other brain measures. The match hints at shared ways of holding abstract form, shared by brains and machines.
Catalog record
| CREATOR | Christopher Pinier, Sonia Acuña Vargas, Mariia Steeghs-Turchina, Dora Matzke, Claire E. Stevenson, Michael D. Nunez |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-10057
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Large Language Models Show Signs of Alignment with Human Neurocognition During Abstract Reasoning Christopher Pinier, Sonia Acuña Vargas, Mariia Steeghs-Turchina, Dora Matzke, Claire E. Stevenson, Michael D. Nunez Abstract This study investigates whether large language models (LLMs) mirror human neurocognition during abstract reasoning. We compared the performance and neural representations of human participants with those of eight open-source LLMs on an abstract-pattern-completion task. We leveraged pattern type differences in task performance and in fixation-related potentials (FRPs) as recorded by electroencephalography (EEG) during the task. Our findings indicate that only the largest tested LLMs ( ∼ \sim 70 billion parameters) achieve human-comparable accuracy, with Qwen-2.5-72B and DeepSeek-R1-70B also showing similarities with the human pattern-specific difficulty profile. Critically, every LLM tested forms representations that distinctly cluster the abstract pattern categories within their intermediate layers, although the strength of this clustering scales with their performance on the task. Moderate positive correlations were observed between the representational geometries of task-optimal LLM layers and human frontal FRPs. These results consistently diverged from comparisons with other EEG measures (response-locked ERPs and resting EEG), suggesting a potential shared representational space for abstract patterns. This indicates that LLMs might mirror human brain mechanisms in abstract reasoning, offering preliminary evidence of shared principles between biological and artificial intelligence. keywords Abstract Reasoning; AI; Artificial Neural Networks; NeuroAI; Deep Learning; Large Language Models (LLMs); Electroencephalography (EEG); Fixation Related Potentials (FRPs); Representational Similarity Analysis (RSA) The prospect of developing an intelligent system akin to human intelligence has long captivated the public imagination. Once relegated to science fiction and thought experiments, the idea has entered the realm of possibilities ever since the appearance of the first computer systems. Successive breakthroughs, from computers mastering Chess and Go ( Silver et al., 2016 ; Silver et al., 2017 ; Silver et al., 2018 ) to the public release of ChatGPT, have steadily expanded the range of tasks at which machines rival or surpass human performance. Large language models (LLMs) now provide a single architecture that approaches human‑level competence across diverse linguistic and reasoning challenges. Yet whether these models reason in a genuinely human‑like manner remains an open question. One way to probe this question is through abstract reasoning, a fundamental ability to extract patterns, rules, and relationships from limited information and apply them in new contexts, which is widely regarded as a cornerstone of human cognition. The aspiration to build systems that can form and manipulate abstractions dates back to the field’s earliest proposals. Newell and Simon’s pioneering chess program and logic theory machine framed intelligent behavior as heuristic search over symbolic abstractions ( Newell, 1955 ; Newell and Simon, 1956 ) . Now, 70 years later, LLMs appear closer to that goal, solving numerous abstract‑reasoning tasks with human‑level proficiency ( Bubeck et al., 2023 ; Musker et al., 2025 ; Webb et al., 2023 ; Webb et al., 2025 ) . However, if LLMs’ reasoning is truly human‑like, we should not only expect human‑like responses but also human‑like internal representations and computational processes. To investigate this, we extend recent work aligning human and LLM’s neural representations on perceptual and linguistic tasks ( Doerig et al., 2024 ; Lei et al., 2025 , e.g., ) to the realm of abstract reasoning and compare people’s performance and neural representations to those of eight open-source LLMs while solving an abstract-pattern-completion task. LLMs’ alignment with human behavior and cortical patterns The early and mid-2010s saw the rise of a remarkable, albeit narrow, form of artificial intelligence, with deep neural networks achieving near-human accuracy in domain-specific tasks such as image classification and object recognition ( Krizhevsky et al., 2012 ; LeCun et al., 2015 , e.g., ) . Despite their success, they offered limited insight into general cognitive mechanisms and often failed to generalize beyond their training distributions ( Bowers et al., 2022 , for a review on their limitations, see ) . The arrival of transformer-based LLMs marked a profound shift, both in the field of AI and in the cognitive sciences. Trained predominantly on vast text corpora, these models have achieved an unprecedented levels of generalization, enabling a broad spectrum of capabilities reminiscent of human creativity and intelligence. This rapid progress, coupled with the increasing availability of open-source LLMs, has opened up exciting research avenues enabling neuroscience-like experiments on the internal activations of these models. A growing body of work shows that the latent spaces of LLMs — that is, the representations that emerge within their hidden layers and capture some underlying features of their training data — mirror the implicit representational spaces that guide human behavior. Dima et al., 2024 , for instance, found that text vectors from one of GPT’s embedding models (text-embedding-ada-002) explained participants’ perceived similarity of human actions in both naturalistic sentences and videos better than other language and vision models. Iaia et al., 2025 also found a significant alignment between the implicit representational geometry of humans and BERT (among other language models) on a semantical odd-one-out task. Marjieh et al., 2024 corroborates this trend, this time on the perceptual level, showing that similarity judgements from GPT models (versions 3 to 4) accurately reproduce the structured ways humans perceive and organize sensory information, such as the color wheel and the pitch spiral. These parallels naturally prompt a deeper question: do the same internal states that let LLMs mirror human psychology also match cortical patterns? Converging evidence suggests they do, with studies showing that these internal states seem to be systematically predictive of activity in the human cortex during linguistic ( Caucheteux and King, 2022 ; Goldstein et al., 2024 ; Lei et al., 2025 ; Mischler et al., 2024 ; Schrimpf et al., 2021 ) or visual ( Doerig et al., 2024 ) tasks. Schrimpf et al., 2021 showed that GPT-2 best predicted human brain responses among 43 language models drawn from multiple neural network families, achieving near-ceiling fits across three complementary datasets, involving functional magnetic resonance imaging (fMRI) and electrocorticography (ECoG) recordings on naturalistic reading and listening tasks. Extending this line of work, Lei et al., 2025 investigated LLM–brain predictivity more closely by comparing layer-wise activations to fourteen open-source LLMs, in both their base and instruction-tuned versions, to fMRI recordings during naturalistic story listening. They found that the instruction-tuned versions consistently outperformed their base counterparts and that higher performance was positively associated with brain correlations. Additionally, in accordance with previous findings, they show that brain-predictive power peaked in the LLMs’ intermediate layers ( Caucheteux and King, 2022 ; Mischler et al., 2024 ) . In summary, the collective evidence now spans multiple independent datasets and neural modalities (fMRI, EEG, ECoG), painting an increasingly coherent picture: when LLMs achieve human-like behavioral competence, their internal activation spaces tend to mirror the brain’s representational landscape along multiple spatial and temporal scales. However, to date, most studies have demonstrated alignment on perceptual or linguistic tasks where low-level features, such as token frequency or sentence length, can spuriously inflate brain-score metrics Feghhi et al., 2024 . Because abstract reasoning demands rule induction and relational generalisation that go beyond such surface statistics, it offers a more stringent, cognitively grounded benchmark. Investigating reasoning processes between humans and AI via abstractions As described earlier, abstract reasoning corresponds to the ability