Using the Tools of Cognitive Science to Understand Large Language Models at Different Levels of Analysis
Alexander Ku 1,2, Declan Campbell 2, Xuechunzi Bai 3, Jiayi Geng 4, Ryan Liu 4, Raja Marjieh 1, R. Thomas McCoy 5, Andrew Nam 6, Ilia Sucholutsky 7, Veniamin Veselovsky 4, Liyi Zhang 4, Jian-Qiao Zhu 4, and Thomas L. Griffiths 1,4,6 · 2025
Read Using the Tools of Cognitive Science to Understand Large Language Models at Different Levels of Analysis by Alexander Ku 1,2, Declan Campbell 2, Xuechunzi Bai 3, Jiayi Geng 4, Ryan Liu 4, Raja Marjieh 1, R. Thomas McCoy 5, Andrew Nam 6, Ilia Sucholutsky 7, Veniamin Veselovsky 4, Liyi Zhang 4, Jian-Qiao Zhu 4, and Thomas L. Griffiths 1,4,6 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-13401.txt.
Introduction
Alexander Ku and co-authors argue that the science of the human mind offers ready tools for understanding language models. Their 2025 paper starts from a familiar worry: these systems grow stronger yet harder to read. Cognitive science faced the same problem with people and built methods to cope.
The team organizes those methods using the levels of analysis that David Marr proposed for information-processing systems. At each level, from the task a system solves down to its inner machinery, they revisit classic techniques and show what each could reveal about model behavior. The goal is a practical toolkit for studying these new kinds of minds with the same care once reserved for our own.
Catalog record
| CREATOR | Alexander Ku 1,2, Declan Campbell 2, Xuechunzi Bai 3, Jiayi Geng 4, Ryan Liu 4, Raja Marjieh 1, R. Thomas McCoy 5, Andrew Nam 6, Ilia Sucholutsky 7, Veniamin Veselovsky 4, Liyi Zhang 4, Jian-Qiao Zhu 4, and Thomas L. Griffiths 1,4,6 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-13401
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Using the Tools of Cognitive Science to Understand Large Language Models at Different Levels of Analysis Alexander Ku 1,2, Declan Campbell 2, Xuechunzi Bai 3, Jiayi Geng 4, Ryan Liu 4, Raja Marjieh 1, R. Thomas McCoy 5, Andrew Nam 6, Ilia Sucholutsky 7, Veniamin Veselovsky 4, Liyi Zhang 4, Jian-Qiao Zhu 4, and Thomas L. Griffiths 1,4,6 Abstract Modern artificial intelligence systems, such as large language models, are increasingly powerful but also increasingly hard to understand. Recognizing this problem as analogous to the historical difficulties in understanding the human mind, we argue that methods developed in cognitive science can be useful for understanding large language models. We propose a framework for applying these methods based on Marr’s three levels of analysis. By revisiting established cognitive science techniques relevant to each level and illustrating their potential to yield insights into the behavior and internal organization of large language models, we aim to provide a toolkit for making sense of these new kinds of minds. Levels of analysis for large language models \authorsaffiliations 1 Department of Psychology, Princeton University , 2 Princeton Neuroscience Institute, Princeton University , 3 Department of Psychology, The University of Chicago , 4 Department of Computer Science, Princeton University , 5 Department of Linguistics, Yale University , 6 Princeton Laboratory for Artificial Intelligence, Princeton University , 7 Center for Data Science, New York University keywords large language models, levels of analysis 1 Introduction The last decade has seen a series of breakthroughs in artificial intelligence (AI) research, culminating in the creation of the large language models that underlie chat-based agents such as ChatGPT, Claude, Gemini, and LLaMa achiam2023gpt ; team2023gemini ; touvron2023llama . These breakthroughs have been driven by a specific strategy: starting with generic artificial neural network architectures and increasing their size and training data. Artificial neural networks are notoriously difficult to interpret, finding solutions to problems that are expressed in the form of billions of continuous weighted connections between units. As a consequence, computer scientists now face an unfamiliar problem: they have created systems that they do not understand. To make things even worse, since the training data and weights of many of the leading systems are not available outside the companies that created them, in many cases the only insights we can obtain about the nature of these systems are those that can be gleaned by studying their behavior. Even though this problem is unfamilar to computer scientists, it is very familiar to another group of researchers: cognitive scientists. Cognitive science is the interdisciplinary science of the mind, and for the 70 or so years since its inception miller03 has been limited by the fact that it had relatively few kinds of mind to study. To cognitive scientists, the advent of intelligent machines offers exciting new opportunities to apply methods that have been refined through trying to understand how human minds work binz2023using ; coda2024cogbench . Those methods encompass both techniques that are based on human behavior and insights that come from related fields such as neuroscience that explore the underlying mechanisms. In this paper we summarize some of the tools from cognitive science that we believe are particularly useful for understanding large language models (and related approaches such as vision-language models). We revisit some of the “greatest hits” of cognitive science – techniques such as rational analysis, the axiomatic approach, and multidimensional scaling – and illustrate how they translate into techniques for gaining insight into AI systems. We illustrate the potential of this approach by using examples from our own work and by drawing analogies between nascent methods in computer science and tools developed in other fields. As an organizing principle, we divide these tools up by the different kinds of questions to which they provide answers. The computational neuroscientist David Marr marr82 suggested that information processing systems can be understood at three levels of analysis: the computational level, which focuses on the abstract computational problem a system solves and its ideal solution; the algorithmic level, which focuses on the representations and algorithms that approximate that solution; and the implementation level, which focuses on how those representations and algorithms are realized in a physical system. The same three levels can be used for analyzing large language models, focusing on how such systems are shaped by their function, the solutions that they seem to find, and the realization of those solutions in weights and units within the underlying artificial neural network (see Table 1 ). Drawing these parallels also provides a guide for where we might expect to look for relevant tools, with the computational level focusing on computational modeling techniques, the algorithmic level drawing on methods from cognitive psychology, and the implementation level being inspired by neuroscience. As a result, we see thinking at these different levels of analysis as being particularly productive for making sense of large language models. Table 1 : Understanding natural and artificial minds across Marr’s levels of analysis. Level of analysis Focus Cognitive science Artificial intelligence Computational What problem is being solved? What is the ideal solution? Understanding behavior in terms of optimal solutions to environmental pressures (e.g., Bayesian models of cognition). Understanding behavior in terms of the training objective (e.g., next-word prediction) and deviations from optimal benchmarks (e.g., violations of probability axioms). Algorithmic How is the solution approximated? What representations and processes are used? Inferring mental representations and processes through behavioral experiments (e.g., reaction times, error patterns, similarity judgments). Probing representations and processes via behavioral analysis (e.g., analyzing systematic errors, soliciting similarity judgments, uncovering hidden associations). Implementation How are the representations and algorithms physically realized? Studying neural circuits and population activity using techniques like optogenetics, single-unit recording, fMRI, and MVPA. Studying artificial neurons, circuits (e.g., induction heads), and population activity using techniques like activation patching, sparse autoencoders, and representational geometry analysis. 2 Computational level: Considering function The computational level focuses on the abstract problem that a system needs to solve. By recognizing the pressures that this problem exerts upon the system, we can make predictions about the properties that the system is likely to have shepard87 ; marr82 ; anderson1990adaptive ; griffiths2020understanding . This perspective is perhaps most familiar from evolutionary biology, in which organisms are understood through the lens of the evolutionary pressures that have shaped them. For instance, our understanding of bird flight is informed by the aerodynamic principles that bird flight must obey. Similarly, we can gain insight into intelligent systems by considering how they have been shaped by the functions that they must perform. This emphasis on function makes the computational level well-suited for analyzing AI systems. Although many aspects of modern AI systems are difficult to interpret (including their behavior and the mechanisms that they use to achieve that behavior), one aspect that we understand well is the function that the system is optimized to perform. Specifically, this function is explicitly defined by humans in the form of the AI system’s training objective. Therefore, computational-level analysis enables us to start from something we understand well – the training objective – and use it to reason about the less-well-understood territory of the behavior of the resulting systems. 2.1 The embers of autoregression McCoy et al. mccoy2023embers used an approach based on computational-level analysis