Cognitive maps are generative programs

Marta Kryven ([email protected]), Cole Wyeth ([email protected]), Aidan Curtis ([email protected]), Kevin Ellis ([email protected]) · 2025

Read Cognitive maps are generative programs by Marta Kryven ([email protected]), Cole Wyeth ([email protected]), Aidan Curtis ([email protected]), Kevin Ellis ([email protected]) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20628.txt.

Introduction

Kryven and co-authors argue that the mental maps people use to plan are best seen as small generative programs, in this 2025 paper. A program exploits the regular structure of a place instead of storing every detail. That thrift suits minds working with limited resources.

In a behavior experiment, people navigating structured spaces planned in modular steps, as the program view predicts. The team's computational model infers a small set of candidate program-like maps from prior knowledge. It then plans with those maps at far lower cost than layout-based methods. A large language model supplies the human-like priors inside the model. The result matched human choices better than rival planners. The work links an old idea in cognitive science to modern tools.

Catalog record

CREATORMarta Kryven ([email protected]), Cole Wyeth ([email protected]), Aidan Curtis ([email protected]), Kevin Ellis ([email protected])
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-20628

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Cognitive maps are generative programs Marta Kryven ([email protected]), Cole Wyeth ([email protected]), Aidan Curtis ([email protected]), Kevin Ellis ([email protected]) Abstract Making sense of the world and acting in it relies on building simplified mental representations that abstract away aspects of reality. This principle of cognitive mapping is universal to agents with limited resources. Living organisms, people, and algorithms all face the problem of forming functional representations of their world under various computing constraints. In this work, we explore the hypothesis that human resource-efficient planning may arise from representing the world as predictably structured. Building on the metaphor of concepts as programs, we propose that cognitive maps can take the form of generative programs that exploit predictability and redundancy, in contrast to directly encoding spatial layouts. We use a behavioral experiment to show that people who navigate in structured spaces rely on modular planning strategies that align with programmatic map representations. We describe a computational model that predicts human behavior in a variety of structured scenarios. This model infers a small distribution over possible programmatic cognitive maps conditioned on human prior knowledge of the world, and uses this distribution to generate resource-efficient plans. Our models leverages a Large Language Model as an embedding of human priors, implicitly learned through training on a vast corpus of human data. Our model demonstrates improved computational efficiency, requires drastically less memory, and outperforms unstructured planning algorithms with cognitive constraints at predicting human behavior, suggesting that human planning strategies rely on programmatic cognitive maps. Keywords: navigation, planning, cognitive maps, computational modeling, large language models. Introduction Current AI formalizes planning as a search within a decision tree of possible actions and outcomes. This tree can be encoded in various ways, such as a learned neural policy [ Liu et al., 2020 ] , an explicit tree structure [ Russell and Norvig, 2016 ] , or a neuro-symbolic model [ Tang et al., 2024 ] . The size of the underlying decision tree determines the computational cost of the problem, or how difficult it should be. However, the normative difficulty of such models rarely aligns with human experience, as people often solve real-world problems that are theoretically intractable with relative ease. For example, people efficiently navigate cities without knowing exact location of every link in the street network (Fig. 1 a) [ Bongiorno et al., 2021 ] , and plan construction projects with thousands of actions (Fig. 1 b). Figure 1: Real-world planning tends to occur in predictably structured domains, such as street networks (a), modular architecture (b,d), and naturally patterned landscapes (c). This excellent efficiency in real-life planning stands in contrast with often inefficient performance in the laboratory. People deviate from optimal plans in a variety of contexts, including tasks based on multi-arm bandits [ Keramati et al., 2016 , Huys et al., 2015 ] , games, such as chess [ Ferreira, 2013 ] , and many experimental paradigms designed to examine planning behaviors [ Unterrainer et al., 2004 , Kryven et al., 2024 , Callaway et al., 2022 ] . Such deviations from optimality are commonly explained by limiting planning horizon [ Ferreira, 2013 , Kryven et al., 2024 , van Opheusden et al., 2023 ] and low-level constraints on perception [ Kryven et al., 2024 ] . However, most laboratory-based tasks conspicuously lack the predictable and regular problem structure ubiquitous in real-life, such as hills and valleys in nature (Fig. 1 c) and modular built layouts (Fig. 1 d). Moreover, classic experimental paradigms often explicitly avoid creating structure in an effort to isolate variables of interest, such as planning depth. Here we test the hypothesis that human planning leverages prior knowledge about the world, particularly the expectation that the world is highly structured. Given this, cognitive maps may be represented as programs , because programs can capture structures such as symmetries and repeated parts. Program-structured maps address a key computational problem: Planning in partially-observed environments is intractable [ Madani et al., 2003 ] . Approximations are needed. Program-structured maps help tackle hard planning problems because programs that repeatedly generates identical map fragments allow recycling successful policies, essentially decomposing the decision problem. This gives plans that are locally optimal (within code fragments), but globally suboptimal. The key idea is to discover fragments of repeated structure in a partially-observed map, and plan policies only once for each repeated fragment. Then, when each fragment is encountered, we avoid costly belief-space planning by reusing previously computed policies. We probe the extent to which humans similarly recycle successful policies across repeated code fragments, finding that their plans align with this signature of suboptimality. We show that human planning in structured environments is predicted by our generative map model, and can not be explained by alternative models based on unstructured planning with cognitive constrains. Background From young children to hunter-gatherers, people impose structure on the world to solve problems [ Pitt et al., 2021 , Lake and Piantadosi, 2020 ] . For example, people spontaneously infer correlation between rewards in spatially adjacent locations [ Schulz et al., 2018 ] , and represent spaces hierarchically – as divided by visible boundaries [ Kosslyn et al., 1974 ] , geography [ Stevens and Coupe, 1978 ] , or sub-regions [ Hirtle and Jonides, 1985 ] . Behavioral evidence for compositional problem representation extends to auditory [ Verhoef et al., 2014 ] , visual [ Tian et al., 2020 ] , and abstract concept domains [ Schulz et al., 2017 ] – suggesting that the compositional reasoning may be an evolved adaptation to natural structures encountered in daily life [ Johnston et al., 2022 ] . A recent study found that people form cognitive maps that facilitate planning [ Ho et al., 2022 ] , selectively representing only the parts of the map relevant to goal-directed routes. Cognitive maps may also depend on prior expectations about the world, leading people to anticipate regularities in new environments, even when not informed about them in advance [ Sharma et al., 2022 ] . In naturalistic setting adaptive planning draws on complex conceptual prior knowledge of the world, including knowledge of how agents and objects interact, often referred to as core knowledge [ Acquaviva et al., 2022 , Spelke and Kinzler, 2007 , Dehaene et al., 2006 ] . Learning these natural priors remains an important problem in cognitive AI [ Kumar et al., 2022 , Li et al., 2024 , Binz et al., 2024 ] . Parallel developments in computing have long tackled the goal of building intelligent systems capable of solving general, procedural tasks [ Chollet et al., 2025 , Veness et al., 2011 ] . Reinforcement Learning (RL) models abstract problem representations by expressing actions performed together as options [ Sutton et al., 1999 ] , learning families of similar Markov Decision Process (MDP) with shared rewards [ Wilson et al., 2012 ] , and building efficient state-spaces by recognizing actions that lead to identical observations [ Singh et al., 2012 ] . Generalized planning frameworks can find algorithm-like policies for solving multiple instances of a task [ Curtis et al., 2022 ] , although their ability to handle uncertainty is still limited. A principle of grouping game-board states based on rotation and reflection symmetries was

Read the complete text