Goals and the Structure of Experience
2025
Read Goals and the Structure of Experience (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15013.txt.
Introduction
Nadav Amir, Stas Tiomkin, and Angela Langdon propose in 2025 a fresh account of how purposeful behavior arises in minds and machines. Standard theory splits an agent's world model into two parts: a description of what is, and a reward function saying what is good.
The authors argue the two parts may not be separate at all. Instead, descriptions and values could grow together out of an agent's goals, each shaping the other as the agent develops. They give this idea its first computational form. If right, the view changes how researchers build agents that act with intent.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-15013
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Goals and the Structure of Experience Abstract Purposeful behavior is a hallmark of natural and artificial intelligence. Its acquisition is often believed to rely on world models, comprising both descriptive (what is ) and prescriptive (what is desirable ) aspects that identify and evaluate state of affairs in the world, respectively. Canonical computational accounts of purposeful behavior, such as reinforcement learning, posit distinct components of a world model comprising a state representation (descriptive aspect) and a reward function (prescriptive aspect). However, an alternative possibility, which has not yet been computationally formulated, is that these two aspects instead co-emerge interdependently from an agent’s goal . Here, we describe a computational framework of goal-directed state representation in cognitive agents, in which the descriptive and prescriptive aspects of a world model co-emerge from agent-environment interaction sequences, or experiences . Drawing on Buddhist epistemology, we introduce a construct of goal-directed, or telic , states, defined as classes of goal-equivalent experience distributions. Telic states provide a parsimonious account of goal-directed learning in terms of the statistical divergence between behavioral policies and desirable experience features. We review empirical and theoretical literature supporting this novel perspective and discuss its potential to provide a unified account of behavioral, phenomenological and neural dimensions of purposeful behaviors across diverse substrates. Nadav Amir 1 , Stas Tiomkin 2 , and Angela Langdon 3 1 Princeton University 2 Texas Tech University 3 National Institute of Mental Health Intramural Research Program, National Institutes of Health Keywords— state representation, goals, world models 1 Introduction: goals and state representations Recent advances in cognitive science and artificial intelligence (AI) have highlighted similarities and differences between biological and artificial learning [ 1 ] . Arguably, the fundamental construct driving any form of intelligent behavior is that of goals , the primary objective of purposeful behavior [ 2 ] . While the construct of goals is a focus of (renewed) interest in cognitive science [ 3 , 4 , 5 , 6 , 7 ] , so far only a few computational frameworks have focused directly on goals as drivers of purposeful action in cognitive agents [ 8 , 9 ] . Furthermore, such frameworks mostly do not explicitly address the role of goals in structuring the mental representations, or world models, that are thought to enable purposeful behaviors in the first place. Here, we describe a new computational approach accounting for the phenomenology of purposeful behavior by focusing on the reciprocal relationship between goals and the representational structures that enable their realization. Goal-directed behavior is often studied using reinforcement learning (RL), a canonical computational framework of trial-and-error learning, planning, and decision making in natural and artificial agents [ 10 ] . A foundational notion in RL models is that of a state representation: a compact description of the causal structure of the environment within the context of a particular task [ 11 , 12 ] . Standard RL models assumes that all goals are expressible as the maximization of value, or an expected cumulative sum of a appropriately designed scalar reward signal furnished by the environment. This assumption, known as the reward hypothesis , lies at the heart of current RL theory and its applications [ 13 ] . A substantial subclass of RL agents learn by using state-value associations to select a course of action according to a policy that optimizes value. In practice, RL models often consider highly rewarding states as end goals and states that are associated with high expected cumulative reward, or value, as sub goals. This approach has given rise to many successful applications in robotics, control systems, AI and cognitive science, with RL becoming an influential quantitative framework for elucidating the cognitive, computational and neural underpinnings of reward-driven learning [ 14 , 15 , 16 , 17 , 18 , 19 ] . More recently, RL algorithms scaffolded by reward-optimized deep neural network methods have achieved super-human level at playing video games [ 20 ] , mastered games such as Chess or Go [ 21 ] , trained robots to execute complex manipulation skills [ 22 ] and enabled large language models to learn mathematical reasoning capabilities [ 23 ] . However, despite their success in effectively learning a wide range of goal-directed behaviors [ 24 ] , recent theoretical work suggests that not all meaningful goals and tasks can be fully expressed using reward signals and value functions [ 25 , 26 ] . Moreover, many instances of biological learning seem more naturally explained in terms of intrinsic drives and motivations that are are not easily expressed as maximization of externally furnished scalar reward signals [ 27 ] . A more cognitively plausible account of goal-directed learning may therefore require extending canonical reward-based RL frameworks, as successful as they may be, to formally address the construct of goals, and how they shape the phenomenology of purposeful behavior. The success of any RL algorithm hinges on the appropriate choice of its two central components: the reward signal and the state representation. In typical RL applications, both reward signals and state representations are specified a priori by a task designer and are selected in order to sculpt a given behavior in a specific setting. For example, training an artificial RL agent to play chess usually providing it with a state representation describing the positions of the different pieces on the chessboard, whose turn it is, whether or not the king or the rook have already moved (which determines whether one can castle) and so on. The reward signal can be simply 1 , -1 , or 0 , depending on whether the agent wins, loses, or draws the game. For less structured tasks, such as a robot learning flexible motion skills in an unknown environment, suitable state representations for a given goal are often approximated using deep-learning or other heuristic methods [ 28 , 29 ] . In all such cases, the underlying assumption is that these representations are low-dimensional approximations of some ground-truth state-space structure. While this assumption may be useful for designing artificial systems that learn well defined tasks, in the case of biological cognitive agents there is typically no ground-truth state representation (or reward function) as these depend on the subjective goals the agent is pursuing at any moment. When trying to cross a busy road, for example, a suitable state representation should include details such as the location of the crossing and the status of the pedestrian signal. When trying to hail a taxi, on the other hand, the state representation should prioritize information about the type of incoming vehicles and their availability to accept passengers. Furthermore, while standard RL models typically include a single state representation, biological learning probably relies on multiple, hierarchically arranged ones [ 30 ] . Finally, in any empirical setting, there is no assurance that subjects represent the task in the same way as the experimentalist [ 31 ] , or that the their preferences are aligned with those implied by the reward signal provided by the task design [ 27 ] . Thus, traditional RL approaches that do not explicitly account for these dependencies may only partially explain how cognitive agents adaptively acquire and update state representations [ 32 ] , and