Universal Decision Learners
Sridhar Mahadevan · 2026
Read Universal Decision Learners by Sridhar Mahadevan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30694.txt.
Introduction
Mahadevan offers a category-theory frame for choice making, joining planning, reinforcement learning, causal action, online learning, and equilibrium. A Universal Decision Learner stretches a partly given choice rule from seen settings to new ones via two universal builds. Left Kan extensions cover rollout, aggregation, and candidate generation; right Kan extensions cover consistency, constraint satisfaction, and fixed-point meaning. The point is not one shared method, but one shared problem: stretch local choice data in the standard way. Bellman equations, planning, causal actions, regret, and equilibria all arise as cases.
Catalog record
| CREATOR | Sridhar Mahadevan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48119 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30694
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Universal Decision Learners Sridhar Mahadevan Abstract Many theories of decision making—planning, reinforcement learning, causal intervention, online learning, and game-theoretic equilibrium—turn local information into globally coherent behavior. This paper proposes a common categorical formulation: a Universal Decision Learner (UDL) extends a partially specified decision functor from observed contexts to new contexts by a pair of universal constructions. Left Kan extensions express rollout, aggregation, and candidate generation; right Kan extensions express consistency, constraint satisfaction, and fixed-point semantics. The central claim is not that every decision problem has the same algorithm, but that many decision formalisms instantiate the same universal problem: extend local behavioral data canonically, then characterize the globally coherent extensions. We give the abstract UDL construction, prove its universal comparison property, define Kan-invariant behavioral equivalence and minimal abstractions, and show how Bellman equations, planning recursions, causal interventions, online regret, and equilibria arise as special cases. The supplementary material develops the reinforcement-learning specialization in more detail. 1 Introduction Learning to make optimal decisions has been studied in many contexts. Learning to plan constructs policies from action models and trajectories. Learning to act with reinforcement learning constructs policies from sample trajectories labeled with rewards, state transitions, and yields approximately optimal value functions. Causal discovery uses interventions as constraints on structural models. Learning a Nash equilibrium in game theory attempts to find an equilibrium from a database of past strategic interaction. Online learning uses the history of sequential losses to find decisions that minimize long-term regret. Viewed abstractly, all these settings involve Universal Decision Learning (UDL): how to extend partial local information into long-term optimal decisions that are coherent in contexts not directly observed. Attempting to formalize UDL in the traditional setting of function approximation over sets (e.g., metric spaces or vector spaces) does not yield an overarching theory, because the function approximation problem has no canonical solution. However, category theory supplies canonical solutions to this problem through Kan extensions ( Kan 1958 ; Mac Lane 1971 ; Riehl 2017 ) . Let \mathcal{D} be a category of locally observed contexts, let \mathcal{C} be a larger category of contexts in which decisions must be made, and let J:\mathcal{D}\to\mathcal{C},\qquad F:\mathcal{D}\to\mathcal{E} encode the inclusion of observed contexts and the local decision data. A decision learner must construct a functor \mathcal{C}\to\mathcal{E} agreeing with, or coherently related to, F . The paper’s main thesis is that UDL can be formalized as Kan extensions, whose universal properties are uniquely guaranteed: Learning to make decisions is the problem of canonically extending partial decision data to new contexts. In this view, a left Kan extension \mathrm{Lan}_{J}F is the universal way to push local decision data forward into larger contexts. It captures rollout, interpolation, aggregation, search, and reward accumulation. Dually, a right Kan extension \mathrm{Ran}_{J}F is the universal way to assemble a decision from constraints imposed by its continuations or observations. It captures backward consistency, Bellman-style fixed points, feasibility constraints, and coinductive semantics. Contributions. This paper contributes: • a formal definition of Universal Decision Learners as Kan-extension semantics for partial decision data; • a decomposition of decision learning into rollout by left Kan extension and consistency by right Kan extension; • a universal comparison theorem showing that UDLs are canonical among all globally defined decision models compatible with the local data; • a categorical account of abstraction and behavioral equivalence via Kan invariance and minimal Kan-invariant quotients; • compact derivations of several decision formalisms as instances of the same construction, with reinforcement learning developed further in the supplement. The paper is theoretical. Its goal is to identify a unifying semantic structure, not to introduce a new empirical benchmark or neural architecture. 2 Related Work This paper builds on many lines of work that have mostly developed separately over the past century. Category theory supplies the general language of universal constructions, functors, limits, colimits, and Kan extensions ( Kan 1958 ; Mac Lane 1971 ; Riehl 2017 ) . Our contribution is to make Kan extension the central semantic operation for decision learning: local decision data are extended to global behavior by rollout-like left Kan extensions and consistency-like right Kan extensions. A detailed categorical foundation for Artificial General Intelligence (AGI) – now available as a 600 -page book complete with a Lean-4 verification of the theoretical results – contains a deeper theoretical study of Universal Decision Learners, as well as an extended treatment of its application to model reinforcement learning ( Mahadevan 2026 ) . Witsenhausen’s intrinsic model ( Witsenhausen 1975 ) was an early attempt to place sequential stochastic control ( Bertsekas 2026 ) , decentralized decision making, and game-like information structures ( von Neumann and Morgenstern 1947 ; Nash 1951 ; Maschler et al. 2013 ) in a common mathematical form . Its key insight is that decision problems are governed not only by dynamics and objectives, but by which information is available to which decision maker at each decision event. UDL inherits this concern with information structure, but recasts it in the categorical language of Kan extensions: information-local decision laws are functors on observed contexts, and global decision semantics are their universal extensions. Another more recent attempt at formalizing UDL is the Universal Decision Model framework of Mahadevan 2021 , which proposed a categorical unification of causal inference ( Pearl 2009 ) , Markov decision processes ( Bertsekas 2026 ) , reinforcement learning ( Sutton and Barto 1998 ) , and Witsenhausen’s decentralized information structures. That work emphasized product decision spaces, information fields, observation structures, and solvability of distributed decision systems. The present paper differs by making the extension problem explicit through Kan extensions: UDL is not only a categorical organization of decision makers and information, but a Kan-extension semantics for how local behavioral data determine global decisions. Reinforcement learning (RL) is essentially approximate dynamic programming, iteratively computing Bellman fixed points through stochastic approximation via temporal-difference learning ( Samuel 1959 ; Sutton and Barto 1998 ; Bertsekas 2026 ; Kushner and Yin 2003 ) . Categorically, the dynamical systems studied in RL, such as MDPs, partially observable MDPs, predictive state representations (PSRs) ( Littman et al. 2001 ) etc., are all special cases of universal coalgebras ( Jacobs 2016 ) , which provides the natural categorical language for unfolding dynamics, bisimulation, and final semantics ( Rutten 2000 ; Jacobs 2016 ; Sokolova 2011 ) . In this paper, coalgebras describe the dynamics, while right Kan extensions describe the value semantics assigned to those dynamics. Finally, UDL provides a categorical language for representation discovery in decision making. Classical bisimulation identifies states with indistinguishable rewards and transitions; proto-value functions and successor representations use transition geometry to define useful value bases or predictive features ( Mahadevan 2005 ; Dayan 1993 ) . Our Kan-invariance and homotopy-Kan-invariance notions express the same broad goal at the semantic level: abstractions should preserve the universal extension that determines observable decision behavior. 3 Decision Data as a Partial Functor We begin with the smallest amount of structure needed to state the framework, and progressively refine it through the main paper and Supplementary Materials. Definition 1 (Decision context) . A decision context category \mathcal{C} is a category whose objects are contexts at which decisions, values, policies, interventions, or predictions may be evaluated. Morphisms encode admissible transitions, refinements, observations, continuations,