Separating the what and how of compositional computation to enable reuse and continual learning
Haozhe ShanCenter for Theoretical NeuroscienceDepartment of Computer ScienceColumbia University [email protected], Sun MinniCenter for Theoretical NeuroscienceDepartment of NeuroscienceColumbia University [email protected] Lea DunckerCenter for Theoretical NeuroscienceDepartment of NeuroscienceC · 2025
Read Separating the what and how of compositional computation to enable reuse and continual learning by Haozhe ShanCenter for Theoretical NeuroscienceDepartment of Computer ScienceColumbia University [email protected], Sun MinniCenter for Theoretical NeuroscienceDepartment of NeuroscienceColumbia University [email protected] Lea DunckerCenter for Theoretical NeuroscienceDepartment of NeuroscienceC (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20709.txt.
Introduction
Haozhe Shan, Sun Minni, and Lea Duncker split brain like learning into two systems, one that infers what task to do and one that carries it out. Splitting the what from the how could let a learner reuse skills and keep learning new ones without wiping out the old.
The team shows many shared lab tasks can be described by a common model built from a vocabulary of short task epochs. An online learner grows that vocabulary trial by trial as new tasks appear and tracks the hidden epoch pattern inside each trial. Plugged into recurrent networks, the split supports steady learning and flexible reuse, offering a concrete model for how brains might compose skills.
Catalog record
| CREATOR | Haozhe ShanCenter for Theoretical NeuroscienceDepartment of Computer ScienceColumbia University [email protected], Sun MinniCenter for Theoretical NeuroscienceDepartment of NeuroscienceColumbia University [email protected] Lea DunckerCenter for Theoretical NeuroscienceDepartment of NeuroscienceC |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20709
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Separating the what and how of compositional computation to enable reuse and continual learning Haozhe ShanCenter for Theoretical NeuroscienceDepartment of Computer ScienceColumbia University [email protected], Sun MinniCenter for Theoretical NeuroscienceDepartment of NeuroscienceColumbia University [email protected] Lea DunckerCenter for Theoretical NeuroscienceDepartment of NeuroscienceColumbia University [email protected] Abstract The ability to continually learn, retain and deploy skills to accomplish goals is a key feature of intelligent and efficient behavior. However, the neural mechanisms facilitating the continual learning and flexible (re-)composition of skills remain elusive. Here, we study continual learning and the compositional reuse of learned computations in recurrent neural network (RNN) models using a novel two-system approach: one system that infers what computation to perform, and one that implements how to perform it. We focus on a set of compositional cognitive tasks commonly studied in neuroscience. To construct the what system, we first show that a large family of tasks can be systematically described by a probabilistic generative model, where compositionality stems from a shared underlying vocabulary of discrete task epochs. We develop an unsupervised online learning approach that can learn this model on a single-trial basis, building its vocabulary incrementally as it is exposed to new tasks, and inferring the latent epoch structure as a time-varying computational context within a trial. We implement the how system as an RNN whose low-rank components are composed according to the context inferred by the what system. Contextual inference facilitates the creation, learning, and reuse of low-rank RNN components as new tasks are introduced sequentially, enabling continual learning without catastrophic forgetting. Using an example task set, we demonstrate the efficacy and competitive performance of this two-system learning framework, its potential for forward and backward transfer, as well as fast compositional generalization to unseen tasks. 1 Introduction Humans and animals exhibit a remarkable ability to learn and retain new skills, and flexibly deploy them to accomplish goals in an ever-changing environment. A growing literature from neuroscience and human behavior suggests that mechanisms for contextual inference and task abstraction may play a crucial role for behavioral flexibility and learning [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 ] . An abstract, task-relevant context could guide the selection and composition of different skills, while the maintenance of context-specific memories could counteract forgetting and aid continual learning [ 1 ] . Yet, the neural mechanisms facilitating the continual learning and flexible reuse of skills are not well understood. How do neural systems manage to expand their repertoire of skills without interference or forgetting, while maintaining the ability to access and compose them in new environmental contexts? We hypothesize that multiple interacting learning systems with different objectives may contribute to overall learning and computation. Specifically, can inferences about the higher-level compositional structure of tasks be exploited for more robust and efficient learning? We investigate the interplay of compositionality, contextual inference, and continual learning in recurrent neural networks (RNNs) using a two-systems approach: one that infers an abstract computational context within a task family by parsing the compositional structure with probabilistic inference, and one that implements and retains the relevant computation for each context. This framework naturally maps onto a what and how architecture, previously explored in meta-learning [ 10 ] . The explicit separation into contexts (what) and computations (how) allows for flexible learning and compositional reuse. We focus our analyses on a family of cognitive and motor tasks commonly used in neuroscience [ 11 ] . Here, we expand upon previous work in RNNs, where continual learning is still a major challenge [ 12 ] , and compositional reuse of computational building blocks has only been shown to emerge implicitly over simultaneous training on multiple related tasks [ 13 , 14 , 15 , 16 ] , rather than being explicitly implemented as a solution that facilitates sequential learning of tasks. The paper is organized as follows: We review related work and our contributions in section 2 . In section 3 , we formalize task compositionality through the development of a generative model for cognitive tasks. This allows us to define a computational context within a task family. We develop an unsupervised online learning and inference approach to directly infer context from the inputs and target responses that constitute a task, one trial at a time across a number of different but related tasks. In section 4 we combine inference and learning in the task model with a contextually gated low-rank RNN. Training this architecture on a number of cognitive tasks, we demonstrate that our approach counteracts catastrophic forgetting and aids continual learning with signatures of both forward and backward transfer. We demonstrate competitive performance in comparison to continual learning approaches previously used in RNNs. We show that our architecture can rapidly learn to deploy known skills to solve novel tasks using only a few examples – a property called compositional generalization [ 17 , 18 , 19 ] . Finally, we discuss limitations and future directions in section 5 . Our work contributes to a more precise quantification of task compositionality, how it may shape computation, and how interactions across different learning systems can benefit continual learning and generalization. Ultimately, addressing these questions will help to elucidate flexibility and learning in biological systems. 2 Related work and our contributions Statistical theories of contextual inference. We follow an influential line of work on contextual inference in cognitive sciences [ 20 , 21 , 1 , 22 ] . Contextual inference has been proposed as a model explaining many learning-related phenomena in classical conditioning [ 20 ] and motor control [ 1 ] . Here, a latent discrete-valued random variable is used to describe distributional changes in task-relevant, continuous observations. Given a set of observations, this variable can be inferred as a familiar or novel context to determine whether a learner may express and refine existing behaviors, or expand their repertoire using a new context. We extend this idea to the problem of learning to solve multiple common neuroscience tasks [ 11 , 14 ] . To do this, we develop a formal description of these tasks in terms of a context variable: Each task transitions through several contexts, each relevant for a different computation on a particular task epoch. A key aspect of our model is that these contexts can reappear in a compositional manner across different tasks, and may additionally share complex temporal dependencies within a given trial. In section 3 we show how this is crucial for capturing the distributional structure of neuroscience tasks, where, for example, the animal needs to compute a response based on information presented at an earlier time in the trial [ 11 , 14 ] . Task-dependent modulation of neural networks. The general notion of a separate system modulating computation in a neural network in a task-dependent manner has been previously studied. An example of this is the Task-Conditioned Hypernetwork [ 23 ] , where the weights of a neural network are generated by a second, separate network based on modifiable task embeddings. Other approaches often assume the network has its own learnable weights but that their involvement in computation is modulated, for instance via a gating mechanism [ 24 , 25 , 16 ]