Cortex and subcortex play distinct roles over learning when cortical memory is limited
Matthew Farrell, Taro Toyoizumi · 2026
Read Cortex and subcortex play distinct roles over learning when cortical memory is limited by Matthew Farrell, Taro Toyoizumi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00667.txt.
Introduction
Farrell and Toyoizumi ask how the brain splits work while it learns. One view says the cortex does slow, rich thinking, while deeper brain areas run cheap, fixed habits. Used well, the pair could beat either part on its own. This 2026 theory paper tests that view with a small model of choice.
Their model pairs a plan-based module with a habit-based one, then caps the memory of the plan-based part. The cap forces clear rules for where scarce memory goes. When rewards shift often, they find, the plan-based part does best by learning the broad shape of the task, not the current prize. The habit part then tracks rewards. The authors set out how this split could be checked in real brain data.
Catalog record
| CREATOR | Matthew Farrell, Taro Toyoizumi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.00667
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cortex and subcortex play distinct roles over learning when cortical memory is limited Matthew Farrell, Taro Toyoizumi Abstract It has been proposed that the brain integrates flexible, computationally expensive cortical processing with simpler, lower-cost subcortical mechanisms to achieve resource-efficient performance greater than that of either system alone. Despite the allure of this perspective, satisfying theoretical frameworks that explore this hypothesis are still limited. We extend existing frameworks in which a model-based module and model-free module learn in tandem by explicitly constraining the memory resources of the model-based module, and investigate the impact of this constraint in a simple decision-making setting. Memory constraints naturally give rise to strategies for allocating memory resources. We evaluate the performance of different strategies in different situations and demonstrate that when the rewarded states change often, it can be advantageous for the model-based module to focus its memory resources not on exploiting the current reward, but on capturing general structure of the environment. This work provides a theoretical foundation for a functional dissociation between cortical and subcortical systems during learning: the cortex supports general structure learning, while subcortical circuits specialize in reward-based learning. We further detail how these hypotheses can be tested on experimental data. 1 Introduction Central to natural and artificial intelligence (AI) is a trade-off between the power of a computational module and the amount of resources needed to support it. This trade-off is well-demonstrated by animals: higher-order thinking supported by (prefrontal) cortex demands strict attention and memory [ 1 ] , while skills that are well-learned such that they become nearly automatic require far fewer mental resources [ 2 , 3 , 4 ] and may not even require cortex to perform [ 5 ] . The brain thus presents an intriguing example of a computational machine where “System 1” (fast, subconscious, automatic) and “System 2” (slow, deliberate, flexible) modules are thought to work together during task learning to achieve more than each can do alone. A better understanding of how this is achieved would yield a better understanding of the brain as a whole. Since our work touches on how humans make decisions, this research could eventually be used to better treat psychological conditions such as addiction. Our work may also contribute to the development of more efficient AI which can reduce power and other resource consumption. If misused, a better understanding of decision-making can be used to manipulate people in a way that is harmful. Many existing works spanning (computational) neuroscience and AI posit such a two-module system. One popular approach layers model-based (MB) mechanisms on top of a model-free (MF) learner, which speeds up learning compared to using a MF learner alone. A common example is MB trajectory planning used to guide or augment data collection for the MF learner to use. Among such methods, some compute long, carefully optimized trajectories that led to high reward regions, either in the case where environment dynamics are known to the agent [ 6 ] or learned [ 7 ] . Others instead perform shorter, more local planning steps from the current situation, an approach that has scaled successfully to superhuman performance on difficult tasks [ 8 , 9 , 10 , 11 ] . This idea of trajectory rollouts is also highly relevant in models of the brain. A specific example of this is hippocampal replay, the reactivation of neurons associated with past experiences. This observation has led to a plethora of models showing how such reactivation can be used to improve learning. For example, in [ 12 , 13 ] an agent exploring an environment is given the opportunity to simulate experiences via replay instead of taking a real action in the world. Faster learning is achieved by choosing replay trajectories wisely and balancing replay with real-world interaction. Neuroscience-inspired replay is also influential in machine learning [ 14 , 15 , 16 ] . In nondeterministic environments, trajectory optimization can be implemented by dynamic programming which has the MB learner compute Q -values as in MF learning. An influential perspective on brain modeling combines MB and MF learners, sometimes by arbitrating between them based on measures such as confidence [ 17 ] and sometimes by taking a weighted sum of their respective Q -values [ 18 , 19 , 20 ] . While not always explicitly considered, combining MB and MF modules is often motivated by the view that higher-order thinking associated with cortex is more expensive to use than lower-order subcortical processes. This point is nicely put by [ 18 ] who note that in their setup sensibly incorporating a MF module “requires that people assign a cost to MB control; otherwise, there is nothing to trade off against its potential.” Despite the high importance of this topic and the recognized centrality of resource considerations, memory constraints applied to the MB learner in this two-system setup have not been directly investigated. Generally if such a limitation exists, it is simply set to some value and not explored beyond this (for instance, [ 18 , 19 , 17 , 20 ] afford the model-based learner the capacity to learn all relevant transitions in the environment). An explicit treatment of memory capacity is quite natural and easily motivated, as many environments animals face will exceed the memory capacity of their higher-order thinking functions. For instance, imagine an animal takes a sequence of discrete actions a which nondeterministically move the animal along branching paths to a set of discrete states s . It is valuable to learn the resulting state probability distribution for each action P(s^{\prime}|s,a) , which amounts to learning a model for the dynamics of the environment. However, if the number of branches in the environment is large, the animal will not be able to track all of these probability estimates explicitly. The animal may give up on using MB learning altogether and fall back to MF; or, as we hypothesize here, the animal may choose a subset of the probabilities P(s^{\prime}|s,a) to track. A third possibility is that the animal uses parametric models to store features that express combinations of probabilities, or engage in other compression mechanisms such as the Successor Representation. Recently, the authors of [ 21 ] proposed a model where the MB learner uses self-supervised learning to learn a parameterized low-dimensional embedding of P(s^{\prime}|s,a) , which is akin to a parameterized version of the tabular-RL-oriented memory constraint considered here. The MF learner is then trained on this low-dimensional embedding of actions. The low-dimensional embedding induces a topography in action space, whereby nearby actions map to nearby embeddings, a property which is seen in recordings from striatum. This study differs from our approach in at least four key ways: (1) in their model, the subcortex is fully dependent on the cortex to function, which may not always be the case in biology [ 5 ] ; (2) they do not treat the dimension of the embedding space as a parameter and investigate the impact of changing it; (3) they allow the optimization to determine the low-dimensional embedding, while here we consider the consequences of different explicitly defined embedding schemes; and (4) our approach uses tabular reinforcement learning rather than parametric models. Despite these differences, the compelling framework of