Why AI systems don’t learn and what to do about it Lessons on autonomous learning from cognitive science
Emmanuel Dupoux, Yann LeCun, Jitendra Malik · 2026
Read Why AI systems don’t learn and what to do about it Lessons on autonomous learning from cognitive science by Emmanuel Dupoux, Yann LeCun, Jitendra Malik (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-15381.txt.
Introduction
Dupoux and co-authors argue that current AI systems fail at autonomous learning and sketch a fix drawn from cognitive science. Their design joins two learning modes under a meta-control switch. System A learns from observation, while System B learns from active behavior. System M reads inner signals and flips between the two modes as needed. The sketch borrows from how organisms adapt across both growth and evolution. It aims at agents that keep learning in changing real-world settings.
Catalog record
| CREATOR | Emmanuel Dupoux, Yann LeCun, Jitendra Malik |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67774 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.15381
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Why AI systems don’t learn and what to do about it Lessons on autonomous learning from cognitive science Emmanuel Dupoux, Yann LeCun, Jitendra Malik Abstract We critically examine the limitations of current AI models in achieving autonomous learning and propose a learning architecture inspired by human and animal cognition. The proposed framework integrates learning from observation (System A) and learning from active behavior (System B) while flexibly switching between these learning modes as a function of internally generated meta-control signals (System M). We discuss how this could be built by taking inspiration on how organisms adapt to real-world, dynamic environments across evolutionary and developmental timescales. † † affiliation: FAIR at META † † affiliation: École des Hautes Études en Sciences Sociales † † affiliation: NYU † † affiliation: UC Berkeley † † date: August 10, 2026 † † correspondence: dpx at @meta.com Forewords The dominant AI research paradigm today relies on hyperscaling of text-based LLMs with ever larger models, data and compute. But even prominent architects of this approach such as Ilya Sutskever 1 1 1 Business insider and Andrei Karpathy 2 2 2 Medium suggest we may be hitting diminishing returns. Areas of concern include (1) confronting the "data wall" on quality text data (2) inability to learn new things beyond current human knowledge because of the absence of interaction with the environment ( 221 ) (3) excessively language-centrism as opposed to spatial, embodied and grounded reasoning in the physical world (4) lack of continual life-long learning (self-improvement after deployment). While these critiques echo long standing controversies within cognitive science on the non-verbal cognition ( 119 ) , and situated interactions ( 179 ; 260 ) in intelligence, it behooves us as scientists to take stock of progress from both fields and look beyond the current paradigm. What could come next? Both AI and Cognitive Science emerged in the 1950’s in the post-war intellectual ferment which brought together neural modeling, computation, information, and control. While the objectives differ –creating intelligent machines vs. scientific understanding of brains and behavior, the intellectual trajectories of AI and cognitive science have overlapped with varying degree of cross-fertilization. Today, the successes of Deep Learning ushered an era of deeper cross-disciplinary interactions. As AI models tackle high level human abilities like language, visual understanding and reasoning, they incorporate concepts and evaluation methods from the cognitive and neural sciences. Conversely, AI systems provide sorely needed quantitative theories of cognitive processes that can be tested against empirical data. Paradoxically, given the importance of deep learning, one key component of human intelligence remains out of reach for current AI models: the ability to learn as humans do. 1 What is autonomous learning? Consider the distinction between children and current AI models. Children learn and act from birth. They flexibly choose what to attend, what to learn, when to act or observe, and more generally how to switch between different learning modes ( 31 ; 218 ) . For example, a toddler trying a new toy may explore it randomly ( learning through action ; 85 ), or by watching a peer, attempt to imitate the goal or gesture, depending on context ( learning through observation ; 82 ; 249 ). They may follow a caretaker’s verbal instruction on how to use the toy ( learning through communication ; 48 ), or take a pause and daydream about the various ways to use the toy ( learning through imagination ; 193 ). In contrast, AI models, once deployed, learn essentially nothing ; their mode of operation is fixed, and if not adapted to their environment, a new model has to be rebuilt using new data by human experts-in-the-loop ( 97 ) . Furthermore, the different learning modes exemplified in children are typically siloed into distinct machine learning paradigms (e.g., self-supervised learning, supervised learning, reinforcement learning), each requiring specific data curation pipelines and training recipes; when the different modes are mixed, it is mainly through rigid sequences of training recipes established through trial and error by human experts and tuned to particular applications (chatbots, coding assistants, etc.). In other words, in current AI systems, learning is outsourced to human experts instead of being an intrinsic capability. Arguably, the inability to learn may explain some difficulties of AI systems to be deployed in real life. AI systems are built by optimizing an objective over a fixed set of training data , typically lifted from the internet. However, once deployed in real life, this system may be confronted with new data that diverge significantly from this distribution, with unpredictable consequences. This phenomenon known as domain mismatch cannot be fixed by merely increasing the training set size, as real-life data always contains new, unseen cases ( heavy tailed ) and keeps changing over time ( non-stationarity ) ( 81 ; 131 ) . Modern AI addresses domain mismatch by breaking down model training into two phases: pretraining using large generic datasets, and fine tuning using data more appropriate to the target application ( 29 ) . This is a first step in the right direction, but it still requires considerable human involvement, and there is no guarantee that this will work, as the system has not been primarily built to be fine-tunable or adaptable, especially on unfiltered raw data. In contrast, in biological organism, domain mismatch is mitigated by enabling the agent to learn and adapt from the data directly available in its environment, allowing for species-specific cognitive adaptability. Humans are particularly adaptable in this respect, having shown the ability to spread very quickly to a variety of different ecological niches ( 32 ) . Figure 1: Standard machine learning (left) . The machine does not learn by itself; it requires an assembly line of research engineers and data scientists collecting, formatting, and curating different kinds of data, each used to train successively different components of the model, each with specificly engineered loss and reward functions. The machine is then left with no ability to learn from its experience. Autonomous machine learning (right). The agent is learning directly in interaction with the world; the sources of data are generarated by the agent itself through different learning modes (learning by observation, by action, which can be extended to higher modes like learning by verbal interaction or self-play). Our proposed architecture include a meta controler enabling learning while operating in the real world. (Drawings from ChatGPT) . In this paper, we start from the idea that autonomous learning should be considered a core capability , essential for building reliable AI systems that can operate in the real world. Conversely, we take it that the development of adaptable AI systems can benefit cognitive science by providing quantitative models capable of addressing long-standing debates about the nature and origins of human intelligence. The main contributions of the paper are the following: we identify three conceptual and technical roadblocks that have so far limited the development of autonomous learning, and we propose possible diractions to address them. This should be as a high level roadmap which we hope will be useful in inspiring future cross-disciplinary work and collaborations. The first roadblock is conceptual: existing approaches to learning remain fragmented across subfields, making it difficult to integrate them within