A New Strategy for Artificial Intelligence: Training Foundation Models Directly on Human Brain Data

Maël Donoso ∗ · 2026

Read A New Strategy for Artificial Intelligence: Training Foundation Models Directly on Human Brain Data by Maël Donoso ∗ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12053.txt.

Introduction

Maël Donoso argues for a new base for AI: train foundation models on human brain data in a direct way. Today's models learn from text and other human-made data. That data is a filtered trace of a deeper brain process. Training on brain data could skip that filter. It could give models a more rich source of human thought. The claim is bold and raises hard points on data capture, scale, and ethics. The work sets out the case and the path it would need.

Catalog record

CREATORMaël Donoso ∗
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-12053

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A New Strategy for Artificial Intelligence: Training Foundation Models Directly on Human Brain Data Maël Donoso ∗ Abstract 1 While foundation models have achieved remarkable results across a diversity of domains, they still rely on human-generated data, such as text, as a fundamental source of knowledge. However, this data is ultimately the product of human brains, the filtered projection of a deeper neural complexity. In this paper, we explore a new strategy for artificial intelligence: moving beyond surface-level statistical regularities by training foundation models directly on human brain data. We hypothesize that neuroimaging data could open a window into elements of human cognition that are not accessible through observable actions, and argue that this additional knowledge could be used, alongside classical training data, to overcome some of the current limitations of foundation models. While previous research has demonstrated the possibility to train classical machine learning or deep learning models on neural patterns, this path remains largely unexplored for high-level cognitive functions. Here, we classify the current limitations of foundation models, as well as the promising brain regions and cognitive processes that could be leveraged to address them, along four levels: perception, valuation, execution, and integration. Then, we propose two methods that could be implemented to prioritize the use of limited neuroimaging data for strategically chosen, high-value steps in foundation model training: reinforcement learning from human brain (RLHB) and chain of thought from human brain (CoTHB). We also discuss the potential implications for agents, artificial general intelligence, and artificial superintelligence, as well as the ethical, social, and technical challenges and opportunities. We argue that brain-trained foundation models could represent a realistic and effective middle ground between continuing to scale current architectures and exploring alternative, neuroscience-inspired solutions. We also note that future discoveries in cognitive and computational neuroscience could make this strategy increasingly relevant over time, as new neural signals of interest are retroactively unlocked in present neuroimaging datasets. \helveticabold 2 Keywords: foundation models, brain, neuroimaging, brain-generated data, brain-trained foundation models, reinforcement learning from human brain (RLHB), chain of thought from human brain (CoTHB) \correspondance \extraAuth † † firstpage: 1 3 Introduction Foundation models, defined as models trained on broad data and adaptable to a wide range of downstream tasks, have rapidly emerged as the dominant paradigm in contemporary artificial intelligence (AI) ( 15 ) . The applications of foundation models are remarkably diverse, ranging from text ( 18 ; 130 ) , image ( 113 ; 3 ) , and video ( 123 ) generation to programming ( 75 ) , robotics ( 2 ; 35 ) , mathematics ( 27 ) , and scientific research in domains such as physics ( 36 ) , chemistry ( 86 ) , and biology ( 51 ) . While these models can be trained on various data types, their most important source of knowledge is arguably the vast corpus of human-generated data, such as text and speech, which can serve as a semantic interface between different modalities ( 2 ; 35 ) . However, this data is ultimately the product of human brains, the filtered projection of a deeper, higher-dimensional neural complexity. In this paper, we explore the possibility of moving beyond human actions such as writing and speaking, and discuss how foundation models could be trained directly on human brain data. To formalize this idea in intuitive terms, let us introduce a simple notation. If B(t) represents the brain activity of a human subject over time, and A(t) the observable actions of this subject, then A(t) can be considered a subset of B(t), since all voluntary actions originate in the brain activity. And if B*(t) represents the available neuroimaging data for the same subject, then B*(t) can serve as an approximation of B(t). This deceptively simple idea, which we could call the generative brain principle , has a surprisingly profound implication for foundation models, as illustrated in Figure 1 : it suggests that all human-generated data could, in principle, be directly inferred from human brain activity, within the limits of the quality and availability of neuroimaging data, and of the performance of brain decoding models. To make this idea more concrete, let us consider the fact that natural language can be decoded from neural signals, with models capable of reconstructing text from imagined ( 128 ) , attempted ( 136 ) , or inner ( 69 ) speech. Theoretically, this suggests that if we had access to unlimited neuroimaging data, we should be able to reconstruct every piece of text or speech ever included in the training corpus of a foundation model, up to a certain precision defined by the quality of the data and the performance of the decoding. Figure 1 : Generative brain principle. Left: Human brain activity, B(t), can be approximated by neuroimaging data, B*(t), while generating observable actions, A(t). Right: The Venn diagram illustrates the relationship between the three sets, with the yellow area at the intersection of B*(t) and A(t) representing the observable actions that can be decoded from neuroimaging data. The teal area, included in B*(t) but not in A(t), represents the additional information that could be gained from incorporating neuroimaging data into foundation models. Future advances in neuroimaging technologies could gradually expand B*(t), resulting in a better approximation of B(t). Practically, of course, it would make little sense to use the scarce and expensive neuroimaging data at our disposal, B*(t), for the sole purpose of reconstructing text, speech, or other observable human actions, A(t). It is obviously much more efficient to rely on the human-generated data already available, which is several orders of magnitude more abundant and affordable. However, the true potential of neuroimaging data is not to infer human actions, but to reveal the generative processes of human cognition underlying these actions. Based on the discoveries in cognitive and computational neuroscience, we suggest that a diversity of neural signals could potentially be leveraged to gain a deeper understanding of the processes that determine, for example, the choice of a particular word. While neuroimaging data provides only a simplified representation of the underlying neural complexity of the human brain, it could give us access to a cognitive latent space that partially includes, but vastly exceeds, the narrow bandwidth of observable behavior. In other words, we hypothesize that B*(t) could include elements of B(t) that are not included in A(t) , and that adding neuroimaging data to the training corpus of foundation models, alongside classical training data, could allow these models to move beyond surface-level statistical regularities, potentially overcoming some of their current limitations. Throughout this paper, expressions such as “training on human brain data” should be understood in their broadest sense, encompassing any form of learning, fine-tuning, or alignment that leverages neural signals in the training strategies of models. While a variety of specific implementations are possible, we argue that this general idea has the potential to serve as a new strategy for AI, and could represent the next frontier for improving foundation models. This would not be the first time that new possibilities emerge at the intersection of neuroscience and AI. These two related domains share an intellectually rich and mutually beneficial history ( 49 ) . Research on the human brain and other

Read the complete text