A Cognitive Framework for Autonomous Agents: Toward Human-Inspired Design

Francesco Guidi, Jingfeng Shan, Mehrdad Saeidi · 2026

Read A Cognitive Framework for Autonomous Agents: Toward Human-Inspired Design by Francesco Guidi, Jingfeng Shan, Mehrdad Saeidi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16648.txt.

Introduction

Francesco Guidi, Jingfeng Shan, Mehrdad Saeidi, and their co-authors study how machines learn to act. Their 2026 preprint sets out a design for self-run agents. The design copies two ways that the human brain learns. One way links cues in the world with what tends to follow them.

Most built systems learn only from gains and losses after an act. Human brains also let cues sway a choice before the result is known. The authors join both styles in a single frame for learning from rewards. They argue that this mix can lead to wiser acts. The work speaks to the design of robots, smart cars, and like tools.

Catalog record

CREATORFrancesco Guidi, Jingfeng Shan, Mehrdad Saeidi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-16648

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Cognitive Framework for Autonomous Agents: Toward Human-Inspired Design Thanks: F. Guidi and A. Zanella are with the National Research Council of Italy (CNR), viale del Risorgimento 2, 40136 Bologna, Italy, e-mail: {francesco.guidi,alberto.zanella}@cnr.it. J. Shan, M. Saeidi, E. Testi, E. Favarelli, A. Giorgetti, D. Dardari and A. Guerra are with WiLab, University of Bologna, via dell’Universitá 50, 47521 Cesena, Italy, e-mail: {enrico.testi, elia.favarelli,andrea.giorgetti, davide.dardari,anna.guerra3}@unibo.it. G. Li Pira and F. Starita are with the University of Bologna, Department of Psychology “Renzo Canestrari”, 47521 Cesena, Italy. Thanks: This work was partially supported by the European Union under the Italian National Recovery and Resilience Plan (NRRP) of NextGenerationEU (Mision 4 – Component 2 -Investment 1.1) Prin 2022 (No. 104, 2/2/2022, CUP J53C24002790006), under ERC Grant no. 101116257 (project CUE-GO: Contextual Radio Cues for Enhancing Decision Making in Networks of Autonomous Agents). Francesco Guidi, Jingfeng Shan, Mehrdad Saeidi Abstract This work introduces a human-inspired RL ( RL ) architecture that integrates Pavlovian and instrumental processes to enhance decision-making in autonomous systems. While existing engineering solutions rely almost exclusively on instrumental learning, neuroscience shows that humans use Pavlovian associations to leverage predictive cues to bias behavior before outcomes occur. We translate this dual-system mechanism into a cue-guided RL framework in which RF ( RF ) stimuli act as conditioned (Pavlovian) cues that modulate action selection. The proposed architecture combines Pavlovian values with instrumental policy optimization, improving navigation efficiency and cooperative behavior in unknown, partially observable environments. Simulation results demonstrate that cue-driven agents adapt faster, achieving superior performance compared to traditional instrumental-solo agents. This work highlights the potential of human learning principles to reshape digital agents intelligence. I Introduction Among the emerging technologies, autonomous systems have been identified as part of the breakthrough innovations expected in the next years [ 11 ] . Multi-agent systems have attracted increasing attention for sensing and exploration applications due to their robustness to single-point failures and their ability to gather information from diverse perspectives and time scales [ 25 ] . Despite these advantages, the development of efficient task completion remains a major challenge [ 9 ] . In this regard, several RL approaches have been proposed to ensure reliable real-time task completion [ 47 , 48 ] . Traditional autonomous agent design has drawn inspiration from biological systems to design collective decision-making mechanisms, particularly animal behavior such as insect colonies [ 34 ] . However, human cognition has been largely overlooked in engineering applications [ 20 ] . In humans, instrumental and Pavlovian processes coexist and compete for behavior control, and their interaction has been formalized within modern RL frameworks [ 6 ] . Instrumental learning determines actions that maximize rewards or minimize punishments, whereas Pavlovian learning associates environmental stimuli/cues with desirable or aversive outcomes [ 6 ] . Notably, Pavlovian responses differ from those governed by instrumental conditioning, because the responses are elicited reflexively by predictive cues and take place before the presentation of the outcome, i.e., of the US ( US ). A classic example is Pavlov’s experiment, where dogs began to salivate upon hearing a bell ring previously associated with food delivery. TABLE I: Examples of Classical (Pavlovian) Conditioning in Human Behavior Scenario Neutral Stimulus (NS) Unconditioned Stimulus (US) Conditioned Stimulus (CS) Food Anticipation Sound of a bell before meals Smell or taste of food (elicits salivation) Bell sound alone elicits salivation Spatial Navigation Learning Particular room lighting cue Finding food or goal object (elicits approach behavior) Light cue alone directs movement toward expected reward Social Conditioning Gesture Verbal praise or criticism (elicits emotional response) Gesture alone modulates emotional response Advertising Brand logo or jingle Pleasant imagery or reward (elicits positive emotion) Logo alone evokes positive affect In engineering, Pavlovian and instrumental learning have often been merged or, in most cases, Pavlovian learning has been neglected, rather than being considered alongside instrumental learning, as in human cognition [ 21 ] . Early bio-inspired architectures, such as hierarchical affective controllers [ 28 ] and cognitive radar systems [ 23 , 22 ] , emulate perception–action cycles but do not fully incorporate cue-guided behavior. More recent frameworks, including MaxPain RL algorithms [ 30 , 46 ] , integrate Pavlovian value signals to bias action selection, whereas multi-agent and dual-critic actor–critic methods [ 49 , 3 ] employ separate evaluators to stabilize learning. These approaches mimic the interaction between Pavlovian and instrumental learning systems observed in biological agents [ 6 ] , as exemplified by the PIT ( PIT ) effect. A well-known effect in the neuroscientific literature that demonstrates how Pavlovian cues can bias instrumental behavior in humans and non-humans animals. Inspired by these insights, this work investigates how cue-guided human RL principles can enhance the decision-making of autonomous agents when navigating uncertain environments. In this sense, traditional model-based methods struggle in complex or partially known environments, highlighting the need for learning-based methods [ 31 , 15 , 18 ] . Thus, machine learning techniques, particularly RL and its deep variants, have become essential for adaptive navigation and environmental awareness [ 45 , 16 , 12 ] . Advanced strategies, including incremental curriculum learning, LSTM ( LSTM ) networks, and transfer learning, further accelerate adaptation in dynamic environments [ 24 ] . Building on prior work in bio-inspired control and multi-agent coordination [ 28 , 23 , 22 , 10 , 30 , 46 , 2 , 49 , 3 ] , we propose a new human-inspired architecture that integrates Pavlovian and instrumental model-free RL with model-based planning processes. This architecture leverages RL guided by radio-frequency cues to improve the decision-making of autonomous agents. While visual cues can enhance navigation, their reliability decreases under poor visibility, whereas radio-frequency cues may provide predictive signals to improve learning efficiency [ 27 ] . More specifically, we aim to address the following research question: (i) Can Pavlovian learning, through the exploitation of radio cues, effectively accelerate learning when combined with instrumental learning? (ii) Can a hybrid approach, merging model-based and -free learning processes, improve agents’ decision-making? To illustrate its potential, in Sec. II and Sec. III we describe Pavlovian learning in humans and how traditional learning in autonomous agents is designed. Then, we provide a novel human inspired framework in Sec. IV , with a case study demonstrating the effectiveness of the proposed framework in Sec. V . Conclusions and future perspective are finally drawn in Sec. VI . II Pavlovian Learning in Humans Pavlovian and instrumental conditioning are foundational learning processes that shape human behavior through distinct but complementary associative mechanisms. At the neural level, Pavlovian control in both humans and animals primarily engages subcortical and limbic circuits, such as the amygdala, insular cortex, and nucleus accumbens shell, whereas instrumental control relies on cortico-striatal networks supporting goal-directed and habit-based learning, including the dorsal striatum and orbitofrontal cortex. Understanding the differences between these forms of learning provides insight into how organisms adapt to their environments and offers a principled foundation for human-inspired designs of autonomous agents. Pavlovian Conditioning Pavlovian conditioning involves learning predictive associations between environmental states or stimuli and biologically relevant outcomes, i.e., the so called US . A NS ( NS ) becomes a CS ( CS ) when repeatedly paired with an US that elicits an UR (

Read the complete text