Understanding Electro-communication and Electro-sensing in Weakly Electric Fish using Multi-Agent Deep Reinforcement Learning

Satpreet H. Singh Harvard University, Sonja Johnson-Yu Harvard UniversityZhouyang LuBrown UniversityAaron WalsmanHarvard UniversityFederico PedrajaColumbia UniversityDenis TurcuColumbia UniversityPratyusha SharmaMITNaomi SaphraHarvard UniversityNathaniel B. SawtellColumbia UniversityKanaka Rajan Har · 2025

Read Understanding Electro-communication and Electro-sensing in Weakly Electric Fish using Multi-Agent Deep Reinforcement Learning by Satpreet H. Singh Harvard University, Sonja Johnson-Yu Harvard UniversityZhouyang LuBrown UniversityAaron WalsmanHarvard UniversityFederico PedrajaColumbia UniversityDenis TurcuColumbia UniversityPratyusha SharmaMITNaomi SaphraHarvard UniversityNathaniel B. SawtellColumbia UniversityKanaka Rajan Har (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08436.txt.

Introduction

Satpreet Singh and co-authors model weakly electric fish collectives with biophysically inspired agents trained by multi agent reinforcement learning. How group conduct emerges from individual interaction is hard to study in live animals, because tests are costly and recording many brains at once is rarely possible. Their simulated fish sense and move through electric organ discharges, much like the real animals, and learn to forage jointly.

Trained agents reproduce curved homing paths and heavy tailed discharge interval patterns seen in real fish. Emergent active sensing, social foraging, dominance like asymmetries, and aggression also appear without being programmed. Sensor ablations, discharge silencing, and food redistribution tests spot what drives the social conduct, and neural dynamics encode task and social context.

Catalog record

CREATORSatpreet H. Singh Harvard University, Sonja Johnson-Yu Harvard UniversityZhouyang LuBrown UniversityAaron WalsmanHarvard UniversityFederico PedrajaColumbia UniversityDenis TurcuColumbia UniversityPratyusha SharmaMITNaomi SaphraHarvard UniversityNathaniel B. SawtellColumbia UniversityKanaka Rajan Har
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE13 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08436

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Understanding Electro-communication and Electro-sensing in Weakly Electric Fish using Multi-Agent Deep Reinforcement Learning Satpreet H. Singh Harvard University, Sonja Johnson-Yu Harvard UniversityZhouyang LuBrown UniversityAaron WalsmanHarvard UniversityFederico PedrajaColumbia UniversityDenis TurcuColumbia UniversityPratyusha SharmaMITNaomi SaphraHarvard UniversityNathaniel B. SawtellColumbia UniversityKanaka Rajan Harvard University Abstract Weakly electric fish, like Gnathonemus petersii , use a remarkable electrical modality for active sensing and communication, but studying their rich electrosensing and electrocommunication behavior and associated neural activity in naturalistic settings remains experimentally challenging. Here, we present a novel biologically-inspired computational framework to study these behaviors, where recurrent neural network (RNN) based artificial agents trained via multi-agent reinforcement learning (MARL) learn to modulate their electric organ discharges (EODs) and movement patterns to collectively forage in virtual environments. Trained agents demonstrate several emergent features consistent with real fish collectives, including heavy tailed EOD interval distributions, environmental context dependent shifts in EOD interval distributions, and social interaction patterns like freeloading , where agents reduce their EOD rates while benefiting from neighboring agents’ active sensing. A minimal two-fish assay further isolates the role of electro-communication, showing that access to conspecific EODs and relative dominance jointly shape foraging success. Notably, these behaviors emerge through evolution-inspired rewards for individual fitness and emergent inter-agent interactions, rather than through rewarding agents explicitly for social interactions. Our work has broad implications for the neuroethology of weakly electric fish, as well as other social, communicating animals in which extensive recordings from multiple individuals, and thus traditional data-driven modeling, are infeasible. 1 Introduction Communication signals in non-human animals are rich, context-dependent, and often difficult to study systematically in their natural habitat. Weakly electric fish provide a striking example: they use electric organ discharges (EODs) both for active electrosensing and for social communication ( 22 ; 23 ; 24 ; 18 ) . EODs encode information about dominance, foraging, and collective behavior, Experimental study of these signals is challenging because it requires recording from multiple freely moving individuals in naturalistic settings. Such complexities have limited our ability to build models of what, exactly, EODs communicate. Multi-agent reinforcement learning (MARL) offers an opportunity to address this gap, and has been previously applied to model collective behaviors such as flocking and cooperative hunting ( 6 ; 8 ; 21 ) . Here we adapt MARL to explicitly study electro-communication and electrosensing. We build recurrent neural network (RNN) agents that emit and sense EODs in a simulated environment, with biologically inspired constraints on movement, electric field generation, electrosensory receptors, and long-range social sensing ( 4 ; 23 ) . Trained agents reproduce key empirical phenomena: heavy-tailed EOD interval statistics, social “freeloading” strategies, and stereotyped pairwise motifs. A minimal two-fish assay further isolates the role of communication, showing that access to conspecific EODs strongly shapes foraging outcomes. Crucially, our framework provides complete access to the internal dynamics of the RNN agents. This enables mechanistic interpretability—linking specific sensory inputs to hidden representations and EOD outputs—as well as targeted ablation and steering experiments. In this way, the model serves not only as a testbed for hypotheses about fish behavior, but also as a generator of synthetic communication corpora that can be analyzed with tools from unsupervised machine translation and related areas ( 2 ; 1 ) . Our goal is to bridge AI and animal communication by developing controllable, interpretable models that help uncover the functional role of non-human communication signals. 2 Methods Figure 1: Overview of our MARL framework for modeling weakly electric fish communication. (a) Schematic of the training loop, where agents interact with a simulated arena, emitting and sensing electric organ discharges (EODs) through weakly electric fish-inspired sensors. Rewards encourage successful foraging and penalize aggressive encounters. (b) Example trajectories from four agents in a single foraging episode, showing exploration and food acquisition. (c) Snapshot of the arena (top) showing agents, food sources, and simulated electric fields; bottom shows temporally-structured EOD spike trains across individual agents. (d) Sequential Pulse Interval (SPI) distributions from real fish (left) and MARL-trained agents (right), showing that in silico agents reproduce the heavy-tailed statistics observed in biological data. Insets show log-linear curves compared to empirical curve fits. Figure 2: (a) Comparison of EOD probabilities under various conditions: (Left to Right) (a1) Effect of the Knollenorgan in competitive environments. The presence of the Knollenorgan (which provides long-range information about other agents) increases EOD rates in competitive scenarios only, suggesting the importance of social information in limited-resource regimes. (a2) Effect of the Knollenorgan in non-competitive environments. The Knollenorgan has no impact on EOD rates in non-competitive scenarios, suggesting that long-range information is not important when food is abundant. (a3) Agents (with collective sensing and Knollenorgan-enabled long-range sensing) generally tend to produce more EODs in arenas with limited food (“Competition") compared to cases where food supply is unlimited (“No competition"), suggesting that competition drives higher EOD rates as agents actively search for food. (a4) Effect of collective sensing in non-competitive environments, aggregated with and without Knollenorgan-based long-range sensing. Collective sensing reduces EOD rates as agents can gather short-range information from the EOD discharges of their neighbors, consistent with 18 . (b) Agent displacement over a \approx 0.36 second window in non-competitive environments indicates that long-range social information associated with larger movement bouts, potentially facilitating more extensive spatial exploration and thereby more efficient foraging. (c) Inter-agent inequality in food consumption increases under food scarcity, as measured by Theil Index ( 9 ) . (d) Top 6 most common pairwise social EOD motifs (Left) without collective sensing in non-competitive environments, vs. (Right) with collective sensing enabled. Higher occurrence of “silent" periods in one agent reveals emergent “freeloading" behavior during collective sensing. Social EOD motifs defined here as interaction between two agents within 15 cm for at least 4 timesteps. (e) SPI distributions shift upwards (equivalently, EOD rates lower) during collective sensing (CS) further supporting the emergence of “freeloading" strategies. Our framework couples a custom 2D physics simulator with multi-agent reinforcement learning (MARL), where artificial agents interact to forage for food, mimicking a typical experimental setup. We implement patchy food distributions with variable replenishment rates to simulate both competitive (zero-sum) and non-competitive foraging scenarios. The simulator manages agent kinematics, food dynamics, and the generation and propagation of electric fields. Agents act in continuous space by selecting forward movement, turning, binary electric organ discharges (EODs) and biting conspecifics. Each emitted EOD produces an electric field that interacts with food, walls, and conspecifics, generating induced sources and reflections that are then transduced into egocentric observations. Agents sense this electric landscape through a compact set of biomimetic sensor channels that capture (i) distortions of their own EODs (short-range active sensing), (ii) low-frequency background fields (passive sensing), and (iii) sharp EOD pulses from conspecifics (long-range social sensing) 7 . The framework also models how agents can use the EODs of neighbors to sense their environment, a phenomenon called collective sensing 18 . Agent share individual instantiations of a common underlying neural network consisting of a recurrent neural network (RNN) followed by parallel Actor and Critic two-layer feedforward networks (MLPs) (Figure 1 a). All layers are 512 units wide, with tanh nonlinearities. Agents are trained using Multi-Agent Proximal Policy Optimization ( 19 ; 17 ; 25 ) with rewards that encourage successful foraging and provide asymmetric penalties during aggressive encounters

Read the complete text