Smart strategies to navigate turbulent odor plumes reorienting to local wind

Lorenzo Piro, Maurizio Carbone, Luca Biferale, Massimo Cencini, Robin A. Heinonen, Marco Rando, Agnese Seminara · 2026

Read Smart strategies to navigate turbulent odor plumes reorienting to local wind by Lorenzo Piro, Maurizio Carbone, Luca Biferale, Massimo Cencini, Robin A. Heinonen, Marco Rando, Agnese Seminara (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21329.txt.

Introduction

Lorenzo Piro and colleagues present a wind-relative reinforcement learning framework for navigating turbulent odor plumes. Animals solve this sensorimotor problem well despite intermittent detections and shifting wind. Their agent tracks one internal variable, time since the last odor detection, and acts relative to locally estimated wind direction filtered through an exponential memory kernel. Policies train and test in direct numerical simulations of turbulence, with and without mean wind. In mild mean wind, the learned policy beats well-known cast-and-surge policies regardless of memory time.

Catalog record

CREATORLorenzo Piro, Maurizio Carbone, Luca Biferale, Massimo Cencini, Robin A. Heinonen, Marco Rando, Agnese Seminara
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53078
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.21329

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Smart strategies to navigate turbulent odor plumes reorienting to local wind Lorenzo Piro, Maurizio Carbone, Luca Biferale, Massimo Cencini, Robin A. Heinonen, Marco Rando, Agnese Seminara Abstract Olfactory search in turbulent environments is a sensorimotor challenge solved with remarkable efficiency by many animals, yet replicating this ability in artificial systems remains difficult because detections are intermittent and wind direction fluctuates strongly, rendering standard search strategies unreliable. We introduce a wind-relative reinforcement-learning framework in which an agent navigates a turbulent plume with a single internal variable — the elapsed time since the last odor detection — and selects actions relative to a locally estimated wind direction filtered through an exponential memory kernel. Policies are trained and evaluated in direct numerical simulations of turbulence, capturing the multi-scale characteristics of velocity and odor fields in natural environments, both in the presence and absence of a mean wind. In a mild mean wind, the learned policy outperforms cast-and-surge regardless of the wind memory time, yet adapts its movement pattern to wind-estimation quality. In isotropic turbulence, performance peaks at an intermediate wind memory time, identifying temporal wind integration as a regime-dependent resource. Our results highlight the importance of developing and validating olfactory-navigation strategies under realistic turbulent conditions, and offer a compact design principle for minimal robotic olfactory navigation and testable predictions for biological search behavior. Locating the source of an odor in a turbulent environment is a fundamental navigation problem that arises across biological and engineering contexts. Entomologists have long known that, for insects, olfactory navigation is a multimodal behavior that often leverages an attractive odor cue and the direction of the wind transporting the odor Cardé and Willis 2008 ; Matheson et al. 2022 . The odor cue alone is insufficient because turbulence breaks scalar fields into irregular, intermittent filaments, so that an agent moving through a plume experiences detections as sparse, unpredictable events rather than as a continuous signal Biferale et al. 1995 ; Shraiman and Siggia 2000 ; Crimaldi and Koseff 2001 ; Celani et al. 2014 . Concentration gradients are therefore unreliable as directional cues, making strategies like chemotaxis Berg 1993 ineffective, and must be coupled to wind. Yet, the local wind direction itself is not a straightforward guide, as it fluctuates on timescales shorter than those of the search Murlis et al. 1992 . These challenges have motivated sustained interest across biology, robotics, and fluid mechanics. On the one hand, a wide range of animals routinely navigate towards odor sources in open environments with no access to global positional information — and crucially, they largely do so by combining olfactory cues with active sensing of local flow direction Cardé 2021 ; van Breugel et al. 2022 ; Reddy et al. 2022 ; Stupski and van Breugel 2024 ; Houle et al. 2026 . In flying and walking insects, dedicated mechanosensory circuits encode wind direction and integrate it with odor signals to drive goal-directed upwind movement. In Drosophila, for instance, neurons receive convergent input from separate odor and wind pathways, and their sparse activation is sufficient to orient their movement in a reproducible wind-relative direction Suver et al. 2019 ; Matheson et al. 2022 . On the engineering side, the same challenge arises in autonomous robots tasked with chemical leak detection or environmental monitoring Hutchinson et al. 2019 ; Wang and Pang 2023 ; Mansfield and Montazeri 2024 ; Fukui et al. 2025 . Algorithms for olfactory navigation largely make use of the wind direction as a primary directional cue Baker et al. 2018 ; Marques et al. 2002 ; Celani and Panizon 2024 and optimized strategies have been developed under a variety of simplifying assumptions that make the navigation problem tractable: access to an allocentric reference frame, the availability of a strong and stable mean wind that provides a reliable upwind direction, or prior statistical knowledge on the entire structure of the odor plume Vergassola et al. 2007 ; Loisy and Eloy 2022 ; Loisy and Heinonen 2023 ; Heinonen et al. 2023 ; Heinonen et al. 2025 ; Piro et al. 2026 ; Rando et al. 2026 ; Verano et al. 2023 . Among these assumptions, the knowledge of a reliable mean wind direction is key to many proposed algorithms: most strategies use it either explicitly, as a fixed allocentric reference frame, or implicitly, by training and evaluating agents in strong-flow conditions where wind-direction estimation is accurate Balkovsky and Shraiman 2002 ; Heinonen et al. 2023 ; Rando et al. 2025 . In reality, agents typically lack this prior information because the wind is weak or even absent, or because they are endowed with limited sensory or computational resources. Recent work has begun to relax these constraints by using richer internal states encoding histories of past odor detections Zhao et al. 2022 ; Singh et al. 2023 , yet such approaches remain demanding in terms of memory and computation, restricting their applicability in resource-constrained settings. Fig. 1 : Problem setup and wind-relative control framework for navigation in a turbulent odor plume. (a) Snapshot of the scalar concentration field (grey scale) for a turbulent plume with mild mean wind \bm{U} (arrow), with the source marked by a star. Two representative trajectories are shown for agents following learned policies with wind-estimation memory time \tau_{w}=1 (light blue to purple) and \tau_{w}=100 (yellow to red); color gradient along each trajectory encodes time elapsed since departure from the shared starting point (green square), with darker shades indicating later times. Red squares mark odor detection events (hits). The black arrows, overlaid on a small portion of the concentration field, illustrate how the local wind direction fluctuates even within a single odor whiff, highlighting the directional uncertainty the agent faces during the search. Lower insets: concentration time series c(t) recorded at two fixed locations (cyan and magenta triangles), illustrating the intermittent nature of the odor signal and the threshold c_{\rm thr} (dashed red line) used to define a hit. Right inset: empirical detection-probability map P_{\rm hit} , showing the spatial probability of encountering the odor plume in this environment. (b) Snapshot of the velocity field (arrows colored by local flow intensity) with a schematic of the wind-relative action rule: the agent (orange circle) measures its local wind estimate \bm{\bar{U}} (red arrow) and rotates its discrete action set accordingly. (c) Estimated wind angle \theta_{w} time series along the paths shown in panel (a) ( \tau_{w}=1 , blue; \tau_{w}=100 , orange), navigating the same flow realization. Right inset: marginal distributions P(\theta_{w}) for both memory times, showing that the long-memory estimate is sharply peaked near the mean wind direction while the short-memory estimate is broadly distributed. (d) Representative training curves for \tau_{w}=1 (dark) and \tau_{w}=100 (light). Left panel: cumulative reward R as a function of training episodes, showing convergence to a stable policy. Right panel: fraction of successful trajectories \phi_{+} (red) and inverse of the normalized arrival time T_{\rm min}/T (green) over training, confirming that both reliability and efficiency improve and saturate. Here, we introduce a minimal reinforcement-learning Sutton and Barto 2018 framework in which agents learn to navigate turbulent plumes with no prior knowledge of either wind or odor statistics. The agent operates solely on local sensory information and a minimal memory structure, with no access to allocentric

Read the complete text