Obstacle-aware navigation of smart microswimmers in a turbulent flow Preprint: APS/123-QED
Vaishnavi Gajendragad, Akanksha Gupta, Nadia Bihari Padhan, Rahul Pandit · 2026
Read Obstacle-aware navigation of smart microswimmers in a turbulent flow Preprint: APS/123-QED by Vaishnavi Gajendragad, Akanksha Gupta, Nadia Bihari Padhan, Rahul Pandit (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21223.txt.
Introduction
Gajendragad and co-authors teach smart microswimmers to navigate turbulent flows around obstacles. Microswimmers in such flows can get trapped at obstacles or escape them in complex ways. They extend adversarial Q-learning methods so swimmers can move from a start point to a target in two dimensional turbulence. A circular obstacle is added by a volume penalization method. Their obstacle-aware strategy curbs the tendency to stick at stagnation points near the obstacle. The smart swimmers beat both naive swimmers and surfers in their tests.
Catalog record
| CREATOR | Vaishnavi Gajendragad, Akanksha Gupta, Nadia Bihari Padhan, Rahul Pandit |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33738 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.21223
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Obstacle-aware navigation of smart microswimmers in a turbulent flow Preprint: APS/123-QED Vaishnavi Gajendragad, Akanksha Gupta, Nadia Bihari Padhan, Rahul Pandit Abstract Microswimmers in turbulent flows often navigate complex, heterogeneous, and obstacle-rich environments, where they exhibit intricate behaviors such as trapping at and escape from obstacles. We generalize recent 𝒬 − \mathcal{Q}- learning methods of J.K. Alageshan et al. [Phys.Rev.E 101 , 043110 (2020)] and A. Gupta et al. [Physics of Fluids 37 , 045107 (2025)] developed for non-interacting microswimmers that aim to move optimally from an initial position to a target, to account for the additional complication of an obstacle in the flow. We begin by considering one circular obstacle in forced two-dimensional (2D) Navier-Stokes turbulence in which the energy spectrum displays a forward cascade. We employ the volume-penalization method to introduce this obstacle within our doubly periodic simulation domain. We augment our adversarial 𝒬 − \mathcal{Q}- learning Refs. [ 1 , 2 ] by suppressing the tendency of microswimmers to get trapped in stagnation points in the vicinity of the obstacle. We demonstrate that smart microswimmers ( S S SS ), which adopt our obstacle-aware adversarial 𝒬 − \mathcal{Q}- learning strategy, outperform both naïve swimmers ( N S NS ) and surfers ( S u S SuS ). I Introduction Motility has played a crucial role in the evolutionary success of microorganisms. Not only has it enabled them to navigate effectively through complex environments, to reach sources of nutrition, but it has also helped them to avoid obstacles. Sperm transport provides an interesting example: millions of spermatozoa face a series of obstacles in fluctuating fluid environments, but using head-based chemotaxis, sperm cells adjust their propulsion in response to environmental chemical gradients to enhance their chances of successful fertilization [ 3 ] . Similarly, bacteria like Escherichia coli employ a run and tumble strategy to explore their surroundings, in the digestive tract, where they assess their proximity to attractants like sugars and amino acids. When a repellent is detected, E. coli increase the frequency of tumbles, changing direction so as to move away from harmful stimuli [ 4 , 5 , 6 ] . Swimmer navigation in steady flows has been well documented [ 7 , 8 , 9 , 10 ] and studied in biophysics. Equally important is the path planning of artificial microswimmers or microrobots through fluid flows; if these flows are turbulent, then this path-planning problem is challenging, but some progress has been made recently using reinforcement learning [ 1 , 11 , 12 ] . The generalization of such reinforcement-learning-aided path planning in obstacle-laden environments is an open problem. We address this here. Experiments on microscopic self-propelled particles, in patterned environments, have shown that they can navigate complex spatial features, particularly near walls, where they first make contact, slide along the surface while rotating, and eventually reorient their propulsion direction to detach and move away [ 13 ] . Additionally, Image-Based Visual Servoing methods have been successfully employed to train helical microswimmers to follow a designated path and effectively avoid obstacles [ 14 ] . Studies on the role of hydrodynamic interactions of active microswimmers with walls and obstacles have observed that optimal path planning is counterintuitive because the flow field generated by their motion [ 15 ] can result in bound states, because of circling or trapping [ 16 , 17 ] ; furthermore, they can be captured or scattered depending on hydrodynamic interactions [ 18 ] . At microscopic scales, inertia is negligible, so swimmer dynamics is strongly influenced by viscosity and thermal fluctuations. However, navigation strategies that are effective in the viscous regime often fail in flow environments with strong shear, vortical structures, and turbulence. Over the past decade, machine-learning strategies have been developed for the path-planning of microswimmers in turbulent flows [ 19 , 20 , 21 , 1 , 22 , 23 , 24 , 12 , 25 ] ; these studies use different versions of reinforcement learning. Recent studies have shown that smart microswimmers can learn to exploit flow gradients and shear to migrate efficiently across Poiseuille flows, significantly outperforming naïve or passive strategies [ 22 ] . Reinforcement learning can be used to tame Lagrangian chaos and suppress dispersion in time-dependent flows by learning multi-objective control strategies [ 26 ] . Related studies demonstrated that microswimmers can successfully navigate complex vortical and turbulent-like flows by exploiting transient flow features, rather than attempting to overcome them [ 24 ] . Furthermore, reinforcement learning has been applied to undulatory microswimmers to demonstrate that gait modulation can be optimized to achieve efficient steering and transport in flow fields [ 27 ] . Thus, intelligent navigation has emerged as a rapidly developing research frontier for microswimmers, both artificial and biological [ 28 , 29 ] ; and there has been a concomitant growth in the application of machine learning (ML) to this field. Similar ideas have also been explored at larger spatial scales, e.g., in the navigation of robotic fish in vortical flows [ 30 ] . Moreover, it has been demonstrated [ 23 ] that successful navigation in steady flows depends crucially on symmetry breaking: when only local hydrodynamic cues are available, swimmers can learn efficient migration strategies provided that either the dynamics or the task itself breaks the underlying symmetries of the flow. Despite these significant advances, an important aspect of realistic microswimmer navigation remains largely unexplored: the effects on path planning of solid obstacles in turbulent or complex flows. In many practical settings – such as porous media, vascular networks, or cluttered microfluidic devices – microswimmers [ 31 , 32 , 33 , 34 ] must cope not only with flow-induced fluctuations, but also detect, avoid, and exploit obstacles. Obstacles fundamentally alter local-flow topology, generating boundary layers, recirculation zones, and intermittent high-shear regions that affect swimmer trajectories strongly. In turbulent flows, the interplay between unsteady vortical structures and obstacle-induced flow heterogeneity amplifies the complexity of navigation. Therefore, the development of ML strategies for microswimmer path planning, in turbulent flows with obstacles, is an important challenge; furthermore, it has applications in targeted drug delivery and the locomotion of microbots [ 35 , 36 , 37 ] . Therefore, we investigate how microswimmers can learn adaptive strategies that account simultaneously for turbulent fluctuations and obstacle-induced flow features. In particular, we generalize the \mathcal{Q}- learning methods of Refs. [ 1 , 12 ] for non-interacting microswimmers as follows: we employ slave microswimmers to implement an adversarial \mathcal{Q}- learning to optimize their path planning. Such microswimmers aim to move optimally, from an initial position to a target, while swimming around obstacles in the flow . We begin by considering one circular obstacle in a forced 2D Navier-Stokes fluid; the forcing is chosen to induce turbulence in which the energy spectrum displays a forward cascade [ 38 , 39 ] ; we use the volume-penalization method [see, e.g., Ref. [ 40 ] ] to introduce this obstacle within our doubly periodic simulation domain. We augment our adversarial \mathcal{Q}- learning by suppressing the tendency of microswimmers to get trapped in stagnation points in the vicinity of the obstacle. Finally, we demonstrate that smart swimmers that adopt our obstacle-aware adversarial \mathcal{Q}- learning strategy