Understanding visual attention beehind bee-inspired UAV navigation
Pranav Rajbhandari 1, Abhi Veda 1†, Matthew Garratt 1, Mandayam Srinivasan 2 and Sridhar Ravi 1 · 2025
Read Understanding visual attention beehind bee-inspired UAV navigation by Pranav Rajbhandari 1, Abhi Veda 1†, Matthew Garratt 1, Mandayam Srinivasan 2 and Sridhar Ravi 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-11992.txt.
Introduction
Pranav Rajbhandari and co-authors study what a bee inspired drone agent pays attention to in a 2025 paper, where the title itself misspells the word behind. Honeybees steer through clutter using optic flow, the apparent motion across their visual field. The team trained a reinforcement learning agent to cross a tunnel with obstacles using only optic flow as input. They then inspected where the trained agents focused.
Attention clustered on regions where optic flow breaks sharply and where its magnitude is large. The agents avoided the obstacles producing the strongest flow while holding a centered path, much like flying insects. The pattern repeated across independently trained agents. The authors suggest it could seed a simple explicit control law for real drones.
Catalog record
| CREATOR | Pranav Rajbhandari 1, Abhi Veda 1†, Matthew Garratt 1, Mandayam Srinivasan 2 and Sridhar Ravi 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-11992
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Understanding visual attention beehind bee-inspired UAV navigation Pranav Rajbhandari 1, Abhi Veda 1†, Matthew Garratt 1, Mandayam Srinivasan 2 and Sridhar Ravi 1 Abstract Bio-inspired design is often used in autonomous UAV navigation due to the capacity of biological systems for flight and obstacle avoidance despite limited sensory and computational capabilities. In particular, honeybees mainly use the sensory input of optic flow, the apparent motion of objects in their visual field, to navigate cluttered environments. In our work, we train a Reinforcement Learning agent to navigate a tunnel with obstacles using only optic flow as sensory input. We inspect the attention patterns of trained agents to determine the regions of optic flow on which they primarily base their motor decisions. We find that agents trained in this way pay most attention to regions of discontinuity in optic flow, as well as regions with large optic flow magnitude. The trained agents appear to navigate a cluttered tunnel by avoiding the obstacles that produce large optic flow, while maintaining a centered position in their environment, which resembles the behavior seen in flying insects. This pattern persists across independently trained agents, which suggests that this could be a good strategy for developing a simple explicit control law for physical UAVs. \affils 1 School of Engineering and Technology, University of New South Wales, Canberra, Australia, 2 Queensland Brain Institute, University of Queensland, Brisbane, Australia (E-mail: [email protected], {a.veda, m.garratt, sridhar.r}@unsw.edu.au, [email protected]) keywords Bio-inspired Robotics; Optic Flow; Deep Reinforcement Learning; Explainable AI; 1 Introduction 1.1 Bio-inspired autonomous navigation With the growing utilization of Unmanned Aerial Vehicle (UAV) and Micro Aerial Vehicle (MAV) systems for tasks like environment exploration/mapping, surveillance, and payload delivery, autonomous navigation of these systems has gained relevance. These robots often have constraints, such as inability to use GPS and reduction in available sensors, due to their use cases or maximum payload. However, the computational requirements of these systems remain large due to the high fidelity demands of autonomous aerial navigation. To maintain performance under various constraints, navigation methods developed often take inspiration from biological organisms. These methods are designed to be efficient and robust, as they mimic biological systems that have developed their capability through the process of evolution over millions of years. They serve as an attractive alternative to traditional navigation methods, such as [ 1 , 2 , 3 , 4 ] . In particular, the honeybee has been the subject of various studies for bio-inspired robotic navigation [ 5 , 6 ] . One of the main sensory inputs that bees utilize during flight is optic flow , the relative motion of elements in the visual field of the observer [ 7 , 8 , 9 ] . The bee’s reliance on optic flow arises from limited sensory capabilities, including low visual acuity and resolution of honeybee eyes, limited neural capacity, and a lack of stereo vision. Hence, it is unfeasible for them to rely solely on visual features for navigation. [ 10 , 11 ] . These constraints also make optic flow a useful sensory input for weight-constrained robotic control, as optic flow can be calculated from video captured by a single camera, which is relatively light compared to other sensory payloads. This has led to the adaptation of honeybee capabilities for various robotic tasks, such as autonomous tunnel navigation [ 12 ] , visual odometry [ 13 , 14 , 15 , 16 ] , landmark-based navigation [ 17 , 18 , 19 ] and autonomous landing [ 20 , 21 , 22 ] . These results benefit from the honeybee’s capability for associative learning [ 23 ] , creating greater understanding of navigational principles of the organism through behavioral experiments. While these projects design systems whose control is inspired from honeybee behavior, our work uses a learning algorithm to train agents with sensory input similar to a bee to fly. Our goal is to inspect the learned behavior to determine what the agent is paying most attention to in its sensory input. Since there is evidence supporting the theory that bees use optic flow from different areas of vision for different control tasks [ 24 , 25 , 26 , 27 ] , we investigate whether similar patterns arise from learning agents that use the same sensory information. 1.2 Reinforcement Learning A Markov Decision Process (MDP) is a framework useful for formalizing robotic optimization tasks. MDP s consist of a state space S , action space A , transition function {\mathcal{T}}(S\mid S,A) , reward function R\colon S\times A\times S\to\mathbb{R} , and discount factor \gamma . An agent in an MDP is described by its policy \pi(A\mid S) , which chooses a distribution over actions at each state. Given an MDP and an agent, we may generate a trajectory (s_{0},a_{0},r_{0}),(s_{1},a_{1},r_{1}),\dots , where s_{i}\sim{\mathcal{T}}(\cdot\mid s_{i-1},a_{i-1}) , a_{i}\sim\pi(\cdot\mid s_{i}) , and r_{i}=R(s_{i},a_{i},s_{i+1}) . An agent’s goal is to maximize the expected return {\mathbb{E}}[\sum_{i}\gamma^{i}r_{i}] over trajectories. A Partially Observable MDP (POMDP) is an extension of this framework that includes an observation space \Omega and an observation function O(\Omega\mid S) . An agent in a POMDP must choose action a_{i} based on its belief , a probability distribution over states. We simplify this to a policy \pi(A\mid\Omega) depending only on the current observation o_{i}\sim O(\cdot\mid s_{i}) . Reinforcement Learning (RL) is a method to solve these tasks by repeatedly sampling trajectories to optimize an agent’s policy. Deep RL uses deep neural networks to define the agent’s policy (the policy network ), as well as for functions like the expected return from a state (the value network ). In our work, we aim to train robotic agents to perform the task of avoiding obstacles while navigating a tunnel using bee-like optic flow observations. To do this, we structure the task as a POMDP , where agents are given reward for navigating successfully through the tunnel, and a penalty for crashing. Our goal is to inspect the policy of an RL agent that learned this task, to find out to which portion of each observation the agent pays most attention. 1.3 Explainable AI/Shapley Values To understand the attention patterns of a trained agent, we use methods from Explainable AI, a field concerned with exactly this problem. Specifically, SHapley Additive exPlanations (SHAP) is a method rooted in game theory that assigns values to a set of input features that represent how much each feature contributed to a decision [ 28 ] . In our case, the features will be specific regions of observed optic flow. We report the absolute SHAP value since we care about the magnitude of the contribution of each feature, as opposed to whether it had a positive or negative effect. We use the attention patterns of trained neural networks to hypothesize how real bees may utilize different regions of optic flow for a particular task. 2 Previous Work 2.1 Buggy robotics Insects, albeit limited in computational capacity ( \approx 10^{4} times less neurons in the brain than humans [ 29 ] ), solve similar navigation problems as MAV s with remarkable performance, even with a miniature form factor and no complex sensory system. This has resulted in insect-inspired systems for autonomous navigation tasks [ 30 , 31 , 32 , 33