Enhancing Robot Navigation Policies with Task-Specific Uncertainty Managements Conference: Proc. of the 24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2025); May 19 – 23, 2025; Detroit, Michigan, USA <<OpenReview submission id>>
Gokul Puthumanaillam, Paulo Padrao, Jose Fuentes, Leonardo Bobadilla, Melkior Ornik · 2025
Read Enhancing Robot Navigation Policies with Task-Specific Uncertainty Managements Conference: Proc. of the 24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2025); May 19 – 23, 2025; Detroit, Michigan, USA <<OpenReview submission id>> by Gokul Puthumanaillam, Paulo Padrao, Jose Fuentes, Leonardo Bobadilla, Melkior Ornik (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13837.txt.
Introduction
Gokul Puthumanaillam and co-authors teach in 2025 robots to care about uncertainty only where it matters. A robot crossing a room needs precise position near obstacles, but not in open space. Their framework, GUIDE, paints each location with the uncertainty level the task can accept there.
Paired with reinforcement learning, the robot learns routes that finish the task while keeping uncertainty under the local limit. No heavy hand-tuning of rewards was needed. Real-world runs beat methods that ignore task-specific uncertainty. The authors frame the maps as a general way to tell navigation policies what precision each part of a job demands.
Catalog record
| CREATOR | Gokul Puthumanaillam, Paulo Padrao, Jose Fuentes, Leonardo Bobadilla, Melkior Ornik |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 9 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-13837
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enhancing Robot Navigation Policies with Task-Specific Uncertainty Managements Conference: Proc. of the 24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2025); May 19 – 23, 2025; Detroit, Michigan, USA <<OpenReview submission id>> Gokul Puthumanaillam, Paulo Padrao, Jose Fuentes, Leonardo Bobadilla, Melkior Ornik Abstract . Robots navigating complex environments must manage uncertainty from sensor noise, environmental changes, and incomplete information, with different tasks requiring varying levels of precision in different areas. For example, precise localization may be crucial near obstacles but less critical in open spaces. We present GUIDE ( G eneralized U ncertainty I ntegration for D ecision-Making and E xecution), a framework that integrates these task-specific requirements into navigation policies via Task-Specific Uncertainty Maps (TSUMs). By assigning acceptable uncertainty levels to different locations, TSUMs enable robots to adapt uncertainty management based on context. When combined with reinforcement learning, GUIDE learns policies that balance task completion and uncertainty management without extensive reward engineering. Real-world tests show significant performance gains over methods lacking task-specific uncertainty awareness. Y. Vorobeychik, S. Das, A. Nowé (eds.) Extended Abstract 1. Introduction Robots encounter varying degrees of uncertainty in sensor measurements, motion models, and environmental conditions. Critically, not all tasks require uniform levels of certainty: for instance, a robot navigating tight corridors must localize precisely, while crossing open spaces may tolerate higher uncertainty. This context-dependent nature of uncertainty requirements motivates a need for policies that can selectively reduce or accept uncertainty based on task-specific demands. Existing methods either aim to minimize uncertainty everywhere ( Patle et al. 2019 ; Gonzalez-Garcia and Castañeda 2021 ; Gul et al. 2019 ) or enforce fixed thresholds ( Cook and Zhang 2020 ; Rana et al. 2020 ) , often leading to inefficiency when uncertainty requirements vary within the same task. Some approaches attempt a uniform trade-off between task performance and uncertainty management ( Taylor et al. 2021 ; Spaan et al. 2015 ; Puthumanaillam et al. 2024b ) , but they still treat uncertainty needs as globally homogeneous. Moreover, reward engineering or manual tuning ( Zhu et al. 2021 ; Chen et al. 2019 ) is frequently required to capture task constraints. In parallel, extensive work in probabilistic robotics ( Gustafsson et al. 2002 ; Ko and Fox 2009 ; Thrun 2002 ; Fox et al. 2001 ) addresses uncertainty but does so uniformly across the workspace. Reinforcement learning (RL) has proven effective for navigation ( Wang et al. 2024 ; Wang et al. 2022 ; Puthumanaillam et al. 2024a ) but seldom integrates task-specific uncertainty considerations ( Curtis et al. 2024 ; Morad et al. 2023 ) . Techniques that penalize high-uncertainty actions ( Singi et al. 2024 ; Guo et al. 2021 ; Zhu and Zhang 2021 ; Li et al. 2024 ) or use Bayesian RL ( Budd et al. 2023 ; Alali and Imani 2024 ; Kumar et al. 2019 ; Yarats et al. 2021 ) still adopt a one-size-fits-all approach. Risk-aware planning and risk-sensitive RL ( Li et al. 2022 ; Hakobyan et al. 2019 ; Ono et al. 2015 ; Zhang et al. 2016 ; Srinivasan et al. 2020 ) similarly rely on uniform thresholds. Although language-conditioned methods ( Shah et al. 2023 ; Padalkar et al. 2023 ; Chang et al. 2023 ) broaden a robot’s task repertoire, they lack a direct mechanism to represent and leverage region-specific uncertainty limits. We address this gap by introducing Task-Specific Uncertainty Maps (TSUMs) that encode allowable uncertainty levels across different regions of the environment for a given task. TSUM captures the context-dependent value of certainty , enabling robots to focus on precision only where it is crucial. We present a policy-conditioning framework, GUIDE ( G eneralized U ncertainty I ntegration for D ecis-ion-Making and E xecution), which integrates TSUMs into navigation policies. We adapt Soft Actor-Critic (SAC) to GUIDEd SAC , balancing task objectives and uncertainty reduction without ad-hoc reward engineering. 2. Methodology Consider a robot operating in a continuous state space S with a continuous action set A . Figure 1. During pretraining, semantic and spatial embeddings are aligned via triplet loss and attention. At deployment, TSUMs derived from task descriptions and environment data condition the navigation policy for task-aware uncertainty management. Given a navigation task \tau specified in natural language, the objective is to learn a policy \pi(a\mid s) that jointly satisfies task objectives and task-specific uncertainty requirements. Task-Specific Uncertainty Maps (TSUM): A TSUM is defined as U^{\tau}(l) , a scalar representing the acceptable uncertainty at location l . Formally, U^{\tau}(l)=w_{\Phi}\,\Phi^{\tau}(l)+w_{\mathcal{C}}\,\mathcal{C}^{\tau}(l)+w_{\mathcal{E}}\,\mathcal{E}(l) , where \Phi^{\tau}(l) captures the relevance of l for the task, \mathcal{C}^{\tau}(l) encodes constraints such as safety and legal restrictions, and \mathcal{E}(l) reflects environmental factors . Task semantics are extracted from the natural language specification \tau using a RoBERTa-based parser ( Liu 2019 ) , which identifies subtasks and constraints. Each location l is mapped to a spatial embedding via a neural network that processes coordinate and environment features. Alignment between these spatial embeddings and the text-derived subtasks is enforced through a triplet loss that brings related concepts closer in embedding space while separating unrelated pairs. An attention mechanism ( Yang et al. 2016 ) weights the most relevant subtasks or constraints for each location, producing a single scalar U^{\tau}(l) indicating how critical it is to maintain low uncertainty at l . Figure 1 (center) represents an example TSUM. Policy Conditioning: Once the TSUM is generated, the robot’s state is augmented with both the TSUM value and the robot’s current uncertainty. Concretely, if s denotes the original state, then the augmented state is \tilde{s}=[s,\,U^{\tau}(s),\,u(s)] , where u(s) represents the robot’s current state-estimation uncertainty at s . The policy \pi(a\mid\tilde{s}) thus explicitly observes how precise the localization at s needs to be, enabling actions that selectively reduce uncertainty in regions with stricter tolerances. To implement this, we adopt a variant of SAC ( Haarnoja et al. 2018 ) , referred to as GUIDEd SAC (G-SAC). Standard SAC updates the policy and Q-value networks to maximize expected reward while promoting exploratory behavior via an entropy term. In G-SAC, the Q-function and policy networks receive \tilde{s} as input, allowing them to incorporate the TSUM-derived acceptable uncertainty as part of the state. By conditioning on U^{\tau}(s) , the learned policy mitigates uncertainty precisely in those regions where the task demands high localization accuracy, while avoiding unnecessary effort in areas where uncertainty can be higher without affecting task success–eliminating the need for extensive reward tuning or ad hoc penalty terms, as the TSUM itself encodes spatially varying uncertainty requirements. 3. Experiments and Results We evaluate GUIDE on real-world navigation tasks using an autonomous surface vehicle (ASV) operating in a lake with obstacles and environmental disturbances. By default, the ASV employs noisy state estimation (low cost, high uncertainty) but can temporarily request precise GPS data at an added penalty ( Puthumanaillam et al. 2024c ; Rojas et al. 2024 ) . Baselines and Ablations. We compare GUIDE (implemented as G-SAC) against: SAC (no TSUMs), SAC-P (penalized uncertainty), B-SAC (bootstrapped uncertainty), CVaR (risk-sensitive RL), RAA (risk-aware planning), and HEU (handcrafted policy that switches to GPS near obstacles). All methods share the same environment observations and cost structure, providing a fair evaluation of task-specific uncertainty handling. Performance Comparison.