Learning-Based Navigation for Indoor Mobile Robots

Tri-Tin Nguyen, Tien-Dat Nguyen, Gia-Uy Le, Vinh Nguyen, Vinh-Hao Nguyen 1 · 2026

Read Learning-Based Navigation for Indoor Mobile Robots by Tri-Tin Nguyen, Tien-Dat Nguyen, Gia-Uy Le, Vinh Nguyen, Vinh-Hao Nguyen 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30468.txt.

Introduction

Tri-Tin Nguyen, Tien-Dat Nguyen, Gia-Uy Le, Vinh Nguyen and Vinh-Hao Nguyen present a learning-based navigation framework for indoor mobile robots. The method pairs a neural global planner, trained from A* paths, with a DWA local planner, framed as choice over the DWA action lattice. The policy first learns by cloning, then refines by PPO under feasibility masking. The framework tests in both simulated and real indoor settings. Results show it makes workable global routes and dependable local motion commands for safe navigation among obstacles.

Catalog record

CREATORTri-Tin Nguyen, Tien-Dat Nguyen, Gia-Uy Le, Vinh Nguyen, Vinh-Hao Nguyen 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20646
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30468

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning-Based Navigation for Indoor Mobile Robots Tri-Tin Nguyen, Tien-Dat Nguyen, Gia-Uy Le, Vinh Nguyen, Vinh-Hao Nguyen 1 Abstract This paper presents a learning-based navigation framework for indoor mobile robots. The proposed method combines a supervised neural global planner, trained from cost-aware A* expert trajectories, with the proposed Learning-Based DWA local planner, which is formulated as discrete candidate selection over the Dynamic Window Approach (DWA) action lattice. For local planning, the policy is first trained by behavior cloning and then refined by Proximal Policy Optimization (PPO) under feasibility-aware masking. The framework is implemented and evaluated in both simulated and real-world indoor environments. Experimental results show that the proposed method generates feasible global routes and reliable local motion commands for safe goal-directed navigation in the presence of obstacles. These results demonstrate the effectiveness of integrating learning-based global planning with reinforcement-learning-refined local control for indoor mobile robot navigation. The source code will be released at https://ntdathp.github.io/rl_robot_web/ . I Introduction Indoor mobile robot navigation commonly follows a hierarchical architecture, in which a global planner generates a map-level route and a local planner produces real-time commands for obstacle avoidance. However, classical planners rely on handcrafted search rules and may produce conservative motions in cluttered environments. To address these limitations, this paper proposes a learning-based navigation framework that combines a supervised neural global planner trained from cost-aware A* expert trajectories with a learning-based local planner formulated as discrete candidate selection over the DWA action lattice. The local policy is first trained by behavior cloning and then lightly refined by PPO under feasibility-aware masking, yielding a unified framework for map-level route generation and structured local motion control. This work contributes a deployable hybrid learning-based navigation framework that preserves DWA feasibility by selecting actions from the DWA lattice rather than directly learning unconstrained continuous velocity commands. Fig. 1 : Overview of the proposed learning-based navigation framework. The pipeline includes data collection, global path planning, local motion planning, deployment, model training, and evaluation. The main contributions of this paper are summarized as follows: • A hybrid learning-based navigation framework integrating a supervised neural global planner with a DWA-based local candidate selector. • A two-stage local-planning policy trained by behavior cloning and PPO refinement with validity-aware action masking. • Simulation and real-world validation demonstrating improved path quality and smoother motion compared with conventional DWA. II Related Work II-A Global Path Planning Global path planning provides map-level routes for mobile robot navigation. Classical methods mainly rely on graph-search or sampling-based algorithms, among which A* is widely used because of its efficiency and reliability on structured maps. Recent learning-based planners, such as Neural A* [ 17 ] , learning-guided heuristics [ 13 ] , MPNet [ 12 ] , and PRM-RL [ 5 ] , have improved planning flexibility. In contrast to methods focusing mainly on global planning, this paper integrates a supervised neural global planner with a feasibility-preserving DWA-based local candidate selector for closed-loop indoor navigation. II-B Local Path Planning Local path planning generates real-time motion commands for path tracking and obstacle avoidance. DWA is a representative velocity-space planner that selects admissible commands under dynamic constraints, obstacle clearance, and goal-progress criteria [ 6 ] . Although DWA has been extended in practical navigation systems [ 1 ] , it can still be conservative in cluttered environments. Learning-based local planners have been studied to improve adaptability, including DWA-RL [ 11 ] , RL-based navigation in crowded or cluttered scenes [ 8 , 19 , 10 , 4 , 3 , 16 ] , velocity-obstacle-based DRL [ 15 ] , RL-enhanced DWA [ 7 ] , and dimension-configurable local planning [ 18 ] . Practical mobile robot systems also emphasize the integration of planning, perception, and decision making for real-world deployment [ 9 ] . Different from end-to-end policies that directly predict continuous commands, our method selects feasible candidates from the DWA action lattice, preserving the constraint-aware structure of DWA while improving motion smoothness and path quality through behavior cloning and PPO refinement. III Methodology III-A System Overview The proposed framework consists of a global planner and a local planner, as shown in Fig. 2 . The global planner generates a feasible route on a known indoor map, while the local planner produces real-time commands for path following and obstacle avoidance. The global planner is trained by supervised learning from expert demonstrations, and the local planner is initialized by behavior cloning and refined by reinforcement learning. Fig. 2 : Overview of the proposed navigation framework. The global planner follows a learning-based A*-inspired design, whereas the local planner is implemented as the proposed Learning-Based DWA, enabling closed-loop indoor navigation. III-B Robot Kinematic Model The robot follows a differential-drive model with state \mathbf{x}=[x,y,\theta]^{T} [ 2 , 14 ] . The global planner provides a reference path, and the local planner generates feasible velocity commands (v,\omega) for path following and obstacle avoidance. III-C Global Path Planning Module The global planner generates a feasible map-level route on a known indoor costmap by learning a directional policy from trajectories produced by a cost-aware A* expert. III-C 1 Cost-Aware A* Expert Planner Training targets are generated by a cost-aware A* planner on a 2D costmap. The planner expands 8-connected neighbors and selects the node minimizing f(n)=g(n)+h(n) , where g(n) is the accumulated cost and h(n) is the Euclidean heuristic. Successor cost includes step, turning, and high-cost penalties. Unknown and occupied cells are excluded. The resulting paths provide state–action supervision. III-C 2 Planning Representation and Network Architecture At each planning step, the input is a five-channel tensor \mathbf{x}_{t}\in\mathbb{R}^{192\times 192\times 5} , encoding obstacle occupancy, normalized costmap value, unknown-space mask, current robot position, and goal position. The target output is the expert next-step action a_{t}^{E}\in\{0,1,\dots,7\} , corresponding to the 8-connected directions \{\mathrm{N},\mathrm{NE},\mathrm{E},\mathrm{SE},\mathrm{S},\mathrm{SW},\mathrm{W},\mathrm{NW}\} . An auxiliary path mask is used for dense spatial supervision. The global planner is implemented as a convolutional policy network, denoted by \pi_{\theta}^{\mathrm{G}} , which maps the input to logits over the eight candidate directions as \mathbf{z}_{t}=\pi_{\theta}^{\mathrm{G}}(\mathbf{x}_{t})\in\mathbb{R}^{8} . Fig. 3 shows the proposed network. Fig. 3 : Network architecture of the proposed neural global planner, consisting of an encoder, an action head, and an auxiliary path head. The network uses a shared convolutional encoder and an action head, while the auxiliary path branch is used only during training. III-C 3 Training Objective Let the supervised training dataset be \mathcal{D}_{\mathrm{G}}=\{(\mathbf{x}_{t},a_{t}^{E},\mathbf{M}_{t})\}_{t=1}^{M}, (1) where \mathbf{x}_{t} , a_{t}^{E} , and \mathbf{M}_{t} denote the input tensor, expert action, and auxiliary path mask, respectively. The action-classification loss is \mathcal{L}_{\mathrm{act}}(\theta)=-\frac{1}{M}\sum_{t=1}^{M}\log\pi_{\theta}^{\mathrm{G}}(a_{t}^{E}\mid\mathbf{x}_{t}), (2) and the auxiliary path loss is \mathcal{L}_{\mathrm{path}}(\theta)=\frac{1}{M}\sum_{t=1}^{M}\ell(\hat{\mathbf{M}}_{t},\mathbf{M}_{t}), (3) where \hat{\mathbf{M}}_{t} is the predicted path mask. The total loss is \mathcal{L}_{\mathrm{G}}(\theta)=\mathcal{L}_{\mathrm{act}}(\theta)+\lambda_{\mathrm{path}}\mathcal{L}_{\mathrm{path}}(\theta), (4) where \lambda_{\mathrm{path}} controls the auxiliary-loss weight. III-C 4 Runtime Rollout-Based Planning At deployment, planning proceeds autoregressively in grid space. From \mathbf{p}_{t} , the network predicts an action, masks invalid moves, and updates the state as \mathbf{p}_{t+1}=\mathbf{p}_{t}+\Delta(a_{t}) . Rollout stops at the goal, on invalid progression, or at the horizon limit. The resulting path is then converted to world coordinates. III-D Local Path Planning Module The local planner generates real-time velocity commands for tracking and obstacle avoidance under kinematic and dynamic constraints. Two variants are used: conventional DWA and a learning-based DWA candidate selector. The conventional DWA serves as both the rule-based baseline and

Read the complete text