RAY-TOLD: Ray-Based Latent Dynamics for Dense Dynamic Obstacle Avoidance with TDMPC

Seungho Han, Seokju Lee, Jeonguk Kang · 2026

Read RAY-TOLD: Ray-Based Latent Dynamics for Dense Dynamic Obstacle Avoidance with TDMPC by Seungho Han, Seokju Lee, Jeonguk Kang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27450.txt.

Introduction

Han, Lee, and Kang propose RAY-TOLD, a controller that helps mobile robots navigate dense, dynamic crowds where reactive planners stall in local minima. Their LiDAR-centred latent model compresses sensor data into a state, supporting a learned terminal value function and policy prior. A policy-mixture strategy adds trajectories from the policy to the planner's candidate set, guiding it toward the goal while keeping motion feasible. In tests with dense dynamic obstacles, the method beats the MPPI baseline and reduces collisions, showing that learned long horizon intent improves safety.

Catalog record

CREATORSeungho Han, Seokju Lee, Jeonguk Kang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32804
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.27450

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RAY-TOLD: Ray-Based Latent Dynamics for Dense Dynamic Obstacle Avoidance with TDMPC Seungho Han, Seokju Lee, Jeonguk Kang Abstract Dense, dynamic crowds pose a persistent challenge for autonomous mobile robots. Purely reactive planning methods, such as Model Predictive Path Integral (MPPI) control, often fail to escape local minima in complex scenarios due to their limited prediction horizon. To bridge this gap, we propose Ray-based Task-Oriented Latent Dynamics (RAY-TOLD), a hybrid control architecture that integrates obstacle information into latent dynamics and utilizes the robustness of physics-based MPPI with the long-horizon foresight of reinforcement learning. RAY-TOLD leverages a LiDAR-centric latent dynamics model to encode high-dimensional sensor data into a compact state representation, enabling the learning of a terminal value function and a policy prior. We introduce a policy mixture sampling strategy that augments the MPPI candidate population with trajectories derived from the learned policy, effectively guiding the planner towards the goal while maintaining kinematic feasibility. Extensive tests in a stochastic environment with high-density dynamic obstacles demonstrate that our method outperforms the MPPI baseline, reducing the collision rate. The results confirm that blending short-horizon physics-based rollouts with learned long-horizon intent significantly enhances navigation reliability and safety. I Introduction Navigating through dense crowds of dynamic obstacles (Fig. 1 ) remains a formidable challenge for autonomous mobile robots. Real-world deployment in human-centric environments requires navigation systems capable of rapidly anticipating environmental changes, avoiding unpredictable dynamic agents, and strictly adhering to kinematic constraints [ 1 ] . While classical optimization-based methods provide reliable collision avoidance, the exponential growth of complexity in highly dynamic environments often necessitates a trade-off between computational efficiency and long-term foresight. Model Predictive Path Integral (MPPI) control has emerged as a powerful sampling-based method for handling non-linear vehicle dynamics in uncertain environments [ 2 ] . By leveraging parallel trajectory rollouts, MPPI achieves robust short-term collision avoidance and kinematic feasibility. However, purely reactive planners like standard MPPI suffer from a critical limitation: the computational cost of simulating forward dynamics curtails the feasible prediction horizon [ 3 ] . Consequently, these methods lack long-term spatial awareness, frequently causing the robot to become trapped in local minima such as U-shaped obstacles [ 4 ] or dense crowd formations, where short-term safe paths fail to align with the global navigation goal. Reinforcement learning (RL), on the other hand, excels in consolidating long-horizon reasoning directly from environmental interactions. By learning a value function that approximates the infinite-horizon cost-to-go, RL provides agents with an intuitive foresight that helps avoid myopic decisions and local minima [ 5 ] . Furthermore, recent advancements in world models and latent dynamics have enabled agents to acquire structured and predictive representations of the environment, facilitating planning through learned internal models rather than relying solely on high-dimensional raw observations [ 6 , 7 ] . Fig. 1 : (a) An environment with dense dynamic obstacles and (b) the corresponding bird’s-eye view. Despite these advances in model-based and representation-driven RL, many practical robotic systems still rely on end-to-end model-free RL policies due to their simplicity and scalability. However, such approaches often struggle to enforce hard safety constraints during learning and tend to suffer from inefficient or unsafe exploration, particularly in environments with complex or dynamic obstacles. These limitations pose significant challenges for the reliable deployment of RL policies in safety-critical physical robotic systems [ 8 ] . To bridge the gap between the constraint-satisfying robustness of physics-based MPC and the long-horizon foresight of learning-based models, this paper proposes Ray-based Task-Oriented Latent Dynamics (RAY-TOLD) . Built upon the principles of temporal-difference learning for model predictive control [ 9 , 10 ] , RAY-TOLD introduces a hybrid control architecture tailored for LiDAR-equipped autonomous robots navigating in dynamic crowds. Our approach encodes high-dimensional obstacle information from LiDAR scans into a low-dimensional latent representation. Within this latent space, a transition dynamics model, a terminal value function, and an action policy are jointly trained. During online execution, RAY-TOLD resolves the local minima problem inherent to MPPI by introducing a policy mixture sampling strategy. Instead of relying entirely on unbiased Gaussian noise for trajectory generation, RAY-TOLD augments the MPPI candidate population with trajectories proposed by the learned policy prior. The sampled trajectories are then evaluated using the learned terminal value function, which encapsulates the long-term intent of the navigation task. This allows the MPPI planner to effectively look beyond its limited short-horizon rollout, securely guiding the robot around complex dynamic obstacles while guaranteeing kinematic feasibility. The main contributions of this work are summarized as follows: • We present RAY-TOLD, a hybrid architecture that seamlessly integrates LiDAR-centric latent dynamics modeling with sampling-based MPPI to tackle navigation in dense dynamic environments. • We introduce a policy mixture sampling technique coupled with a learned terminal value function, effectively eliminating the vulnerability of MPPI to local minima without requiring explicitly handcrafted heuristics. • We conduct extensive tests in highly stochastic environments, demonstrating that blending short-horizon physics-based rollouts with long-horizon learned intent significantly reduces collision rates and outperforms standard MPPI baselines in safety and reliability. The remainder of the paper is organized as follows. Section II reviews the related literature on MPC and RL-based collision avoidance. Section III presents the detailed methodology of RAL-TOLD, including the mathematical formulations. Section IV provides test validation of RAL-TOLD in environments with dense dynamic obstacles. Finally, Section V concludes the paper. II Related Work MPC and MPPI are widely used since they explicitly handle system dynamics and constraints [ 3 ] . To extend their prediction horizons, hierarchical approaches like PRM-RL [ 11 ] pair probabilistic roadmaps with RL. Recent MPPI variants integrate perceptive dynamics for off-road tasks [ 12 ] and distributed frameworks for scalable multi-robot coordination [ 13 ] . Additionally, TD-CD-MPPI [ 2 ] embeds temporal-difference learning into MPPI to approximate infinite-horizon costs. Building on these, RAY-TOLD utilizes MPPI as the core planner but explicitly steers the sampling using a LiDAR-trained task-oriented latent model. Combining RL’s long-term reasoning with MPC’s safety has inspired various hybrid models. AC-MPC [ 8 ] embeds a differentiable MPC within an RL actor, while DR-MPC [ 1 ] adds residual RL corrections to nominal MPC commands. MPC-inspired RL [ 5 ] parameterizes controllers like QP solvers, and Meta-RL frameworks use MPC to adapt dynamically to changing environments [ 14 ] . Unlike residual or differentiable combinations, our method injects RL guidance directly into MPPI’s proposal distribution, ensuring all actions remain grounded in physics-based rollouts. World models [ 15 ] improve sample efficiency by enabling latent imagination. Architectures like DreamerNav [ 6 ] merge depth and occupancy maps for indoor navigation, while iQRL [ 7 ] prevents representation collapse via implicit quantization. For more complex settings, DAWM [ 16 ] uses Transformers to predict state increments at intersections, and Performer-MPC [ 17 ] applies real-time attention for dynamic spatial encoding. RAY-TOLD adapts these concepts specifically for sparse 2D LiDAR streams, crafting representations optimized for local motion prediction of dense crowds. TD-MPC [ 9 ] jointly learns latent dynamics and terminal values for fast planning. TD-MPC2 [ 10 ] scales this for multi-task continuous control, and D-MPC [ 18 ] incorporates diffusion models for multi-step action proposals. To mitigate value overestimation from out-of-distribution rollouts, TD-M(PC) 2 [ 19 ] introduces policy constraints during value learning.

Read the complete text