Dynamic Lookahead Distance via Reinforcement Learning-Based Pure Pursuit for Autonomous Racing
Mohamed Elgouhary, Amr S. El-Wakeel · 2026
Read Dynamic Lookahead Distance via Reinforcement Learning-Based Pure Pursuit for Autonomous Racing by Mohamed Elgouhary, Amr S. El-Wakeel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-28625.txt.
Introduction
Elgouhary and El-Wakeel combine reinforcement learning with Pure Pursuit control for autonomous racing. Pure Pursuit is simple and fast, but its lookahead distance is hard to set. Short values corner well yet can shake on straights. Long values are smooth but cut corners poorly. Their agent uses Proximal Policy Optimization to set lookahead online from speed and curvature data. Training ran in the F1TENTH Gym simulator, with deployment in ROS2. On unseen tracks, the learned method set the best lap times. It also transferred to a real car.
Catalog record
| CREATOR | Mohamed Elgouhary, Amr S. El-Wakeel |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35096 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.28625
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dynamic Lookahead Distance via Reinforcement Learning-Based Pure Pursuit for Autonomous Racing Mohamed Elgouhary, Amr S. El-Wakeel Abstract Pure Pursuit (PP) is a widely used path-tracking algorithm in autonomous vehicles due to its simplicity and real-time performance. However, its effectiveness is sensitive to the choice of lookahead distance: shorter values improve cornering but can cause instability on straights, while longer values improve smoothness but reduce accuracy in curves. We propose a hybrid control framework that integrates Proximal Policy Optimization (PPO) with the classical Pure Pursuit controller to adjust the lookahead distance dynamically during racing. The PPO agent maps vehicle speed and multi-horizon curvature features to an online lookahead command. It is trained using Stable-Baselines3 in the F1TENTH Gym simulator with a KL penalty and learning-rate decay for stability, then deployed in a ROS2 environment to guide the controller. Experiments in simulation compare the proposed method against both fixed-lookahead Pure Pursuit and an adaptive Pure Pursuit baseline. Additional real-car experiments compare the learned controller against a fixed-lookahead Pure Pursuit controller. Results show that the learned policy improves lap-time performance and repeated lap completion on unseen tracks, while also transferring zero-shot to hardware. The learned controller adapts the lookahead by increasing it on straights and reducing it in curves, demonstrating effectiveness in augmenting a classical controller by online adaptation of a single interpretable parameter. On unseen tracks, the proposed method achieved 33.16 s on Montreal and 46.05 s on Yas Marina, while tolerating more aggressive speed-profile scaling than the baselines and achieving the best lap times among the tested settings. Initial real-car experiments further support sim-to-real transfer on a 1:10-scale autonomous racing platform. I Introduction Autonomous racing is a rapidly evolving domain that tests the limits of perception, planning, and control algorithms under high-speed and high-precision requirements. Unlike traditional autonomous driving, racing involves aggressive maneuvers, tight curves, and the need for real-time adaptation to dynamic vehicle and track conditions. Designing controllers that can operate safely and efficiently in such environments remains a central challenge in robotics and intelligent systems. Among classical trajectory tracking strategies, Pure Pursuit [ 25 ] has emerged as a widely adopted geometric controller due to its conceptual simplicity, low computational overhead, and reasonable performance in many driving scenarios. It works by projecting a lookahead point on a reference trajectory and computing a steering command that aims the vehicle toward that point. However, despite its popularity, the Pure Pursuit controller exhibits a fundamental limitation: its behavior is highly sensitive to the choice of the lookahead distance. The lookahead distance determines the trade-off between stability and responsiveness. A small lookahead value can improve curve tracking and allow faster directional changes, but it often causes steering oscillations and instability on straight segments. A large lookahead value usually produces smoother and more stable motion, but it can cut corners and perform poorly in sharp turns. In fixed-lookahead implementations, the controller cannot adapt to changing track conditions, which leads to suboptimal performance, especially in high-speed racing where both accurate cornering and stable straight-line behavior are important. Several heuristic approaches have attempted to address this issue, such as curvature-aware or speed-dependent lookahead modulation. These methods can improve performance in specific scenarios, but they still rely on manually crafted rules and schedule parameters that often require retuning across tracks, speed profiles, and vehicle platforms. In contrast, a learned adaptation policy can potentially capture more context-dependent behavior while retaining the structure of the underlying controller. To overcome these limitations, we propose a hybrid control framework that augments classical Pure Pursuit with a learning-based adaptation mechanism [ 9 ] . Specifically, we use Proximal Policy Optimization (PPO) [ 23 ] to dynamically adjust the lookahead distance in real time based on the vehicle’s current state. Unlike fixed tuning and hand-crafted adaptive schedules, our approach formulates lookahead selection as a continuous control task, enabling the policy to learn context-dependent behaviors while preserving the structure and interpretability of the underlying geometric controller. The PPO agent is trained in simulation using the F1TENTH Gym environment [ 19 ] , where it learns to map vehicle speed and multi-horizon raceline curvature features to an optimal lookahead distance. The integration of PPO with the Pure Pursuit controller ensures that learning remains focused on adaptive behavior while retaining the interpretability, robustness, and low-latency characteristics of classical control. We do not replace the underlying geometric controller or learn low-level steering and throttle end-to-end. Instead, we focus on a narrower and more interpretable problem: adapting the Pure Pursuit lookahead distance online while preserving the structure, transparency, and low computational cost of the classical controller. This framing is especially useful in modular ROS2-based autonomy stacks, where bounded computation and controller interpretability remain important. To support the learning process, we leveraged a globally optimized race trajectory to extract reference waypoints [ 11 ] , including x , y positions, target speed, and curvature at each point. These were used both to guide the baseline controller and to define relevant state features for the PPO agent. The agent observes vehicle speed and multi-horizon curvature features to learn a dynamic mapping to the lookahead distance. LiDAR is used for collision detection in the environment and reward to enforce safety during training. For efficient and stable training, we utilized Optuna [ 1 ] to optimize key hyperparameters, including the initial learning rate and maximum gradient norm. We further stabilized training by applying KL-divergence penalties and learning rate decay, enabling smoother convergence and improved final performance. Because the learned policy adjusts only the Pure Pursuit lookahead parameter while leaving the geometric controller unchanged, the resulting method remains lightweight, interpretable, and easy to integrate into modular ROS2 autonomy stacks. Our contributions are as follows: • We introduce a reinforcement learning-augmented Pure Pursuit controller that dynamically adjusts the lookahead distance online for autonomous racing. • We design a PPO training setup based on speed and multi-horizon curvature features, together with a reward that promotes progress, smoothness, and safe lap completion. • We evaluate the learned policy zero-shot on unseen tracks against both fixed-lookahead and hand-crafted adaptive Pure Pursuit baselines, and further validate sim-to-real transfer on a real 1:10-scale autonomous racing vehicle against a fixed-lookahead Pure Pursuit baseline. • We adapt a single interpretable Pure Pursuit parameter ( L_{d} ), yielding behavior consistent with racing intuition while preserving the classical controller structure. This work highlights the potential of combining the adaptability of deep reinforcement learning with the reliability and transparency of classical control. The resulting controller is well-suited for high-performance autonomous racing and represents a step toward more intelligent, context-aware control strategies in robotics. II Related Work Path tracking is a foundational problem in autonomous driving, with numerous classical [ 21 ] and learning-based approaches [ 9 ] developed over the years. Among classical methods, geometric controllers such as Pure Pursuit [ 25 ] , Stanley [ 5 ] , and the Follow-the-Carrot algorithm have gained widespread popularity due to their simplicity and ease of implementation. In particular, the Pure Pursuit algorithm has seen extensive use in autonomous ground vehicles for applications ranging from urban navigation [ 17 ] , [ 22 ] to racing [ 2 ] , due to its ability to operate in real time with minimal computational resources. Several enhancements to