Autonomous overtaking trajectory optimization using reinforcement learning and opponent pose estimation
Matej Rene Cihlar *, Luka Šiktar, Branimir Ćaran, Marko Švaco · 2026
Read Autonomous overtaking trajectory optimization using reinforcement learning and opponent pose estimation by Matej Rene Cihlar *, Luka Šiktar, Branimir Ćaran, Marko Švaco (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27207.txt.
Introduction
Cihlar and co-authors build a reinforcement learning system for autonomous race overtaking. The agent computes steering and speed from pre-generated raceline data plus live sensors. A LiDAR pipeline with a 2D detector spots the rival car ahead. A depth camera with YOLO detection adds a second view of that car. An unscented Kalman filter fuses both streams into one pose estimate. Pose errors stayed near 0.08 and 0.05 meters in the two axes. The full system completed overtakes in simulation and real-world runs alike.
Catalog record
| CREATOR | Matej Rene Cihlar *, Luka Šiktar, Branimir Ćaran, Marko Švaco |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 15041 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.27207
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Autonomous overtaking trajectory optimization using reinforcement learning and opponent pose estimation Matej Rene Cihlar *, Luka Šiktar, Branimir Ćaran, Marko Švaco Abstract Vehicle overtaking is one of the most complex driving maneuvers for autonomous vehicles. To achieve optimal autonomous overtaking, driving systems rely on multiple sensors that enable safe trajectory optimization and overtaking efficiency. This paper presents a reinforcement learning mechanism for multi-agent autonomous racing environments, enabling overtaking trajectory optimization, based on LiDAR and depth image data. The developed reinforcement learning agent uses pre-generated raceline data and sensor inputs to compute the steering angle and linear velocity for optimal overtaking. The system uses LiDAR with a 2D detection algorithm and a depth camera with YOLO-based object detection to identify the vehicle to be overtaken and its pose. The LiDAR and the depth camera detection data are fused using a UKF for improved opponent pose estimation and trajectory optimization for overtaking in racing scenarios. The results show that the proposed algorithm successfully performs overtaking maneuvers in both simulation and real-world experiments, with pose estimation RMSE of (0.0816, 0.0531) m in (x, y). † † tocauthor: Matej Rene Cihlar, Luka Šiktar, Branimir Ćaran, Marko Švaco † † institute: University of Zagreb, Zagreb 10000, Croatia, Faculty of mechanical engineering and naval architecture, 1 Introduction Autonomous racing has emerged as a challenging domain for testing self-driving algorithms and autonomous overtaking methods. Driving at the dynamic limits in adversarial conditions requires advanced vehicle control and perception algorithms. The autonomous racing environment is highly stochastic and complex, making it an ideal testbed for pose estimation and reinforcement learning (RL) algorithms. Additionally, introducing opponents into the environment makes the problem more challenging in terms of safety and performance. This paper focuses on optimizing overtaking maneuvers in a multi-agent racing environment using a reinforcement learning approach, with opponent pose estimation required for optimal overtaking. Estimating the pose of the opponent, as opposed to obstacle avoidance or treating the opponent as a static object, results in fewer crashes and more optimal driving. To produce a robust estimate of the opponent pose, an unscented Kalman filter (UKF) is implemented to fuse data from a LiDAR and a depth camera. The LiDAR pose estimation algorithm produces a 2D position (x, y) of the opponent vehicle from the 2D LiDAR scan, while the depth camera uses YOLO to detect the opponent vehicle’s bounding box, calculate its depth, and enhance the pose estimation. Using YOLOv8 object detection, specifically fine-tuned for the opponent vehicle, the distance to the opponent is calculated. The yaw angle of the opponent is not estimated because it can be directly determined from the vehicle kinematic model. For opponent pose estimation, which is used to calculate optimal driving and overtaking trajectories, this paper employs sensor fusion with a UKF 18 . A similar sensor fusion approach has been applied in autonomous driving by Hwang et al. 10 , but not in autonomous racing scenarios on the F1TENTH platform. The proposed method combines 2D LiDAR pose estimation 19 and depth camera data for opponent pose estimation using YOLOv8 object detection models 12 . Current state-of-the-art RL algorithms for autonomous racing are designed to follow optimal racing lines in single-agent racing environments. Ghignone et al. 8 presented a deep RL algorithm that follows optimal racing lines using a trajectory-conditioned reinforcement learning approach. Budai et al. 3 presented a deep RL algorithm that uses a curriculum learning approach to learn optimal racing lines in a single-agent environment. Despite these advances, most RL algorithms are simulation-based and lack real-world validation 2 . This paper focuses on an adversarial real-world multi-agent racing environment where overtaking maneuvers are incorporated into the reward formulation. Evans et al. 6 proposed a system in which the car learns overtaking maneuvers from a predefined expert dataset, validated on an F1TENTH scaled racing platform, similar to the most current RL algorithm implementations 11 . Chisari et al. 4 presented trained RL models that can be transferred to real-world scenarios using a policy output regularization approach and a lifted action space for smooth actions in race car driving. The main contribution of this paper is the combination of RL overtaking maneuvers that use opponent pose, estimated using UKF sensor fusion, validated on a real-world F1TENTH racing platform. 2 Methodology This paper consists of two main components: pose estimation using sensor fusion and a reinforcement learning algorithm for overtaking maneuvers. The physical platform used for real-world testing is based on the F1TENTH platform 11 . For processing, a Jetson Xavier NX computer is used, while a Hokuyo 2D LiDAR and an Intel RealSense D435 depth camera provide sensor inputs. The final setup is shown in Figure 1 . Figure 1 : F1TENTH racing platform setup 2.1 Opponent pose estimation Opponent pose estimation, relative to the RL agent, is performed using an onboard 2D LiDAR with an object detection algorithm and an Intel RealSense D435 depth camera with RGB-based neural network object detection and depth data. The pose estimates are fused using an Unscented Kalman Filter (UKF). The overall system performance is validated in real-world scenarios using the F1TENTH racing platform ground truth position, obtained with the Optitrack motion capture system. For LiDAR-based opponent pose estimation, an object detection algorithm from 1 uses clustering and rectangle fitting. The most likely opponent car cluster is then selected using the UKF estimate from the previous timestep. The depth camera uses both RGB and depth data for opponent pose estimation. For the RGB data, the YOLOv8 12 object detection model is used to detect the opponent car’s bounding box. The model is trained on a custom dataset of 120 images using Roboflow 7 , and since only one F1TENTH car is available, an Astro robot is used as the opponent. This should not affect the algorithm behavior since the model can be trained on any car as long as it can detect it reliably. The distance estimation is done by taking the height of the bounding box and applying the general reciprocal function: distance=\frac{a}{bbox\_height+b}+c, (1) where the parameters were determined experimentally. This approach is valid since the opponent is always seem from the side, so the height changes only with distance, not with orientation. The yaw angle is not estimated because it can be approximated from the Ackermann steering model, which limits the direction of travel to the direction of orientation. From the bounding box center pixel location, the angle around the z-axis of the opponent relative to the agent can be calculated, and depth data can be extracted. Since the depth distance actually measures the back of the opponent car, an average offset was calculated from the Astro robot dimensions, and added to the depth distance. These measurements were then passed to the UKF. For the sensor fusion, an Unscented Kalman Filter (UKF) is implemented based on 18 . The UKF state vector is defined as [x,y,v_{x},v_{y}] and a constant velocity model is used for the process. Since LiDAR and depth camera measurements are in different formats and from different sensors, two different measurement models are defined, including the static transformations for the sensor frames that are measured manually. Since sensors have different publishing rates, the UKF is updated on every mesurement. In this step the