End2Race: Efficient End-to-End Imitation Learning for Real-Time F1Tenth Racing
Zhijie Qiao, Haowei Li, Zhong Cao, Henry X. Liu · 2025
Read End2Race: Efficient End-to-End Imitation Learning for Real-Time F1Tenth Racing by Zhijie Qiao, Haowei Li, Zhong Cao, Henry X. Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-16894.txt.
Introduction
Zhijie Qiao, Haowei Li, Zhong Cao, and Henry X. Liu train a small race car to drive itself in a 2025 paper. The F1Tenth platform is a tenth-scale car used in classes and contests worldwide. Their method learns driving end to end by copying human drivers. No separate planning stack sits in between.
Results beat prior learning methods by a clear margin. Rule-based baselines also fell behind. Code is shared in a public repository. End-to-end learning on a cheap platform lets students test autonomy ideas safely. Lessons from the track can feed into full-size vehicle research, where testing errors cost far more.
Catalog record
| CREATOR | Zhijie Qiao, Haowei Li, Zhong Cao, Henry X. Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-16894
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
End2Race: Efficient End-to-End Imitation Learning for Real-Time F1Tenth Racing Zhijie Qiao, Haowei Li, Zhong Cao, Henry X. Liu Abstract F1Tenth is a widely adopted reduced-scale platform for developing and testing autonomous racing algorithms, hosting annual competitions worldwide. With high operating speeds, dynamic environments, and head-to-head interactions, autonomous racing requires algorithms that diverge from those in classical autonomous driving. Training such algorithms is particularly challenging: the need for rapid decision-making at high speeds severely limits model capacity. To address this, we propose End2Race , a novel end-to-end imitation learning algorithm designed for head-to-head autonomous racing. End2Race leverages a Gated Recurrent Unit (GRU) architecture to capture continuous temporal dependencies, enabling both short-term responsiveness and long-term strategic planning. We also adopt a sigmoid-based normalization function that transforms raw LiDAR scans into spatial pressure tokens, facilitating effective model training and convergence. The algorithm is extremely efficient, achieving an inference time of less than 0.5 milliseconds on a consumer-class GPU. Experiments in the F1Tenth simulator demonstrate that End2Race achieves a 94.2% safety rate across 2,400 overtaking scenarios, each with an 8-second time limit, and successfully completes overtakes in 59.2% of cases. This surpasses previous methods and establishes ours as a leading solution for the F1Tenth racing testbed. Code is available at https://github.com/michigan-traffic-lab/End2Race. I Introduction Autonomous racing has emerged as a compelling testbed for advancing autonomous vehicle technologies. One notable example is F1Tenth [ 1 ] —a widely adopted 1/10-scale racing car that offers a simplified, accessible platform supporting both university courses and practical research. Annual head-to-head competitions held worldwide further promote community collaboration and innovation. Enhancing algorithmic capabilities in this domain is therefore of interest for advancing autonomous driving technologies broadly, particularly in high-speed and interactive environments. Current racing methods in F1Tenth are generally grouped into three types: map-based, reactive, and learning-based, with each category reflecting distinct trade-offs among global optimality, computational cost, and adaptability [ 2 ] . Map-based strategies typically start with Simultaneous Localization and Mapping (SLAM) [ 3 ] to build a representation of the environment, followed by trajectory optimization techniques to generate a globally optimal raceline [ 4 ] . Execution is accomplished using a lattice planner [ 5 ] to generate a set of feasible paths, followed by a Pure Pursuit controller [ 6 ] . While these methods offer strong performance, they require heavy preprocessing and highly accurate sensor input for real-time scan matching and localization. Fig. 1: Simple overtake scenario illustration. Reactive methods avoid map construction and act directly on sensor data. The Follow-the-Gap method [ 7 ] , for instance, identifies the largest free space and steers toward its midpoint. While computationally lightweight and straightforward to implement, this approach often lacks consistency and can lead to unstable maneuvers. Learning-based methods have been widely explored over the years, with reinforcement learning (RL) and imitation learning (IL) being the most commonly adopted. However, the majority of work remains confined to single-agent settings, limiting their use in head-to-head racing . Few studies have investigated head-to-head racing scenarios, but achieved limited success (Table I ), leaving an open field for learning-based approaches within the F1Tenth domain. Overtaking is one of the most challenging tasks in head-to-head, high-speed autonomous racing, as it depends on a sequence of informed decisions and precise maneuvers. We illustrate a simple scenario in Fig. 1 . The process begins with the ego vehicle identifying a suitable opening ahead, which is rare given the close spacing and high speed of both vehicles. Once an opportunity appears, the ego must quickly change lanes to align with the gap, a maneuver that increases the risk of losing control from sharp steering. Next, the vehicle must accelerate rapidly to pass the opponent. The overtaking itself is particularly risky, as both vehicles travel side by side for an extended period with minimal space between them and the track boundaries. After successfully passing the opponent, the ego must return to the center as quickly as possible to avoid potential collision with the track. The entire process is typically completed within just 3 to 6 seconds. TABLE I: F1Tenth End-to-End Learning Methods Comparison Reference Method Single-Agent Complete 10 Laps Head-to-Head Overtake Collision Sun et al. (2022) [ 8 ] IL ✓ ✗ ✗ No head-to-head Brunnbauer et al. (2022) [ 9 ] RL ✓ ✗ ✗ No head-to-head Dwivedi et al. (2022) [ 10 ] RL ✓ ✗ ✗ No head-to-head Trumpp et al. (2023) [ 11 ] RL ✓ ✓ ✗ No head-to-head Evans et al. (2023) [ 12 ] RL ✓ ✓ ✗ No head-to-head Sun et al. (2024) [ 13 ] IL ✓ ✓ ✓ 21.2% End2Race (ours) IL ✓ ✓ ✓ 5.8% Successfully executing such a task requires rapid sensing and decision making, typically at update rates of 50–100Hz, with zero tolerance for delay. This, in turn, imposes strict constraints on model complexity and capacity. Moreover, the 1/10th-scale F1Tenth platform faces severe power and size limitations, as it typically relies on embedded hardware such as the NVIDIA Jetson NX [ 14 ] , which are far less capable than datacenter GPUs like the H100 [ 15 ] . As a result, deploying large-scale models, including transformer-based [ 16 ] architectures or vision-language models (VLMs) [ 17 ] , is practically infeasible. To address the limitations of existing learning paradigms, particularly for head-to-head autonomous racing scenarios, we introduce End2Race , a novel end-to-end imitation learning algorithm. End2Race is extremely lightweight and efficient, achieving an inference time of less than 0.5 milliseconds on a consumer-class GPU, which is more than sufficient for the update frequency of real-time, high-speed autonomous racing. Rather than storing extended sequences of past observations, which would impose excessive processing delays, our approach employs a Gated Recurrent Unit (GRU) architecture [ 18 ] to maintain a compact hidden state, updated continuously with new observations. This design efficiently captures temporal dependencies between the ego vehicle and its opponent, enabling both short-term responsiveness and long-term strategic planning. In addition, we adopt a sigmoid-based normalization function that transforms raw LiDAR scans into a latent representation as spatial pressure tokens, which naturally aligns with human cognition and facilitates effective model training and convergence. The model is trained on a single Austin track and evaluated on three previously unseen tracks (Fig. 2 ) in the F1Tenth Simulator [ 19 ] . These tracks are intentionally selected to reflect the challenging conditions of autonomous racing, featuring narrow corridors, sharp turns, and continuous sweeping curves. In the single-vehicle setting, our model demonstrates safe and efficient navigation across all tracks. From 2,400 overtaking scenarios, each with an 8-second time limit, the model achieves a 94.2% safety rate, overtakes successfully in 59.2% of cases, and reliably transitions to car-following maneuvers when overtaking is not feasible. In addition, the model demonstrates strong robustness to sensor noise, which is essential for reliable operation in real-world autonomous racing applications. The main contributions of this work are as follows: 1. We propose an end-to-end imitation learning algorithm that achieves safe navigation in single-agent settings and effective overtaking during head-to-head racing. 2. Our model demonstrates strong robustness to sensor noise, which is essential for reliable operation in real-world autonomous racing applications. 3. We develop an automated workflow to generate diverse overtaking scenarios for