Approaching Current Challenges in Developing a Software Stack for Fully Autonomous Driving

Simon Sagmeister, Simon Hoffmann, Tobias Betz, Dominic Ebner, Daniel Esser, Markus Lienkamp · 2025

Read Approaching Current Challenges in Developing a Software Stack for Fully Autonomous Driving by Simon Sagmeister, Simon Hoffmann, Tobias Betz, Dominic Ebner, Daniel Esser, Markus Lienkamp (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-12813.txt.

Introduction

Simon Sagmeister and five co-authors draw lessons from building a full self-driving software stack in a paper from 2025. Research teams usually build and publish each driving module on its own. Stitching those parts back into one stack that runs on a real car brings its own set of snags, apart from the flaws of any single algorithm.

The authors base their account on the TUM Autonomous Motorsport team's race car work. They sort the snags they met when deploying research code on real test vehicles and give strategies that worked for them. Open-source code on GitHub lets other teams reuse the fixes and judge full stacks more fairly.

Catalog record

CREATORSimon Sagmeister, Simon Hoffmann, Tobias Betz, Dominic Ebner, Daniel Esser, Markus Lienkamp
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-12813

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Approaching Current Challenges in Developing a Software Stack for Fully Autonomous Driving Simon Sagmeister, Simon Hoffmann, Tobias Betz, Dominic Ebner, Daniel Esser, Markus Lienkamp Abstract Autonomous driving is a complex undertaking. A common approach is to break down the driving task into individual subtasks through modularization. These sub-modules are usually developed and published separately. However, if these individually developed algorithms have to be combined again to form a full-stack autonomous driving software, this poses particular challenges. Drawing upon our practical experience in developing the software of TUM Autonomous Motorsport, we have identified and derived these challenges in developing an autonomous driving software stack within a scientific environment. We do not focus on the specific challenges of individual algorithms but on the general difficulties that arise when deploying research algorithms on real-world test vehicles. To overcome these challenges, we introduce strategies that have been effective in our development approach. We additionally provide open-source implementations that enable these concepts on GitHub. As a result, this paper’s contributions will simplify future full-stack autonomous driving projects, which are essential for a thorough evaluation of the individual algorithms. ©2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. I Introduction Autonomous driving is a rapidly growing research field with a continuously increasing number of publications [ 1 ] . However, only a few algorithms and approaches have been deployed in real-world applications. A recent review paper [ 2 ] shows that out of 111 publications in the area of motion planning and vehicle control, only 44\text{\,}\mathrm{\%} have been deployed in an autonomous driving software stack. However, standalone testing of individual modules is insufficient for a modular approach, as the performance of each module is interdependent with other modules in the software stack [ 3 ] . Considering real-world experiments, Betz et al. [ 2 ] show that only 15\text{\,}\mathrm{\%} out of these 111 racing-focused publications have been evaluated on a full-scale vehicle. Comparing different algorithms becomes more challenging in the absence of real-world validation, as assessing an algorithm’s performance is difficult without an actual test vehicle, particularly for certain types of algorithms [ 3 ] . We obtained these numbers from publications on autonomous racing. We do not know the exact numbers for publications on autonomous driving in general. However, autonomous racing often takes place in competitions involving a real test vehicle, therefore potentially inflating the percentage of deployed algorithms compared to autonomous driving on public roads. Fig. 1: The EAV24 racing vehicle of TUM Autonomous Motorsport used during the Abu Dhabi Autonomous Racing League. It is based on Dallara’s SF23 Super Formula Chassis and contains an autonomous driving hardware stack in the space usually occupied by the driver. Our institute has gained a lot of experience with autonomous driving projects over the last few years. Starting with the Roborace competition in 2018 [ 4 ] , we developed software capable of autonomous head-to-head racing. Since then, we have gradually improved our software stack, with up to 30 people working on the stack in parallel. This enabled us to win the inaugural races of the Indy Autonomous Challenge (IAC) [ 5 ] and the Abu Dhabi Autonomous Racing League (A2RL) [ 6 ] . Fig. 1 shows one of our research vehicles: the EAV24 race car we used to compete in A2RL. Additionally, we designed and built a research vehicle called EDGAR, which is tailored to autonomous driving research on public roads [ 7 ] . This has provided us with valuable insights into evaluating various algorithms across different test vehicles. While we have shared our general approach in previous publications [ 4 , 8 ] , we want to share our insights on combining individual research algorithms into a complete software stack with this work. We derive these insights from practical experience, continuously developing and deploying new research algorithms on vehicles in different racing competitions. We aim to bridge the gap between research and real-world application by making the following contributions: • Identifying current challenges in developing, maintaining, and deploying autonomous driving software. • Introducing concepts to overcome these challenges. • Validating these concepts using real-world data. • Providing open-source software to implement these concepts at https://github.com/TUMFTM/TAM__common . II Related Work The Darpa Urban Challenge, held in 2007, is considered a milestone in autonomous driving [ 9 ] . From this, various participants presented their approach to developing an autonomous driving software stack [ 10 , 11 , 12 ] . However, these publications did not use the Robot Operating System (ROS) 2, now a de facto standard in autonomous driving research [ 13 ] . That makes their approaches less applicable in modern software environments. Today, autonomous racing series offer a comparable challenge to the capabilities of current algorithms. The most prominent are IAC, A2RL, F1TENTH, and Formula Student Driverless (FSD) [ 2 ] . Teams competing in these series often publish their approaches in scientific papers, mainly focusing on algorithmic challenges [ 8 , 14 , 15 , 16 , 17 , 18 , 19 , 3 ] . On the contrary, Sauerbeck et al. [ 20 ] focus on lessons learned while applying perception systems in high-speed autonomous racing. The paper contains algorithmic challenges and best practices in efficient testing and development. However, they focus solely on perception systems instead of considering challenges in a full-stack autonomous driving system. Similarly, Ögretmen et al. [ 21 ] focus only on the planning module and its interdependency with the regulations of their racing series. In [ 22 , 23 ] , the authors describe software components using a tailored architecture modeling language. However, their approach was not evaluated with a system as complex as a full autonomous driving software stack. Reke et al. [ 13 ] derived a ROS 2 based software architecture for autonomous driving on public roads. Their main focus was modularity and real-time capability. However, they did their evaluation only on a single test vehicle. Additionally, they did not implement all parts of the proposed architecture before evaluation. Therefore, they could not identify the long-term challenges and disadvantages of their approach. The open-source project Autoware [ 24 , 25 ] provides full-stack autonomous driving software. Autoware has already been deployed in multiple different, even embedded, applications. However, no distinct publications focus on the challenges of using and developing research algorithms with Autoware. Instead, the annual Autoware Challenges call for solutions to current, predominantly algorithmic problems within the Autoware stack [ 26 ] . Nevertheless, these are just open challenges not addressed by publications so far. Similarly, Betz et al. [ 2 ] identify open challenges in autonomous racing without presenting mitigation strategies. In summary, the current state of the art focuses mainly on algorithmic challenges and their influence on software architecture. No publications to date have identified the current challenges of developing and deploying a complete software stack while also presenting validated solutions to address them within a scientific environment. III Challenges

Read the complete text