Towards Selection and Transition Between Behavior-Based Neural Networks for Automated Driving Conference: CSAI; December 2024; Beijing, China
Iqra Aslam, Igor Anpilogov, Andreas Rausch · 2024
Read Towards Selection and Transition Between Behavior-Based Neural Networks for Automated Driving Conference: CSAI; December 2024; Beijing, China by Iqra Aslam, Igor Anpilogov, Andreas Rausch (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-16764.txt.
Introduction
Iqra Aslam, Igor Anpilogov, and Andreas Rausch present a driving system built from small networks in a 2024 conference paper. Self-driving cars often rely on one huge neural network that handles everything. Such systems work well but are hard to train and hard to understand, which raises safety worries.
Their design uses a selector that picks among small specialist networks, one for each behaviour such as following a lane or turning. The selector switches in real time and smooths the change between behaviours, taking speed and heading into account. Tests in a driving simulator showed the system worked as intended. The authors argue that small, named parts are easier to check and trust than one opaque whole.
Catalog record
| CREATOR | Iqra Aslam, Igor Anpilogov, Andreas Rausch |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-16764
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Selection and Transition Between Behavior-Based Neural Networks for Automated Driving Conference: CSAI; December 2024; Beijing, China Iqra Aslam, Igor Anpilogov, Andreas Rausch Abstract . Autonomous driving technology is progressing rapidly, largely due to complex End-To-End systems based on deep neural networks. While these systems are effective, their complexity can make it difficult to understand their behavior, which raises safety concerns. This paper presents a new solution: a Behavior Selector that uses multiple smaller artificial neural networks (ANNs) to manage different driving tasks, such as lane following and turning. Rather than relying on a single large network, which can be burdensome, require extensive training data and is hard to understand. The developed approach allows the system to dynamically select the appropriate neural network for each specific behaviour (i.e. turns) in real time. We focus on ensuring smooth transitions between behaviors and taking into account the vehicle’s current speed and orientation to improve stability and safety. The proposed system has been tested using the AirSim simulation environment, demonstrating its effectiveness. 1. Introduction The field of autonomous driving is undergoing a stage of rapid advancements. There are a vast number of approaches explored to develop the most effective system for controlling vehicles without human intervention. The primary goal is to navigate the vehicle from its current position to a specified target location autonomously. There are two main approaches to achieving this: the classical modular pipeline approach and the End-to-End (E2E) learning approach ( Tampuu et al. 2020 ) . The modular pipeline breaks down the autonomous driving task into sub-tasks such as perception, planning, and control ( Aslam et al. 2024b ) . In contrast, the E2E approach replaces the entire pipeline with a single, large artificial neural network (ANN) that learns to map raw sensor data directly to vehicle control signals. While the E2E approach has shown promise, especially with the development of efficient ANNs, one of the biggest breakthroughs is the creation of efficient ANN. It required vast amounts of training data and time to train a good network that could handle all driving maneuvers (e.g., lane following, turning, stopping) ( Chen et al. 2024 ) . Moreover, these networks can be difficult to interpret and may behave unpredictably in unforeseen situations. To mitigate these issues, one solution is to use multiple smaller ANNs, each responsible for a specific driving behavior (e.g., lane following) rather than relying on a single network for the entire driving task. This approach requires less training data, simplifies the network, and makes training faster and easier to validate. For instance, a network dedicated solely to lane following does not need to be trained and validated on data that includes all driving behaviors, instead just use lane-following data. However, managing multiple ANNs introduce new challenges: (1) only one network can control the vehicle at any given time, necessitating an arbiter or Behavior Selector (BS) to activate the appropriate driving behavior. (2) Ensuring smooth switching between different driving behaviors requires additional mechanisms. (a) the current selected behavior then should correct the state (e.g., speed and orientation to be needed for the next driving sequence) of the vehicle in such a way that the next behavior can operate. For example, consider the switch between the Follow Lane behavior and the Turn Left behavior. Turn Left behavior is operating at low speed, while Follow Lane is operating at high speed. If the vehicle accelerates too high quickly while following a lane, it may not be able to safely execute a sharp turn as trained (b)additionally, if the vehicle’s orientation is misaligned with the lane at the time of switching. Since the switch occurs at a semi-random position on the road, the previous driving function may not have completed its maneuver, leaving the vehicle misaligned with the lane, it may deviate from the intended path. This could be problematic, as the training data typically assumes the vehicle is parallel to the lane. This aligns with the “ Garbage In, Garbage Out " principle ( Witten and Frank 2002 ) : if the vehicle’s state doesn’t match the training conditions, the behavior will be incorrect. This issue underscores the importance of aligning the vehicle’s state with the training data to prevent suboptimal performance. This paper investigates solutions for integrating a behavior-based approach with neural network-driven systems. It aims to identify methods by which the Behavior Selector can effectively select and transition between E2E behaviors based on the route planner’s driving commands while addressing the challenges outlined. The rest of this paper is organized as follows: Section II provides an overview of related work in E2E driving and behavior selectors, focusing on both robotics and automotive applications. Section III presents the system architecture and different conceptual approaches for the behavior selector. In Section IV, Evaluation and discussion of the results are presented. Section V concludes the paper by summarizing its contributions and suggesting potential directions for future research. 2. Related Work The concept of creating autonomous driving vehicles using ANNs was first introduced by D. A. Pomerleau in 1990 ( Pomerleau 1988 ) . The ANNs take a large amount of training data as well as computational power. Despite having these disadvantages, the neural network approach proved to be the most effective at mimicking the driving behavior of a human driver. However, given the complexity of driving, it’s impractical to train a single network to handle all possible scenarios. This led to the development of behavior-specific E2E models, where individual distinct networks tackle specific tasks. It can be described as a multi-state system or as “ state of a system " or “ system behavior ", a concept explored in 1971 ( Ackoff 1971 ) which viewed complex systems as collections of distinct operational states. Building on this, ( Murchland 1975 ) J.D. Murchland, contributed to understanding how systems switch between behaviours, particularly focusing on reliability. Murchland’s work is particularly relevant when considering the design and evaluation of autonomous driving systems that rely on multiple behavioral states to manage complex driving tasks. While his focus was on the reliability aspects of these transitions, lacking the real-time operation of autonomous vehicles. As the field evolved, the need for a control mechanism to switch between different behaviors in a multi-state system became apparent. In 1986, R. A. Brooks ( Brooks 1986 ) laid the foundation for these control systems in robotics, particularly with the use of state machine-based mechanisms for task-achieving behaviors. As such, the decomposition of a mobile robot control system based on task-achieving behaviors greatly influenced the design of behavior selectors, which manage the transition between different driving behaviors in autonomous systems. Later in 1997 ( Rosenblatt 1997 ) J.K. Rosenblatt applied the ideas of DAMN (Distributed Architecture for Mobile Navigation) to autonomous vehicles and robotics, that focused on task-oriented behaviors, i.e. using an arbiter to switch between different navigational patterns like obstacle avoidance, goal-seeking, and path-following. The DAMN architecture utilized an arbiter to manage and prioritize these behaviors, allowing the system to make real-time decisions by blending the outputs of various behaviors through a voting mechanism. However, the behaviors were more generalized and focused on fundamental navigational tasks rather than specific driving maneuvers like turning left, turning right, or lane following,