Evaluating Scenario-based Decision-making for Interactive Autonomous Driving Using Rational Criteria: A Survey

Zhen Tian †, Zhihao Lin †, Dezong Zhao ⋆, Wenjing Zhao, David Flynn, Shuja Ansari, Chongfeng Wei · 2025

Read Evaluating Scenario-based Decision-making for Interactive Autonomous Driving Using Rational Criteria: A Survey by Zhen Tian †, Zhihao Lin †, Dezong Zhao ⋆, Wenjing Zhao, David Flynn, Shuja Ansari, Chongfeng Wei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01886.txt.

Introduction

Zhen Tian and co-authors surveyed in 2025 how self-driving cars learn to negotiate with other road users. Interactive driving — merging, yielding, and threading through intersections — is where autonomy is hardest. Deep reward-based learning has become the favored method there. Vehicles can learn self-tuning plans from experience instead of frozen rules. But methods tuned for a highway merge may fail at an unprotected turn, and the literature lacked a review that judged these methods across cases by steady, rational rules.

The survey organizes the field case by case, weighing how varied learning methods are tested for safety, efficiency. And contact quality in each setting. Its aim is useful: to show builders which testing lenses expose a method's real strengths and blind spots. And thereby to guide the design of choice-making systems that can earn large-scale deployment on public roads.

Catalog record

CREATORZhen Tian †, Zhihao Lin †, Dezong Zhao ⋆, Wenjing Zhao, David Flynn, Shuja Ansari, Chongfeng Wei
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-01886

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evaluating Scenario-based Decision-making for Interactive Autonomous Driving Using Rational Criteria: A Survey Zhen Tian †, Zhihao Lin †, Dezong Zhao ⋆, Wenjing Zhao, David Flynn, Shuja Ansari, Chongfeng Wei Abstract Autonomous vehicles (AVs) can significantly promote the advances in road transport mobility in terms of safety, reliability, and decarbonization. However, ensuring safety and efficiency in interactive during within dynamic and diverse environments is still a primary barrier to large-scale AV adoption. In recent years, deep reinforcement learning (DRL) has emerged as an advanced AI-based approach, enabling AVs to learn decision-making strategies adaptively from data and interactions. DRL strategies are better suited than traditional rule-based methods for handling complex, dynamic, and unpredictable driving environments due to their adaptivity. However, varying driving scenarios present distinct challenges, such as avoiding obstacles on highways and reaching specific exits at intersections, requiring different scenario-specific decision-making algorithms. Many DRL algorithms have been proposed in interactive decision-making. However, a rationale review of these DRL algorithms across various scenarios is lacking. Therefore, a comprehensive evaluation is essential to assess these algorithms from multiple perspectives, including those of vehicle users and vehicle manufacturers. This survey reviews the application of DRL algorithms in autonomous driving across typical scenarios, summarizing road features and recent advancements. The scenarios include highways, on-ramp merging, roundabouts, and unsignalized intersections. Furthermore, DRL-based algorithms are evaluated based on five rationale criteria: driving safety, driving efficiency, training efficiency, unselfishness, and interpretability (DDTUI). Each criterion of DDTUI is specifically analyzed in relation to the reviewed algorithms. Finally, the challenges for future DRL-based decision-making algorithms are summarized. I INTRODUCTION AUTONOMOUS vehicles (AVs) face significant challenges in making reliable decisions when interacting with human-driven vehicles (HDVs). This challenge is primarily due to the difficulty of accurately predicting the intentions of HDVs. Road traffic crashes cause significant fatalities and serious injuries, reflecting the global issue of millions of lives lost annually [ 1 ] . Since 2021, over 900 Tesla crashes involving driver-assistance systems have been reported [ 2 ] . Despite unresolved safety issues, the number of AVs is projected to surpass 50 million by 2024 [ 3 ] . These statistics underscore the critical need for improving safety in autonomous driving. With a safe decision-making system, AVs have the potential to significantly decrease road crashes caused by human errors such as fatigue, distraction, and delayed reactions [ 4 ] . Moreover, AVs are capable of making optimal decisions faster than human drivers, thereby enhancing traffic efficiency [ 5 ] . Fig. 1: Autonomous driving in different scenarios. Fig. 2: Rear-end accident conditions between ADS and HDV: (a) Rear-end accidents that HDV hit an ADS from behind with a sample of 252; (b) Rear-end accidents that ADS hit an HDV from behind with a sample of 67 [16]. There are several typical driving scenarios, such as highways, roundabouts, on-ramping merging, and unsignalized intersections, each characterized by distinct road features and scenario-specific requirements. Autonomous driving in such scenarios is depicted in Fig. 1. For example, on-ramp merging involves completing lane changes well in advance of any obstructed roadway, while navigating a roundabout requires seamlessly exiting at the intended point. Achieving these scenario-based requirements relies heavily on precise and timely operational decision-making in real time. Operational decision support for AV driving includes perception, planning, and control modules. The perception module consists of onboard sensors that continuously perceive the surrounding environment. The perceived data is processed through perception algorithms, such as YOLO methods [ 6 , 7 ] . The planning module handles driving tasks based on scenario recognition. Subsequently, the motion planner generates discrete decisions and converts them into feasible trajectories. These feasible trajectories are then transmitted to the control module to generate control commands, which are sent to the vehicle’s actuators. The actuators, including the steering wheel and pedals, receive and execute the control commands to drive the vehicle. The interactions between AVs and HDVs are complex and therefore continuous decision-making is required, such as lane changes or braking [ 8 ] . The model-based, simple guidance, and learning-based methods are commonly used in interactive driving with HDVs. There are mainly four types of model-based approaches. The first model-based approach aims to predict the intentions or trajectories of HDVs, but heavily relies on rule-based classification. For example, [ 9 ] predicts the trajectories of HDVs within a fixed time window. However, the time required for a lane-changing maneuver may exceed this fixed time window. The second model-based approach is to make decisions using robust control methods, such as the min-max model predictive control [ 10 ] . However, robust control methods make excessively cautious decisions based on a worst-case scenario assumption [ 11 ] . These methods are not suitable for most real traffic environments because worst-case scenarios are rare in real-world settings. Furthermore, decisions made for worst-case scenarios negatively impact driving quality, such as resulting in slower driving speeds. On the other hand, the game theory, the third model-based approach, has gained popularity recently. Game theory includes cooperative and non-cooperative games, both relying on equilibrium models. However, these models fail to capture the complexities of real-world driving, which are characterized by uncertainties and do not adhere to a regular equilibrium framework. Therefore, model-based methods are unable to handle interactive driving with HDVs effectively. Additionally, the fourth model-based approach, including collision-avoidance methods [ 12 ] and Voronoi diagram-based methods [ 13 ] , is unable to safely respond to movable objects. Real-world collisions between HDVs and vehicles equipped with advanced driving system (ADS) assistance are summarized in [ 14 ] . As illustrated in Fig. 2, 79\penalty\ \% of accidents involve HDVs hitting AVs, and 21\penalty\ \% of that involve AVs hitting HDVs. Therefore, achieving collision-free interactions with HDVs are still to be addressed. Compared to the aforementioned methods, simple guidance methods, such as risk-quantified fields, are widely used because they do not need to predict HDVs’ intentions or make excessively cautious decisions [ 15 ] . The artificial potential field (APF) is a typical example, which can guide the AV to the target lane without collisions by utilizing attractive and repulsive force fields [ 16 ] . However, APF assumes that all areas around the vehicle have the same level of risk because it calculates risks toward the central point. This assumption differs from reality, where the front of a car faces more danger than other parts. Additionally, APF is difficult to generalize across different scenarios without prior knowledge of the entire environment [ 17 ] . To promote collision-free interactions, a large number of interactions are needed to exclude risky actions, taking into account the uncertainties in decision-making and the varying driving conditions of HDVs. Learning-based methods facilitate the exploration of control strategies by allowing full interaction with the mixed-traffic environment. These methods enable AVs to learn and adapt to complex driving scenarios through iterative interactions and feedback. Machine learning (ML) [ 18 , 19 ] focuses on developing algorithms to make decisions based on data, including supervised, unsupervised, and reinforcement learning. Supervised learning trains models on labeled data, supporting tasks like classification [ 20 , 21 ] . However, supervised learning is less suited for implementation in real driving environments, as labeling complex driving scenarios exhaustively is challenging and

Read the complete text