Learning to Drive Ethically: Moral Reasoning in Autonomous Driving
Dianzhao Li 1,2 Ostap Okhrin 1,2 1 Chair of Econometrics and Statistics, esp. in the Transport Sector, Technische Universität Dresden Dresden, Germany 2 Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI) Dresden/Leipzig, Germany. {dianzhao.li, ostap.okhrin}@tu-dresden.de · 2025
Read Learning to Drive Ethically: Moral Reasoning in Autonomous Driving by Dianzhao Li 1,2 Ostap Okhrin 1,2 1 Chair of Econometrics and Statistics, esp. in the Transport Sector, Technische Universität Dresden Dresden, Germany 2 Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI) Dresden/Leipzig, Germany. {dianzhao.li, ostap.okhrin}@tu-dresden.de (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-14926.txt.
Introduction
Dianzhao Li and Ostap Okhrin present a self-driving system that weighs harm to others as it learns to drive, in a 2025 paper. Their setup adds an ethics-aware cost to the usual driving goals. The cost blends the chance of a crash with how bad the harm would be, with care for people on foot and on bikes.
The system works in two layers. A learning agent picks high-level motion targets, and gives extra weight to rare, high-risk events so it learns from them. Standard path planning and control tools then turn the targets into smooth paths. In closed-loop tests built from real traffic data, the system cut risk to others while keeping its own driving smooth and steady.
Catalog record
| CREATOR | Dianzhao Li 1,2 Ostap Okhrin 1,2 1 Chair of Econometrics and Statistics, esp. in the Transport Sector, Technische Universität Dresden Dresden, Germany 2 Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI) Dresden/Leipzig, Germany. {dianzhao.li, ostap.okhrin}@tu-dresden.de |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-14926
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning to Drive Ethically: Moral Reasoning in Autonomous Driving Dianzhao Li 1,2 Ostap Okhrin 1,2 1 Chair of Econometrics and Statistics, esp. in the Transport Sector, Technische Universität Dresden Dresden, Germany 2 Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI) Dresden/Leipzig, Germany. {dianzhao.li, ostap.okhrin}@tu-dresden.de Abstract Autonomous vehicles hold great promise for reducing traffic fatalities and improving transportation efficiency, yet their widespread adoption hinges on embedding robust ethical reasoning into routine and emergency maneuvers, particularly to protect vulnerable road users (VRUs) such as pedestrians and cyclists. Here, we present a hierarchical Safe Reinforcement Learning (Safe RL) framework that explicitly integrates moral considerations with standard driving objectives. At the decision level, a Safe RL agent is trained using a composite ethical risk cost, combining collision probability and harm severity, to generate high - level motion targets. A dynamic Prioritized Experience Replay mechanism amplifies learning from rare but critical, high - risk events. At the execution level, polynomial path planning coupled with Proportional–Integral–Derivative (PID) and Stanley controllers translates these targets into smooth, feasible trajectories, ensuring both accuracy and comfort. We train and validate our approach on rich, real - world traffic datasets encompassing diverse vehicles, cyclists, and pedestrians, and demonstrate that it outperforms baseline methods in reducing ethical risk and maintaining driving performance. To our knowledge, this is the first study of ethical decision-making for autonomous vehicles via Safe RL evaluated on real-world, human-mixed traffic scenarios. Our results highlight the potential of combining formal control theory and data-driven learning to advance ethically accountable autonomy that explicitly protects those most at risk in urban traffic environments. 1 Introduction Over the past several decades, both academic institutions and industry stakeholders have devoted significant effort to advancing autonomous driving (AD) technologies. By eliminating human error, autonomous vehicles (AVs) promise to reduce traffic accidents and enhance both social welfare and economic productivity. While fully functional Level 5 systems, with completely autonomous vehicles available on the mass market, are expected to emerge in the coming decades [ 1 ] , the transitional period will involve extensive interaction between AVs and human-driven vehicles. This raises a pressing societal question: Can AVs make responsible decisions in emergencies and everyday interactions, not only to protect their occupants but also to protect those outside the vehicle [ 2 ] ? This question is especially urgent for vulnerable road users (VRUs) such as pedestrians and cyclists, who bear a disproportionately high burden of severe injury and death in collisions. According to the U.S. National Highway Traffic Safety Administration, 7,522 pedestrians were killed and more than 67,000 injured in 2022 [ 3 ] . Safeguarding VRUs should therefore be a primary objective of technical design, regulation, and public policy [ 4 ] . Beyond emergency responses, broader ethical and policy concerns have also emerged, including legal liability, data privacy, and equitable access to mobility solutions [ 5 , 6 , 7 ] . Early public and academic debates often focused on abstract dilemmas such as the “trolley problem”, how an AV should react when a collision is unavoidable. Empirical work such as the Moral Machine Experiment has demonstrated that ethical preferences vary widely across cultures, for example, favoring younger over older pedestrians or humans over animals [ 8 ] . However, emphasizing these rare, extreme scenarios risks obscuring the everyday ethical decisions AVs must make, such as maintaining safe following distances, navigating busy intersections, and yielding to pedestrians, which cumulatively determine public safety and perceived fairness in urban environments [ 9 ] . Recent research on embedding ethical reasoning into autonomous vehicles has increasingly combined formal control techniques with data-driven learning to develop hybrid ethical decision-making systems. For example, in [ 10 ] , a lexicographic risk-minimization framework is presented that ranks road users by priority and optimizes vehicle trajectories to reduce collision risk in descending order of that ranking. Similarly, [ 11 ] proposes an ethical trajectory planning approach in which candidate paths are evaluated using a set of ethics metrics, total risk minimization, worst-off protection, equal treatment, liability-based responsibility, and bounded personal risk, and weighted according to regional guidelines. These control-theoretic methods leverage well-established optimization tools and offer verifiable safety guarantees. However, they often require careful parameter tuning and rely on pre-defined policies. Meanwhile, RL has gained traction as a promising approach for autonomous driving [ 12 , 13 ] , thanks to its success in solving complex problems in domains such as game strategy and robotics control [ 14 , 15 , 16 , 17 ] . Although many RL studies incorporate safety as a primary design principle by embedding safety constraints into reward functions, explicit ethical reasoning remains largely absent. To address this gap, autonomous vehicles should be capable of more than just reactive ethical choices in rare, high-risk situations. They should also anticipate ethical concerns in everyday scenarios to prevent crises before they emerge. This requires three key capabilities: (i) the ability to anticipate the intentions of surrounding traffic participants; (ii) the capacity to make moral decisions involving multiple agents; and (iii) consideration of broader driving objectives such as safety and efficiency. To that end, we propose EthicAR, an ethical AD agent built upon the principles of Safe RL. EthicAR separates the objectives of AV into two components: standard driving goals (e.g., safety and efficiency) and moral reasoning across surrounding traffic participants. This structure allows the vehicle to make ethically informed decisions, particularly in the face of potential collisions. The framework is organized into two hierarchical levels: a decision level and an execution level . The decision level does not directly control the vehicle, instead, it determines how and where the vehicle should move, producing a target lateral position and target longitudinal speed. It is implemented using a Safe RL algorithm that incorporates ethical risk as a cost signal, following the formulation introduced in [ 11 ] . The risk metric combines two factors: (i) the probability of collision involving either the ego vehicle or other road users, and (ii) the severity of harm associated with those collisions. Because high-risk situations are rare in naturalistic driving data, we introduce a dynamic Prioritized Experience Replay (PER) mechanism. This strategy emphasizes learning from high-risk experiences, thereby enhancing the ability to learn from rare but critical situations. The execution level translates high-level decisions into physical motion. It includes a path planner that generates smooth, feasible trajectories using polynomial equations. A low-level path follower then executes these trajectories using a PID controller for longitudinal speed and a Stanley controller for lateral position tracking [ 18 ] . This setup ensures stable and comfortable vehicle behavior. To train the agent, we use real-world datasets that capture diverse traffic scenarios with various types of vehicles, pedestrians, and cyclists. These datasets provide realistic interactions, allowing the learned policy to generalize effectively to heterogeneous and dynamic environments. We evaluate EthicAR against several baselines in real-world scenarios and present a comprehensive analysis of its performance. To the best of our knowledge, this is the first study to apply Safe RL to ethical decision-making in AVs using real-world data, backed by extensive empirical validation. In summary, the main contributions of this paper are as follows: 1. Ethics-Aware Cost Function for Safe RL. We leverage a Safe RL framework