URB - Urban Routing Benchmark for RL-equipped Connected Autonomous Vehicles

Ahmet Onur Akman*, Anastasia Psarou, Michał Hoffmann, Łukasz Gorczyca, Łukasz Kowalski, Paweł Gora, Grzegorz Jamróz, Rafał Kucharski · 2025

Read URB - Urban Routing Benchmark for RL-equipped Connected Autonomous Vehicles by Ahmet Onur Akman*, Anastasia Psarou, Michał Hoffmann, Łukasz Gorczyca, Łukasz Kowalski, Paweł Gora, Grzegorz Jamróz, Rafał Kucharski (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17734.txt.

Introduction

Ahmet Onur Akman and co-authors build a test ground for self-driving cars in a 2025 paper. Connected autonomous vehicles could cut city congestion if they choose routes together. Reinforcement learning can learn such shared route plans, but fair and realistic tests for it were missing.

Their benchmark, called URB, joins 29 real traffic networks with realistic travel demand. It ships with preset tasks, learning methods, three baselines, and clear scoring rules. Results were sobering, the team reports. Even after long and costly training, leading methods rarely beat human drivers. The work sets a first public leaderboard and shows that scaling remains hard.

Catalog record

CREATORAhmet Onur Akman*, Anastasia Psarou, Michał Hoffmann, Łukasz Gorczyca, Łukasz Kowalski, Paweł Gora, Grzegorz Jamróz, Rafał Kucharski
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-17734

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

URB - Urban Routing Benchmark for RL-equipped Connected Autonomous Vehicles Ahmet Onur Akman*, Anastasia Psarou, Michał Hoffmann, Łukasz Gorczyca, Łukasz Kowalski, Paweł Gora, Grzegorz Jamróz, Rafał Kucharski Abstract Connected Autonomous Vehicles (CAVs) promise to reduce congestion in future urban networks, potentially by optimizing their routing decisions. Unlike for human drivers, these decisions can be made with collective, data-driven policies, developed by machine learning algorithms. Reinforcement learning (RL) can facilitate the development of such collective routing strategies, yet standardized and realistic benchmarks are missing. To that end, we present URB : Urban Routing Benchmark for RL-equipped Connected Autonomous Vehicles. URB is a comprehensive benchmarking environment that unifies evaluation across 29 real-world traffic networks paired with realistic demand patterns. URB comes with a catalog of predefined tasks, four state-of-the-art multi-agent RL (MARL) algorithm implementations, three baseline methods, domain-specific performance metrics, and a modular configuration scheme. Our results suggest that, despite the lengthy and costly training, state-of-the-art MARL algorithmsrarely outperformed humans. Experimental results reported in this paper initiate the first leaderboard for MARL in large-scale urban routing optimization and reveal that current approaches struggle to scale, emphasizing the urgent need for advancements in this domain. 1 Introduction Figure 1 : URB is a comprehensive benchmarking framework for MARL methods in solving CAV routing tasks in a mixed urban traffic environment. It enables end-to-end assessment through a collection of 29 real-world traffic networks, realistic demand patterns, baseline methods, domain-specific performance indicators and a flexible parameterization scheme. Recent technological ref1 and algorithmic ref2 advancements let us believe that in the foreseeable future Connected Autonomous Vehicles (CAVs) will enter our cities and start driving alongside human drivers mckinsey2023av ; wef2025av , not only successfully navigating through the traffic complexity and arriving safely at the destination, but also making independent routing decisions: which route to select to reach the destination. A possible future scenario could be as follows: In a small French town of St. Arnoult, 40% of drivers decide to switch to autonomous driving mode, delegating their routing decisions. Then, either each vehicle or the central controller will apply some algorithm to select routes to minimize travel costs . This raises a series of significant and open research questions: 1. Which algorithm is most suitable for collective urban fleet routing? 2. Does RL outperform alternative operations research (OR) or machine learning (ML) methods? If yes, how efficient can the training be, what reward formulation best captures the objective, should the solution be centralized or decentralized, how can we formulate useful observations within practical constraints? How detailed environment simulations are needed? 3. How does the problem scale with network complexity, number of agents, and planning horizon? 4. What is the impact of applying such algorithms on: the transportation system, CAVs, and non-CAV drivers? By focusing only on algorithmic goals, are we overlooking any significant aspects of CAV deployment that may be detrimental to our urban societies (increased emissions, mileage, variability, inequality, etc.)? Those questions are timely, yet open psarou2025autonomous ; jamroz2025social . Therefore, in this study, we introduce URB - a comprehensive benchmarking framework for MARL methods in solving CAV routing tasks in a mixed (CAV-human) urban traffic environment. We outline its motivation, theoretical foundation, design, and key features. We then initiate the first URB leaderboard of the four most established MARL algorithms on a representative scenario and document how each solution affects different system efficiency statistics. Finally, we discuss URB ’s practical potential and limitations, and outline the future directions we intend to pursue. The human-CAV urban routing problem is interdisciplinary and intersects traffic engineering, with detailed vehicle dynamics and traffic flow properties, transport engineering, with day-to-day route choice behavior in human daily demand patterns, and machine learning, with a discrete optimization problem on a huge action space in a non-stationary environment. URB bridges experts from the above fields, allowing them to contribute without in-depth domain expertise. In particular, thanks to SUMO SUMO2018 integration and interface of the common human route choice models and demand patterns, machine learning researchers can test their custom algorithms on realistic traffic scenarios. Likewise, transport researchers, thanks to the provided TorchRL bou_torchrl_2023 implementations, may use state-of-the-art RL algorithms and test their impact on custom traffic and travel demand scenarios. With URB we aim to trigger positive competition within the RL community to propose new algorithms, and test them on a diverse set of tasks and instances. Hopefully, URB leaderboard will eventually be dominated by efficient, scalable, reliable and socially aware solutions that, when deployed in real networks, will improve the performance of all the parties involved. URB will be gradually extended with problems that will arise in the future, when CAVs will start operating in our cities in various configurations, with candidate solutions (from within the RL community and outside) evaluated on a wide set of measures and problem instances. This is particularly timely before CAV fleets are deployed, to inform the society about potential threats and motivate vehicle developers to propose sustainable fleet operating algorithms. URB ’s codebase 1 1 1 https://github.com/COeXISTENCE-PROJECT/URB and data collection 2 2 2 https://doi.org/10.34740/kaggle/ds/7406751 are publicly available in online repositories under non-restrictive licenses, as detailed in Appendix C.1 . 1.1 Urban routing and (MA)RL - significance and challenges calling for benchmark The urban routing problem with CAVs is not only significant for future societies, but also challenging . The CAVs promise to relieve our congested networks by enabling a new class of routing behaviors, potentially making better use of scarce resources (capacity) for better global and user-level performance. This translates into minutes saved daily and hours saved annually for all commuters, and tons of fuel and \text{CO}_{2} emissions saved at the system level. Realizing this potential, however, requires solving a highly non-trivial problem. With thousands of agents (up to millions in megacities) taking simultaneous actions in large action spaces (here we sample only a few routes, while the choice set grows exponentially with network size), the environment is not only non-deterministic (due to the stochastic nature of traffic and the heterogeneity of people), but also non-stationary (as agents compete for limited resources in a game-like fashion) and costly to simulate. One environment run can take up to hours (with detailed simulators like SUMO) in real-size cities, while MARL algorithms often require millions of training episodes. At the same time, standard discrete OR techniques fail in such large action spaces mazyavkina2021reinforcement . Existing studies applied MARL to tackle the urban routing problem. In AgentRewardShaping , drivers use MARL with different rewards to minimize congestion, but consider only homogeneous agent populations and global reward; in regret_route_choice , authors proposed a regret-minimization for MARL route selection with external traffic data, and routechoiceenv used a centralized controller with a simplified macroscopic traffic simulation. Here, we build on it and extend, testing and simulating diverse scenarios and solutions in RouteRL akman2025routerl , a MARL environment integrated with a microscopic traffic simulator, SUMO. In line with the aforementioned studies, we argue that solving the urban routing problem with RL may be the most intuitive direction, as it can be naturally reframed as a decision-making task, and the optimization target can be intuitively formulated as a reward signal. The human day-to-day route-choice learning process wu_day–day_2020 naturally resembles the classical RL training loop.

Read the complete text