Hierarchical GNN-Based Multi-Agent Learning for Dynamic Queue-Jump Lane and Emergency Vehicle Corridor Formation
Haoran Su · 2026
Read Hierarchical GNN-Based Multi-Agent Learning for Dynamic Queue-Jump Lane and Emergency Vehicle Corridor Formation by Haoran Su (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04177.txt.
Introduction
Haoran Su, writing alone, designs a traffic system that clears a path for emergency vehicles in crowded streets. Normal strategies cannot keep up as conditions change by the second. Su combines graph neural networks with multi-agent reinforcement learning in a two-level design suited to streets full of connected vehicles.
A high-level planner sets the global plan, while low-level controllers carry out the driving paths. Graph attention lets the system scale as the number of vehicles changes. Trained with a multi-agent policy method, the system cuts emergency travel time sharply against baselines and far more against uncoordinated traffic in simulations. Crash rates stay near zero, ordinary traffic keeps most of its efficiency, and extra studies support robustness across scenes.
Catalog record
| CREATOR | Haoran Su |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-04177
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Hierarchical GNN-Based Multi-Agent Learning for Dynamic Queue-Jump Lane and Emergency Vehicle Corridor Formation Haoran Su Abstract Emergency vehicles (EMVs) require rapid passage through congested urban traffic to reach time-critical situations where every second matters. Existing traffic management strategies rely primarily on static infrastructure or simple rule-based heuristics that fail to adapt to dynamic traffic conditions and varying connected vehicle (CV) penetration rates. In this paper, we propose a novel hierarchical graph neural network (GNN)-based multi-agent reinforcement learning (MARL) framework to coordinate CVs for dynamic emergency corridor formation in mixed traffic environments. Our approach employs a two-level architecture: a high-level planner that determines global corridor formation strategies using graph attention networks over the vehicle interaction topology, and low-level controllers that execute individual vehicle trajectories based on local subgraph observations. The graph-based representation naturally captures spatial relationships between vehicles, enabling scalable coordination that adapts to variable numbers of agents without retraining. We formulate corridor formation as a cooperative multi-agent Markov decision process and train the system using Multi-Agent Proximal Policy Optimization (MAPPO) with curriculum learning. Extensive experiments in SUMO simulations across diverse scenarios demonstrate that our GNN-MAPPO approach reduces EMV travel time by 28.3% compared to baseline multi-agent actor-critic methods and by 44.6% compared to uncoordinated traffic. The hierarchical design maintains interpretability while achieving near-zero collision rates (0.3%) and minimal impact on background traffic efficiency (81% of normal speed). Ablation studies confirm that the graph structure contributes 16.8% performance gain, hierarchical control adds 11.2%, and attention mechanisms provide 3.6% improvement. Generalization experiments show our approach maintains 85% of in-distribution performance on unseen scenarios with higher traffic density and longer road segments, significantly outperforming baselines. Our results demonstrate the effectiveness of combining graph neural networks with hierarchical multi-agent reinforcement learning for intelligent transportation systems. I Introduction Emergency vehicles including ambulances, fire trucks, and police cars must navigate through congested urban traffic to reach time-critical situations. Statistical evidence shows that every minute of delay in emergency response correlates with significantly increased mortality rates for cardiac arrest patients and expanded property damage. However, in dense urban environments, EMVs frequently encounter severe obstacles: congested roads with limited maneuvering space, uncoordinated vehicle behavior, and inadequate infrastructure support. Traditional emergency vehicle preemption (EVP) systems rely primarily on auditory and visual signals (sirens, lights) combined with static infrastructure such as dedicated lanes or adaptive traffic signal control. These approaches have fundamental limitations: human drivers may not perceive signals in time, dedicated lanes consume valuable road capacity, and signal control only affects intersections. The emergence of connected and autonomous vehicle (CAV) technology presents transformative opportunities for emergency response. Connected vehicles (CVs) equipped with Vehicle-to-Everything (V2X) communication can receive real-time information about approaching EMVs and coordinate maneuvers through vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) links. This capability enables sophisticated coordination strategies impossible with traditional vehicles, such as synchronized lane changes and adaptive speed adjustments to form dynamic corridors (Fig. 1 ). Recent work has begun exploring multi-agent reinforcement learning (MARL) to train CVs for cooperative yielding behaviors [ 38 ] . However, existing approaches face several critical limitations: (a) Before: Congested traffic blocks EMV (b) After: Dynamic corridor formed by CVs Figure 1 : Emergency vehicle corridor formation through CV coordination. (a) Without coordination, the emergency vehicle (white ambulance) is blocked by mixed traffic consisting of human-driven vehicles (yellow) and connected vehicles (green). (b) After MARL-based coordination, CVs execute synchronized yielding maneuvers to form a clear corridor (green lane), enabling rapid EMV passage with minimal disruption to background traffic. Limited Scalability : Traditional MARL methods using fixed-size neural networks struggle when the number of agents varies between episodes. Most approaches either restrict scenarios to fixed agent counts or use inefficient padding strategies that waste computational resources and hurt generalization. Weak Spatial Coordination : Methods employing independent learning or simple parameter sharing fail to capture the complex spatial relationships inherent in traffic networks. Vehicles must coordinate based on proximity, lane adjacency, and relative positions to EMVs—relationships that feedforward networks cannot effectively model. Simple Action Spaces : Existing work typically employs binary yield/no-yield decisions or discrete acceleration levels, limiting the fine-grained control necessary for smooth, safe corridor formation. Real-world scenarios require continuous control over acceleration and lane positioning. Lack of Interpretability : End-to-end black-box policies make it difficult for traffic engineers to understand, validate, or debug coordination strategies, hindering real-world deployment and regulatory approval. Poor Generalization : Models trained on specific traffic densities and CV penetration rates often fail when deployed in different conditions, requiring expensive retraining for each new scenario. I-A Contributions To address these challenges, we propose a hierarchical graph neural network-based multi-agent reinforcement learning framework with the following key contributions: 1) Graph-Based Representation for Vehicle Networks : We model the mixed traffic environment as a dynamic directed graph where vehicles are nodes and spatial relationships (proximity, lane adjacency, EMV influence) are edges. This representation naturally captures the topology of vehicle interactions and enables graph neural networks to learn spatially-aware policies. The graph structure explicitly encodes domain knowledge about traffic physics while remaining flexible enough to learn complex coordination patterns. 2) Hierarchical Two-Level Architecture : We introduce a novel hierarchical design that decomposes the corridor formation problem into two stages: (i) a high-level planner operating on the global vehicle graph determines which CVs should yield and where to form the corridor, and (ii) low-level controllers operating on local subgraphs execute individual vehicle trajectories. This separation improves both learning efficiency (each component learns a simpler task) and interpretability (high-level strategies are explicitly represented). 3) Scalable Multi-Agent Coordination : Our approach leverages the permutation invariance and variable-size handling capabilities of GNNs to seamlessly coordinate different numbers of CVs without retraining. The graph-based policy naturally generalizes across scenarios with 6-18 vehicles, compared to baseline methods that require separate models for each configuration. 4) Comprehensive Experimental Validation : We conduct extensive experiments in SUMO simulations across diverse scenarios (varying traffic density, CV penetration rates from 0-100%, different EMV speeds) with rigorous evaluation including: • Performance comparison against multiple baselines (no control, MAAC, QMIX, flat GNN) • Detailed ablation studies quantifying the contribution of each component • Generalization tests on unseen scenarios (higher density, longer roads, different speeds) • Analysis of sample efficiency, collision rates, and traffic impact • Visualization and interpretation of learned coordination strategies Our results demonstrate that the proposed GNN-MAPPO approach achieves 28.3% reduction in EMV travel time compared to baseline MAAC and 44.6% compared to uncoordinated traffic, while maintaining safety (0.3% collision rate) and traffic efficiency (81% of normal speed). The hierarchical architecture improves corridor formation time by 21.2% compared to flat GNN designs. I-B Paper Organization The remainder of this paper is organized as follows. Section II reviews related work on emergency vehicle preemption, multi-agent reinforcement learning, graph neural networks, and connected vehicle applications. Section III presents our problem formulation and the proposed hierarchical GNN-MARL framework in detail. Section IV describes the experimental setup and comprehensive results. Section V discusses limitations, insights, and future directions. Section VI concludes the paper. II Related Work II-A Emergency Vehicle Preemption Systems Traditional EVP systems focus primarily on traffic signal control. Adaptive signal timing systems adjust traffic lights to create green waves along EMV routes [ 32 , 9 , 20 , 10 ] . However,