Human-Centric Traffic Signal Control for Equity: A Multi-Agent Action Branching Deep Reinforcement Learning Approach Journal: Engineering Applications of Artificial Intelligence
Xiaocai Zhang, Neema Nassir, Lok Sang Chan, Milad Haghani · 2026
Read Human-Centric Traffic Signal Control for Equity: A Multi-Agent Action Branching Deep Reinforcement Learning Approach Journal: Engineering Applications of Artificial Intelligence by Xiaocai Zhang, Neema Nassir, Lok Sang Chan, Milad Haghani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02959.txt.
Introduction
Traffic signals that count people, not just vehicles, are proposed by Xiaocai Zhang and 3 co-authors in a 2026 paper. Most multi-agent learning systems for signals are vehicle-centric. They also struggle with the huge number of combined actions across a corridor of intersections in a city network.
Their framework splits each decision into local and global actions. Local actions divide green time between the next two phases at each intersection. One global action sets how long those phases last. The reward penalizes the number of delayed individuals, including pedestrians, vehicle occupants, and transit passengers. Seven realistic scenarios in Melbourne, Australia were tested. The approach cut impacted travelers significantly and stayed robust across settings.
Catalog record
| CREATOR | Xiaocai Zhang, Neema Nassir, Lok Sang Chan, Milad Haghani |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 97 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02959
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Human-Centric Traffic Signal Control for Equity: A Multi-Agent Action Branching Deep Reinforcement Learning Approach Journal: Engineering Applications of Artificial Intelligence Xiaocai Zhang, Neema Nassir, Lok Sang Chan, Milad Haghani Abstract Coordinating traffic signals along multimodal corridors is challenging because many multi-agent deep reinforcement learning (DRL) approaches remain vehicle-centric and struggle with high-dimensional discrete action spaces. We propose MA2B-DDQN, a human-centric multi-agent action-branching double Deep Q-Network (DQN) framework that explicitly optimizes traveler-level equity. Our key contribution is an action-branching discrete control formulation that decomposes corridor control into (i) local, per-intersection actions that allocate green time between the next two phases and (ii) a single global action that selects the total duration of those phases. This decomposition enables scalable coordination under discrete control while reducing the effective complexity of joint decision-making. We also design a human-centric reward that penalizes the number of delayed individuals in the corridor, accounting for pedestrians, vehicle occupants, and transit passengers. Extensive evaluations across seven realistic traffic scenarios in Melbourne, Australia, demonstrate that our approach significantly reduces the number of impacted travelers, outperforming existing DRL and baseline methods. Experiments confirm the robustness of our model, showing minimal variance across diverse settings. This framework not only advocates for a fairer traffic signal system but also provides a scalable solution adaptable to varied urban traffic conditions. 1 Introduction Driven by population growth and urbanization, the demand for efficient and diverse transportation options is steadily increasing in many cities around the world ( 5 ) . This leads to the development of multimodal transport systems, which integrate various modes of transport, such as walking, cycling, public transit, and private vehicles, to provide seamless, accessible and sustainable mobility solutions. Fairness and equity are important principles of a multimodal transportation system, which encompasses all users of transportation, not just those in cars. By shifting the focus from a car-centric model to an individual-centric solution, this system promotes sustainability while ensuring fair access to transportation resources for all road users, regardless of their mode of travel. Despite the importance of fairness, only a few works have translated fairness into the urban transportation sector, with a focus on transportation planning rather than traffic engineering. The concept of fairness has received limited attention from scholars and practitioners alike in the context of traffic engineering ( 40 ) . Ensuring fairness in transportation systems means making them accessible to all segments of the community, regardless of economic status, disability, or geographic location. This is important for reducing social inequalities and promoting fair access to public services, ultimately leading to more accessible and sustainable transportation. Traffic signals coordinate movements at intersections to enhance the efficiency of transportation networks. Traffic Signal Control (TSC) remains a challenging but active research problem within transportation due to its complex, dynamic, and stochastic characteristics ( 56 ; 4 ) . Traditional fixed-time traffic light control algorithms become inefficient in managing congestion within highly dynamic traffic scenarios. Although manual traffic control can be effective, it often results in inefficient use of time and manpower. Early-stage adaptive TSC methods tackle optimization challenges to develop efficient coordination and control strategies. Popular TSC solutions, including Split Cycle Offset Optimization Technique (SCOOT) ( 17 ) and Sydney Coordinated Adaptive Traffic System (SCATS) ( 45 ) , have been implemented in many cities across the world ( 5 ) . However, these adaptive TSC systems, like SCATS, mainly address vehicle traffic and often require further enhancements to accommodate pedestrians or cyclists. For SCATS to efficiently cater to integrated transportation systems, more innovative adaptations are necessary ( 34 ) . In order to elevate the efficiency of TSC, the paradigm of Deep Reinforcement Learning (DRL) has been extensively leveraged to handle the complex and fluctuating environmental dynamics in traffic and transportation systems. DRL is particularly effective in TSC due to its ability to autonomously discover optimal strategies through a process of trial and error, effectively adapt to evolving conditions, and make informed decisions grounded in intricate and variable traffic patterns. This approach has been shown to surpass conventional transportation approaches in managing traffic flows, as evidenced by several recent studies ( 57 ; 65 ) . These studies highlight the substantial benefits of DRL, showcasing its potential to revolutionize traffic management by enhancing decision-making processes and response times to real-time traffic situations. In its early stages, the applications of DRL in TSC were primarily concentrated on individual intersections. Subsequently, techniques like Q-learning ( 38 ) , DQN ( 10 ) , DDDQN ( 12 ) , and hybrid methods that integrate fuzzy control with DRL ( 21 ) were gradually extended to optimize the signal control of multiple intersections. Effectively coordinating traffic signals is essential to ensure that all traffic lights within a network collaborate to enhance overall traffic flow efficiency. This paper aims to develop advanced DRL methodologies for TSC at multiple intersections within the same corridor. However, previous research on DRL for multi-intersection signal coordination primarily targets enhancing vehicle throughput and reducing waiting time or congestion at intersections. This has prompted a need for exploring more humanized objectives, such as equity and fairness, within DRL frameworks for traffic and social management. Moreover, effectively managing both vehicle and pedestrian traffic is challenging due to the contradiction in their optimization scale required: pedestrian traffic needs focused optimization at individual intersections, while vehicle traffic optimization needs to be extended at the corridor-wide level. This paper tackles this challenge by exploring multimodal transportation coordination that encompasses both vehicles and pedestrians. In this paper, we introduce a novel DRL framework tailored for multi-agent environments, aimed at optimizing traffic signals across a network of multiple intersections. This cooperative learning model uses a periodic synchronization strategy, where all agents periodically update their policies based on globally shared information. The updating interval is also an adaptive variable, determined by the DRL model to promote exploration of actions and states for potentially higher rewards. The method is fundamentally built on the Double Deep-Q Network (DDQN) framework, incorporating an action branch architecture ( 49 ) extending for multi-agent optimization. The model is termed as M ulti- A gent A ction- B ranching DDQN ( MA2B-DDQN ). This approach can be extended to a large-scale network with more intersections (agents) included. The proposed method aims to find the optimal timing of the traffic signals for the upcoming few phases at all intersections within this road network, by treating every participant in the transportation network equally and fairly. As shown by Figure 1 , users of the transportation services can come from various modalities, such as private cars, pedestrians, cyclists, and public transit options like buses or trams. The information such as the numbers of users for different modalities of transportation is useful for human-centric optimization. On the other hand, the development of advanced sensor and Artificial Intelligence (AI) technologies has facilitated the process of information sensing, data collection, data fusion ( 70 ) , and data pre-processing ( 26 ) . For example, the number of occupants in a car can be estimated ( 19 ; 37 ) , the number of pedestrians can be counted using Bluetooth low energy scanners ( 13 ) , and on-board passenger counts for public transportation could be precisely predicted using advanced AI