Arterial Network Traffic State Prediction with Connected Vehicle Data: An Abnormality-Aware Spatiotemporal Network Lei Han, Mohamed Abdel-Aty, Yang-Jun Joo Abstract Emerging connected-vehicle (CV) data shows great potential in urban traffic monitoring and forecasting. However, prior CV-based studies on arterial traffic measures prediction (i.e., delays and queues) are limited to simulated high-penetration scenarios or small networks, which are challenging to apply in real-world city-scale arterial networks. To address such gaps, we develop a CV data-based arterial traffic prediction framework with two components: (1) a two-stage traffic state extraction method that estimates vehicle-level traffic measures from CV trajectories and then aggregates them into network-level traffic state measures; (2) an Abnormality-aware spatiotemporal graph convolution network (AASTGCN) that adopts a dual-expert architecture to separately model normal and abnormal traffic, and jointly captures short-term traffic dynamics and long-term periodicity via spatiotemporal GCN with a gated-fusion mechanism. Real-world CV data are used to test our method in a large arterial network with 1,050 links (386.4 miles). Experimental results show that: 1) the proposed traffic estimation method is effective for large arterial networks to provide real-time traffic measures (e.g., link-level average travel delay and queue length), which are critical for urban traffic operation and evaluation. 2) Abnormal traffic prediction is typically challenging for existing methods. By modeling abnormal cases separately from normal traffic in two dedicated experts, AASTGCN outperforms existing models for both normal and abnormal traffic conditions. 3) The gate-fusion mechanism adaptively balances real-time and historical information: it leverages more historical-periodic information in normal traffic and shifts a higher weight to real-time traffic dynamics for abnormal traffic deviating abruptly from historical patterns. The proposed framework can be implemented in large urban arterial networks for various real-time traffic operation applications. [orcid=0000-0002-2976-0762] [orcid=0000-0002-4838-1573] [orcid=0000-0003-2319-0874] † † highlights: Leverage high-resolution CV data to estimate arterial network traffic state measures (e.g., travel delay and queue). Propose an Abnormality-Aware Spatiotemporal Graph Convolution Network (AASTGCN) to predict arterial-network delay and queue length. AASTGCN adopts two spatiotemporal branches with gated fusion to capture both real-time traffic dynamics and long-term traffic periodic patterns. A dual-expert architecture is incorporated to model normal and abnormal traffic separately, disentangling their distinct patterns and improving prediction accuracy under both conditions. Experiments on a city-scale arterial network with 1,050 links validate the SOTA performance of AASTGCN. keywords Traffic Prediction ,Connected Vehicle Data,Arterial Network,Travel delay,Queue length,Spatiotemporal Network † † corresponding: Corresponding author 1 Introduction Arterial networks carry a substantial volume of urban traffic and serve as the backbone of urban transportation systems. Reliable estimation and prediction of traffic states on these networks are critical for traffic operations and management applications ( 55 ) . Traditional traffic state measuring approaches have relied on fixed sensors such as loop detectors ( 32 ; 50 ) , automated vehicle identification sensors ( 28 ) , microwave vehicle detection systems ( 41 ; 42 ) and license-plate recognition cameras ( 55 ; 19 ) . However, the high installation and maintenance costs typically restrict their deployment to specific road types or small networks. Consequently, most of these studies are conducted on expressways ( 41 ; 42 ; 1 ; 58 ) rather than urban arterials. Although a few studies have examined arterial roads, their study areas are typically limited to a few arterial segments or networks ( 55 ; 19 ) . These data constraints limit the applicability of traditional approaches to real-world, city-scale arterial networks. With advances in vehicle communication techniques, high-resolution connected vehicle (CV) data have become a promising data source for urban traffic monitoring ( 48 ) . Unlike fixed sensors, CV data are obtained from individual vehicles without spatial restrictions, which can cover large-scale urban road networks and diverse road types. Therefore, recent studies have shifted towards utilizing CV data for urban arterial traffic state analysis ( 14 ; 43 ; 34 ; 21 ; 39 ) . For example, travel time and delay can be derived from CV arrival and departure times and are widely used as key indicators of arterial traffic performance. Substantial efforts have focused on estimating and predicting these measures ( 5 ; 43 ; 36 ) . Queue length is another critical indicator to measure arterial traffic effectiveness. As it is difficult to estimate from stationary sensors, numerous queue-length estimation and prediction methods using CV trajectories have been proposed ( 60 ; 8 ; 44 ) . However, most of the existing studies rely on simulated virtual data and assume relatively high penetration rates (e.g., 10-50%) ( 45 ) . Only a few studies validated their methods with real-world cases ( 44 ; 40 ) , yet their samples are generally limited to specific arterial segments and networks. To the best of our knowledge, large-scale arterial traffic state estimation and prediction of delay and queue length using real-world CV data remains an open research gap. Motivated by the above gaps, this study aims to estimate and predict segment-level delay and queue length over a city-scale arterial network with high-resolution real-world CV data. The key to accurate prediction of these measures relies on capturing complex temporal patterns and spatial dependencies in arterial traffic. To this end, deep learning (DL) models, particularly spatiotemporal graph networks, have been widely adopted due to their superior ability to model such spatiotemporal dependencies ( 23 ; 34 ; 29 ; 58 ) . However, prior methods still face two limitations. First, most studies primarily extract short-term traffic dynamics to forecast future traffic without accounting for the long-term temporal periodicity of arterial traffic (e.g., recurring patterns on the same day of the week). Failing to incorporate such periodic information may hinder model generalization and limit prediction accuracy ( 1 ) . Second, abnormal events (e.g., crashes and non-recurrent congestion) may substantially disrupt typical traffic patterns, yet most DL frameworks fail to differentiate these abnormal conditions, modeling them mixed with normal traffic ( 15 ; 52 ) . Given that abnormal traffic states are relatively rare, such mixed training will bias the model toward dominant normal traffic, resulting in poor robustness on sparse yet critical abnormal events and ultimately degrade overall prediction performance. To address these challenges, we propose an Abnormality-Aware Spatiotemporal Graph Convolution Network (AASTGCN) for predicting arterial network delay and queue length. The main contributions of this paper are summarized as follows: • Leveraging high-resolution CV data, a two-stage traffic state extraction framework is developed that first estimates vehicle-level traffic measures and then aggregates them to obtain link-level traffic state measures across arterial networks. • Within AASTGCN, two spatiotemporal branches are introduced and fused via a gated mechanism to simultaneously capture real-time traffic dynamics and long-term traffic periodic patterns from historical observations. • Abnormal traffic states are explicitly detected based on historical traffic distributions. Dual-expert architecture is employed for normal and abnormal traffic to disentangle their distinct patterns and improve prediction accuracy under both conditions. • Experiments on a city-scale arterial network with over 1,000 links (386.4 miles) validate the state-of-the-art (SOTA) performance of the proposed AASTGCN. Following this section, Section 2 reviews relevant literature. Section 3 details the CV-data based traffic state extraction, and Section 4 introduces the framework of AASTGCN. Section 5 provides experiment design and results. Finally, Section 6 presents the conclusion. 2 Literature Review 2.1 CV Data-based Traffic State Estimation Owing to their wide spatial coverage and vehicle-level granularity, CV data have emerged a primary data source for urban arterial traffic state estimation. A series of traffic measures (e.g., speed, travel time, delay, and queue length) can be derived from CV trajectories to reflect traffic states on arterial networks ( 2 ; 49 ) . Among these measures, travel time and delay are more readily derived from CV data, and most of the existing studies have focused on their estimation. For example, 22 proposed a statistical model for urban road network travel time estimation using low-frequency probe vehicle GPS data; 2 conducted simulation-based experiments for a major arterial in Berkeley, CA, showing that a CV penetration rate as low as 1% could provide representative estimates of travel time. Using the NGSIM dataset, 20 simulated different CV penetration scenarios and claimed that 3–4% penetration on urban streets can yield reliable travel time estimation. 11 propose a data-driven matching-algorithm to achieve fast link travel time estimation from high-sampling-rate CV data at the city scale. Queue length is another key performance measure for arterial traffic operations, and a big part of recent work has investigated CV data-based queue length estimation. For instance, shockwave-based methods have been proposed to identify critical queue-related events (e.g., joining and leaving the queue) from CV trajectories and then estimate queue length ( 3 ; 6 ; 26 ; 53 ) . Several studies have developed stochastic frameworks to estimate queue length using the observed locations of CVs at each cycle ( 9 ; 10 ; 7 ; 60 ) . Other stochastic estimation methods infer queue length by modeling arrival and departure processes at the intersection approach ( 17 ; 47 ; 44 ) . Despite these advances, most queue-length estimation methods assume relatively high CV penetration rates (10%–50%), which is unrealistic in current real-world deployments. Additionally, most algorithms require detailed knowledge, such as signal timing and CV penetration rate, making them difficult to deploy at scale. As a result, these methods remain primarily confined to simulation-based settings or limited arterial segments and networks. Overall, toward real-world city-scale arterial networks, how to effectively estimate traffic state measures (e.g., delay and queue length) with emerging CV data and further enable real-time prediction remains largely unexplored and warrants further investigation. 2.2 Traffic Prediction Deep Learning Methods Given that traffic prediction is inherently a spatial-temporal forecasting task, DL models have been widely adopted for their powerful capabilities to extract intricate spatiotemporal correlations and achieved superior prediction performances in recent years. Initially, recurrent neural networks (RNNs) and its variants (e.g., long and short-term memory (LSTM) and gated recurrent unit (GRU) networks) are employed to model temporal correlations of traffic features ( 46 ; 56 ) . Convolutional neural networks (CNNs) are introduced to capture spatial dependences ( 57 ; 62 ) . However, while CNNs are effective for grid-structured inputs, they can hardly handle the inherent graph structure of road networks. This non-Euclidean characteristic of traffic networks imposes significant limitations on the efficacy of CNNs in handling the spatial dependencies and topological constraints in traffic data ( 13 ) . Conversely, graph neural networks (GNNs) have demonstrated strong abilities in modeling graph-structured traffic data by explicitly encoding network topology and neighborhood-based information with flexible receptive fields ( 24 ; 33 ) . Researchers combined GNNs with temporal modules (e.g., RNNs) as spatiotemporal graph neural networks (STGNNs) to jointly capture spatial and temporal dependencies in traffic flow and achieve improved prediction performances ( 30 ; 54 ) . Subsequently, a variety of STGCN-based models—such as Graph WaveNet ( 51 ) , ASTGCN ( 16 ) , T-GCN ( 59 ) , GMAN ( 61 ) , STGIN ( 63 ) , STABC ( 29 ) and PDG2Seq ( 13 ) —have been developed to explore spatiotemporal relationships from different perspectives. Recently, Transformer-based models have gained popularity and demonstrated strong performance, owing to their attention mechanisms that effectively learn the important spatiotemporal traffic data ( 31 ; 65 ; 35 ; 58 ) . For instance, 4 proposed a bidirectional spatial–temporal adaptive transformer that adopted an encoder–decoder architecture with both spatial-adaptive and temporal-adaptive transformers for accurate traffic forecasting. STAEformer ( 31 ) leverages novel spatiotemporal and adaptive embeddings to learn spatiotemporal patterns in traffic data, providing an effective framework for improving the performance of traffic speed and flow prediction. Although existing studies have developed advanced DL models for traffic prediction, two key challenges persist: (1) most studies primarily extract short-term traffic dynamics to forecast traffic, while underutilizing critical temporal periodicities (e.g., weekly patterns). While some studies have included daily and weekly historical traffic, they often treat these periodic inputs as additional features and simply concatenate them into input temporal sequences, ignoring the distinct distributions between current and historical traffic flow ( 64 ) . (2) abnormal traffic prediction remains insufficiently addressed. Normal traffic is generally easier to predict as it tends to follow recurring and stable patterns. In contrast, abnormal traffic affected by incidents (e.g., crashes or non-recurrent congestion) may substantially disrupt typical traffic dynamics to make it harder to forecast—yet accurate prediction under such conditions is more critical for traffic operation management ( 37 ) . However, existing studies typically train models without distinguishing abnormal traffic from normal traffic. Given that abnormal traffic states are relatively rare, such training may bias models toward dominant normal traffic, thus reducing robustness to abnormal traffic. In summary, effectively incorporating temporal periodicities from historical traffic and enhancing the prediction performance of abnormal traffic conditions remain open challenges, which constitute the primary focus of this study. 3 CV Data-based Arterial Traffic State Extraction 3.1 CV Data Processing The arterial basemap is the foundation for representing the arterial network structure. Following common definitions in prior studies ( 49 ; 48 ; 55 ) , arterials are segmented into directional links delineated by intersections and links are adopted as the basic analysis unit. As a result, the arterial network can be represented as a directed graph \mathcal{G}=\{\mathcal{N},\mathcal{L}\} , where \mathcal{N} and \mathcal{L} are the sets of intersections (nodes) and directional links, respectively. As shown in Fig. 1 , two links \mathcal{L}_{i} and \mathcal{L}_{j} , between intersections \mathcal{N}_{A} and \mathcal{N}_{B} represent two opposite directions. This segmentation guarantees the continuity of CV trajectories within each link from the upstream to downstream intersections. To achieve an accurate network representation in the basemap, we use OpenStreetMap as raw map data and identify intersections. Finally, arterials are manually split into basic road links and refined to ensure that each link spans from the upstream stop line to the downstream stop line. Raw connected-vehicle (CV) trajectories are represented as Tr_{v}=\{\mathcal{P}_{1},\mathcal{P}_{2},...,\mathcal{P}_{n_{v}}\} , where n_{v} is the number of CV points for vehicle v . Each CV point is defined as \mathcal{P}_{i}=\{\mathrm{lon}_{i},\mathrm{lat}_{i},t_{i},v_{i},h_{i}\} , including longitude \mathrm{lon}_{i} , latitude \mathrm{lat}_{i} , timestamp t_{i} , speed v_{i} (mph), and heading h_{i} (degree). Given the arterial basemap and CV trajectories, CV data processing aims to (i) match CV points to arterial links and (ii) convert the original GPS coordinates to link-based distances. As shown in Fig. 2 , two key steps are conducted: Spatial matching. As shown in Fig. 2 (a), each CV trajectory point is first aligned to arterial links through a three-step procedure. Step 1, Geofence filtering: For each link, a buffer (geofence) with a fixed width l is generated, and CV points within the buffer are selected as candidate groups. Step 2, Heading checking: To filter out candidate CV points that are not traveling along the target link, the angular deviation \Delta\theta between vehicle heading and the link traveling direction is computed. CV points with |\Delta\theta|<\theta_{\mathrm{thre}} are treated as correctly aligned (blue dots), while the remaining points are removed while the remaining points are removed including the opposite CVs (red dots) and CVs on other roads (orange dots). Step 3, Trajectory validation: To filter out vehicles merging from the middle of the road or exiting from the roadside, a journey is considered invalid and removed if it contains fewer than two matched points or its total travel distance is less than half of the link length. Only journeys satisfying both criteria are retained as the final matched trajectories for each link to obtain a reliable traffic state indicator. CV point projecting. This step converts the matched CV point from original GPS coordinates (latitude/longitude) to the distance along the link. As shown in Fig. 2 (b), a CV point \mathcal{P}_{i} is projected onto link \mathcal{L}_{j} to obtain the projected point \mathcal{Q}_{\mathcal{P}_{i}\rightarrow\mathcal{L}_{j}} . Then, the distance from the link origin O (upstream stop line) to \mathcal{Q}_{\mathcal{P}_{i}\rightarrow\mathcal{L}_{j}} is calculated as the link-based distance of \mathcal{P}_{i} on \mathcal{L}_{j} , denoted by x_{i,\mathcal{L}_{j}} . After these two steps, each raw CV point is augmented with two additional attributes: its matched link \mathcal{L}_{j} and its link-based distance x_{i,\mathcal{L}_{j}} . Thus, \mathcal{P}_{i} can be represented as \{\mathrm{lon}_{i},\mathrm{lat}_{i},t_{i},v_{i},h_{i},\mathcal{L}_{j},x_{i,\mathcal{L}_{j}}\} . Therefore, the space-time diagram of a given CV trajectory on each link can be obtained, as shown in Fig. 2 (c), serving as the basis for subsequent traffic measure computing. 3.2 Traffic State Measure Extraction With the processed CV data, a two-stage traffic state extraction framework is developed that first estimates single vehicle-level traffic state measures and then aggregates them to obtain link-level measures across the arterial network. 3.2.1 Single vehicle traffic state measures For each vehicle traversing a link, a trajectory state segmentation is first used to split its entire trajectory into three states: free-flow, transition, and stop, as illustrated in Fig. 3 . Preliminary trajectory states are first labeled by speed: Stop if v_{i}\leq v_{s} with v_{s}=1~\mathrm{m/s} ; Free-flow if v_{i}>v_{t} , where v_{t}=0.8\times (speed limit) following 49 ; and Transition otherwise (i.e., v_{s}