Ground Plane Projection for Improved Traffic Analytics at Intersections

Sajjad Pakdamansavoji, Kumar Vaibhav Jha, Baher Abdulhai, James H. Elder · 2025

Read Ground Plane Projection for Improved Traffic Analytics at Intersections by Sajjad Pakdamansavoji, Kumar Vaibhav Jha, Baher Abdulhai, James H. Elder (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-12342.txt.

Introduction

Sajjad Pakdamansavoji, Kumar Vaibhav Jha, Baher Abdulhai and James H Elder test whether traffic at intersections is better analyzed on the ground plane than in the camera image. Turning movement counts guide signal timing, traffic management and city planning. Vision systems usually track vehicles in image coordinates, which distort distance and direction.

The authors project detected vehicles from roadside cameras down onto the ground plane, giving real-world coordinates. For a single camera, that change improves both trajectory classification and turning counts. Weak fusion of projections from several cameras improves accuracy further. Their conclusion is plain: analyze traffic where it actually moves, on the ground.

Catalog record

CREATORSajjad Pakdamansavoji, Kumar Vaibhav Jha, Baher Abdulhai, James H. Elder
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-12342

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Ground Plane Projection for Improved Traffic Analytics at Intersections Sajjad Pakdamansavoji, Kumar Vaibhav Jha, Baher Abdulhai, James H. Elder Abstract Accurate turning movement counts at intersections are important for signal control, traffic management and urban planning. Computer vision systems for automatic turning movement counts typically rely on visual analysis in the image plane of an infrastructure camera. Here we explore potential advantages of back-projecting vehicles detected in one or more infrastructure cameras to the ground plane for analysis in real-world 3D coordinates. For single-camera systems we find that back-projection yields more accurate trajectory classification and turning movement counts. We further show that even higher accuracy can be achieved through weak fusion of back-projected detections from multiple cameras. These results suggeest that traffic should be analyzed on the ground plane, not the image plane. I INTRODUCTION Accurate turning movement counts (TMC) are essential data for core intelligent transportation system (ITS) goals, including optimizing traffic signal timings, alleviating congestion, and enhancing road safety. They are also important for the design of efficient road networks, planning pedestrian pathways, and strategizing for future urban expansions. Computer vision systems for TMC typically involve detection of vehicles in each image frame, tracking of these detections over frames, and then classification of each image plane trajectory into one of several possible turning movement classes. Accurate classification requires that tracks from different classes are well-separated relative to the dispersion within each class. While this is typically true on the ground plane, projection to the image plane distorts these trajectories and could potentially degrade this separation. This motivates an analysis of whether it is advantageous to perform trajectory classification in the ground plane rather than the image plane. We perform this analysis here, making the following specific contributions: 1. We enhance two public ITS datasets and contribute a third novel dataset, providing ground-truth turn counts, orthographic projections and homographies from the image plane to the ground plane to support ground plane analysis. 2. We develop and open-source a novel pipeline for automatic ground-plane TMC. 3. We use our three datasets to evaluate and compare single-camera TMC in the image plane vs the ground plane, finding classification on the ground plane to be consistently more accurate. 4. We demonstrate how this approach can be extended to multi-camera systems to achieve even more accurate ground plane classification through a simple weak-fusion approach. II PRIOR WORK Historically, turning movement counts have been collected manually or by using inductive loop detectors [ 13 ] . These methods are reliable but costly. Manual methods require deployment of personnel every time a cont is required, and inductive loops are susceptible to damage from shifts in the roadbed due, for example, to freeze/thaw cycles. Roadside radar is less expensive and more flexible, but provides limited information about each vehicle [ 39 ] . Since the 1990s, traffic surveillance cameras have become increasingly explored for ITS applications due to reasonable costs and utility for both human and machine interpretation. Computer vision approaches for TMC based on traffic camera data typically comprise three stages: Detection, tracking and classification of trajectories. II-A Detection Early traffic analytics methods often relied on background subtraction for detection [ 3 , 4 , 25 , 34 ] . Modern methods typically use convolutional neural network (CNN) detectors, including two-stage detectors like Faster RCNN [ 14 ] and one-stage detectors like CenterNet [ 12 ] , various versions of YOLO [ 10 , 15 , 29 , 14 ] , RetinaNet [ 9 ] , and NAS-FPN [ 32 ] . II-B Tracking Tracking methods applied in early traffic analytics systems were typically feature-based, employing particle filters [ 8 ] , dynamic feature grouping [ 11 ] , the Kanade-Lucas-Tomasi (KLT) tracker [ 31 ] , region-based tracking [ 27 , 23 ] and contour-based tracking [ 35 ] . Modern approaches typically employ online trackers based on variations of the Kalman filter, such as SORT [ 29 ] , DeepSort [ 5 , 32 ] , ByteTrack [ 16 ] , and JDE [ 37 ] . Further advances have been achieved by training a re-identification feature network [ 6 ] , implementing Mahalanobis distance smoothing [ 14 ] , and integration of trajectories from multiple viewpoints [ 18 ] . Some traffic analytics systems have employed tracking methods like CenterTrack [ 12 ] and Tracktor [ 22 ] that eschew the Kalman model and instead learn to directly predict and associate current detections from the bounding box coordinates in the previous frame. II-C Classifying trajectories Trajectory classification methods can be categorized into line-based, zone-based, field map-based and prototype-matching, or a combination thereof. Line-based methods [ 18 , 22 ] classify trajectories based on their intersections with predefined virtual lines. Zone-based methods [ 9 , 31 ] classify based on entry and exit zones; [ 31 ] incorporates an additional central zone to handle shorter tracks. Field map methods [ 12 , 37 ] classify trajectories based upon proximity and completeness field maps derived from manually drawn models of each movement of interest. Prototype matching techniques define a typical trajectory for each object, either manually [ 10 , 15 ] , semi-automatically using line or zone intersections [ 14 , 1 ] , or with unsupervised automatic clustering methods [ 14 , 29 ] . Matching of new trajectories to prototypes is achieved with a range of distance metrics, including cosine distance of trajectory directions, shape-based measures like the Hausdorff distance [ 29 ] , longest common subsequence (LCSS) [ 26 ] , nearest neighbor [ 1 ] , or combinations of these [ 10 , 15 ] . [ 24 ] explores a cascaded approach, combining zone-based and prototype matching techniques. Prior work [ 1 , 18 ] has explored back-projection to the ground plane for classification of turning movement counts and integration of multiple camera views, however whether this afford significant advantage over camera-plane classification has not been systematically tested. II-D Our approach We adopt the standard detect-track-classify framework. We select the detector and tracker based upon a comprehensive evaluation on our training data. For detection we employ the deconvolution-based foundation model, InternImage [ 30 ] . For tracking we use the Kalman filter-based ByteTrack system [ 16 ] . Our main innovation is in trajectory classification. We use an unsupervised method to identify reliable exemplars for each turning movement class and use these to derive a dense likelihood map for each turning movement class over either the image plane or the ground plane. Approximating vehicle locations over a trajectory as conditionally independent, we use these maps to estimate the conditional likelihood of novel trajectories tracks. This method proves effective for both longer and shorter tracks. III DATASETS Most existing traffic intersection datasets (e.g., [ 33 , 20 , 19 , 21 , 36 ] ) provide only one camera view per intersection. (An exception is the multimodal A9-Intersection dataset [ 7 ] , which provides two views per intersection. However, the field of view of the two cameras is relatively narrow and insufficient to monitor traffic in all directions.) Here we evaluate camera plane and ground plane TMC methods on the CityFlow V2 [ 21 ] dataset (Fig. 1 (a))

Read the complete text