A Unified Detection Pipeline for Robust Object Detection in Fisheye-Based Traffic Surveillance
Neema Jakisa Owor, Joshua Kofi Asamoah, Tanner Wambui Muturi, Anneliese Jakisa Owor, Blessing Agyei Kyem, Andrews Danyo, Yaw Adu-Gyamfi, Armstrong Aboah, University of Missouri–Columbia, First Authors · 2025
Read A Unified Detection Pipeline for Robust Object Detection in Fisheye-Based Traffic Surveillance by Neema Jakisa Owor, Joshua Kofi Asamoah, Tanner Wambui Muturi, Anneliese Jakisa Owor, Blessing Agyei Kyem, Andrews Danyo, Yaw Adu-Gyamfi, Armstrong Aboah, University of Missouri–Columbia, First Authors (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20016.txt.
Introduction
Neema Jakisa Owor and seven co-authors build a detection system for traffic cameras that use fisheye lenses. Such cameras see a wide area from one spot, but strong distortion warps objects near the image edges. Standard detectors struggle most in exactly those outer regions, where shapes look degraded and uneven.
Their pipeline adds simple steps before and after detection and combines several trained models through an ensemble, which improves consistency across the whole image. On the 2025 AI City Challenge Track 4 test, the system earned an F1 score near 0.64 and placed eighth among sixty-two teams. The result shows that careful processing can offset much of the distortion penalty.
Catalog record
| CREATOR | Neema Jakisa Owor, Joshua Kofi Asamoah, Tanner Wambui Muturi, Anneliese Jakisa Owor, Blessing Agyei Kyem, Andrews Danyo, Yaw Adu-Gyamfi, Armstrong Aboah, University of Missouri–Columbia, First Authors |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20016
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Unified Detection Pipeline for Robust Object Detection in Fisheye-Based Traffic Surveillance Neema Jakisa Owor, Joshua Kofi Asamoah, Tanner Wambui Muturi, Anneliese Jakisa Owor, Blessing Agyei Kyem, Andrews Danyo, Yaw Adu-Gyamfi, Armstrong Aboah, University of Missouri–Columbia, First Authors Abstract Fisheye cameras offer an efficient solution for wide-area traffic surveillance by capturing large fields of view from a single vantage point. However, the strong radial distortion and nonuniform resolution inherent in fisheye imagery introduce substantial challenges for standard object detectors, particularly near image boundaries where object appearance is severely degraded. In this work, we present a detection framework designed to operate robustly under these conditions. Our approach employs a simple yet effective pre and post processing pipeline that enhances detection consistency across the image, especially in regions affected by severe distortion. We train several state-of-the-art detection models on the fisheye traffic imagery and combine their outputs through an ensemble strategy to improve overall detection accuracy. Our method achieves an F1 score of 0.6366 on the 2025 AI City Challenge Track 4, placing 8th overall out of 62 teams . These results demonstrate the effectiveness of our framework in addressing issues inherent to fisheye imagery. 1 Introduction Object detection is a core component of intelligent transportation systems (ITS), supporting critical functions such as vehicle detection and classification, traffic state estimation, and incident detection [ 41 ] . The effectiveness of these tasks depends not only on algorithmic accuracy but also on the spatial and temporal quality of visual input [ 4 ] . In practice, most ITS deployments rely on rectilinear cameras, whose narrow fields of view limit the ability to capture complete scenes, particularly at complex locations like intersections and merges [ 5 ] . To address these limitations, systems often deploy multiple cameras to extend coverage. Although this strategy improves visibility, it introduces added hardware costs, increases calibration complexity, and reduces spatial continuity across views. These trade-offs have prompted growing interest in camera systems that offer wide-area coverage from a single viewpoint, with reduced infrastructure and improved scene-level coherence. Figure 1 : Fisheye-based traffic surveillance image capturing wide-area activity at an intersection using a single camera, as well as object detections from our proposed solution. Fisheye cameras provide a promising alternative, offering panoramic fields of view up to 180 degrees from a single vantage point (Fig. 1 ). This enables continuous coverage of complex scenes such as roundabouts, merges, and intersections using a single device. By capturing more of the environment in a single frame, fisheye systems enhance spatial continuity and significantly reduce hardware complexity. However, this comes at the cost of severe radial distortion, particularly near the image periphery, where objects often appear warped, compressed, or blurred [ 9 , 16 ] . In response, recent studies have reported three main approaches in addressing these limitations. First, the use of preprocessing techniques that enhance visual consistency under varying conditions. For example, methods such as illumination clustering and night-to-day conversion have been proposed to normalize image appearance prior to detection [ 35 ] . Second, the introduction of distortion-aware models that aim to learn geometric invariance directly from fisheye data. These models often incorporate spherical convolutions or curved bounding boxes to account for spatial deformation without requiring explicit rectification [ 27 , 38 , 5 ] . Third, the use of post processing techniques that refine detection outputs through methods such as super resolution and ensemble fusion, improving localization and reducing false positives [ 16 ] . While each of these approaches addresses specific limitations, they are typically applied in isolation and often involve tradeoffs in computational efficiency or latency. These limitations underscore the need for a unified detection pipeline that combines efficient preprocessing, robust model architectures, and streamlined post-processing to achieve reliable object detection on fisheye imagery. In response to this need, we propose a unified framework designed to perform robustly under heavy radial distortion without relying on explicit geometric correction. The approach integrates a simple yet effective combination of pre and post processing steps to enhance detection consistency across the image, particularly in peripheral regions where distortion is most pronounced. Multiple state of the art object detectors are trained on fisheye traffic data, and their predictions are fused through an ensemble strategy to improve both accuracy and stability. Toward this end, the study makes the following contributions: 1. We introduce a unified detection framework that operates robustly on fisheye images without explicit distortion modeling. 2. We propose a targeted set of pre- and post-processing steps to improve detection consistency across challenging conditions. A key contribution is extending the training distribution to better handle nighttime scenes, which are underrepresented in the base fisheye dataset. To address this, we incorporate synthetic nighttime images and generate pseudo-labels using YOLO-World, which helps the model generalize more reliably under low-light conditions. 3. We introduce a novel ensemble model that combines 4 state-of-the-art object detection models, namely, YOLOR, YOLOv12, Salience-DETR, and Co-DETR. By combining models with complementary strengths, the ensemble improves detection robustness and accuracy, particularly in the challenging visual conditions presented by fisheye traffic scenes. 4. Finally, we conduct extensive experiments to validate the effectiveness of our proposed framework. The results demonstrate strong performance on AI City Challenge Track 4, highlighting the framework’s robustness and practical value in real-world scenarios. 2 Related Work Object detection is central to traffic surveillance, enabling systems to track vehicles and interpret behavior over time. Advances in deep learning have significantly improved detection accuracy in conventional scenes, but fisheye imagery introduces geometric distortion that standard models struggle to handle. This section reviews core detection architectures and processing techniques, with a focus on methods developed to address challenges specific to distorted visual input. 2.1 Object Detection for Intelligent Transportation Systems Deep learning-based object detectors are typically classified into two categories: two-stage and one-stage models. Two-stage detectors first generate region proposals and then classify objects within those regions. R-CNN [ 7 ] introduced this pipeline, which was later improved by SPP-Net [ 12 ] and Fast R-CNN [ 6 ] to increase efficiency and reduce redundancy. Faster R-CNN [ 29 ] further streamlined the process by integrating proposal generation into the network itself, while Mask R-CNN [ 11 ] extended the framework to support instance segmentation. These architectures have been widely adopted in traffic analysis tasks. For example, Zhang et al. applied Mask R-CNN to extract vehicle-level attributes such as speed, axle count, and lane position [ 40 ] , and Mhalla et al. developed a specialized Faster R-CNN variant for embedded multi-object traffic detection. One-stage detectors address this issue by performing classification and localization in a single forward pass. Popular examples include YOLO [ 28 ] , SSD [ 22 ] , and RetinaNet [ 20 ] , which have become standard for real-time applications due to their speed. Several extensions to YOLO have improved robustness under challenging conditions. For instance, Lu et al. [ 23 ] introduced a cross-scale feature fusion module and an illumination-invariant transform to improve performance under deformation and lighting variation, though challenges persist for detecting small or distant vehicles. Transformer-based models have emerged as a strong alternative to CNN-based detectors. DEtection TRansformer (DETR) reformulated object detection as a set prediction task, eliminating the need