Automatic Labelling for Low-Light Pedestrian Detection

1 st Dimitrios Bouzoulas, 2 nd Eerik Alamikkotervo, 3 rd Risto Ojala · 2025

Read Automatic Labelling for Low-Light Pedestrian Detection by 1 st Dimitrios Bouzoulas, 2 nd Eerik Alamikkotervo, 3 rd Risto Ojala (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-02513.txt.

Introduction

Dimitrios Bouzoulas, Eerik Alamikkotervo, and Risto Ojala wrote this 2025 paper on spotting people on foot in dark street scenes. Cameras that see visible light are cheap and common in cars, but large labeled sets for low light are scarce. Heat-sensing cameras see people well in the dark, so the team built a pipeline that borrows their labels.

First, a tuned model finds people in heat images. Those boxes are then moved onto the paired color images, giving labels with no hand work. Three detector models trained on the made labels beat the same models trained on hand labels in most tests, which points to a cheap way to grow dark-scene data sets.

Catalog record

CREATOR1 st Dimitrios Bouzoulas, 2 nd Eerik Alamikkotervo, 3 rd Risto Ojala
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-02513

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Automatic Labelling for Low-Light Pedestrian Detection Thanks: We thank Henry Ford Foundation Finland for providing funding for this research. 1 st Dimitrios Bouzoulas, 2 nd Eerik Alamikkotervo, 3 rd Risto Ojala Abstract Pedestrian detection in RGB images is a key task in pedestrian safety, as the most common sensor in autonomous vehicles and advanced driver assistance systems is the RGB camera. A challenge in RGB pedestrian detection, that does not appear to have large public datasets, is low-light conditions. As a solution, in this research, we propose an automated infrared-RGB labeling pipeline. The proposed pipeline consists of 1) Infrared detection, where a fine-tuned model for infrared pedestrian detection is used 2) Label transfer process from the infrared detections to their RGB counterparts 3) Training object detection models using the generated labels for low-light RGB pedestrian detection. The research was performed using the KAIST dataset. For the evaluation, object detection models were trained on the generated autolabels and ground truth labels. When compared on a previously unseen image sequence, the results showed that the models trained on generated labels outperformed the ones trained on ground-truth labels in 6 out of 9 cases for the mAP@50 and mAP@50-95 metrics. The source code for this research is available at https://github.com/BouzoulasDimitrios/IR-RGB-Automated-LowLight-Pedestrian-Labeling I Introduction Pedestrian detection has a key role in autonomous vehicles (AVs) and advanced driver assistance systems (ADAS), having the potential to increase safety and lower pedestrian related traffic accidents [ 1 ] . According to the World Health Organization (WHO) [ 2 ] , every year approximately 1.19 million people lose their lives in traffic accidents. The crashes referenced by WHO are a result of a multitude of factors such as poor infrastructure, mechanical problems, and human errors. Looking at the various types of operating conditions nighttime/low-light conditions pose a common and unavoidable threat. This has been verified by the data analysis done in [ 3 ] on the data provided by the transportation Statistics and the National Highway Traffic Safety Administration of the United States, where it was found that the probability of a fatal accident during nighttime was nine times higher compared to daytime. These statistics verify the need for systems capable of reliably detecting pedestrians in low-light conditions. Figure 1: Autolabelling pipeline, using unlabelled low-light IR-RGB image pairs as an input, the system outputs labelled RGB images. AVs and cars with ADAS currently on the roads and in production have primarily RGB cameras available. Using only RGB cameras can be challenging in edge case conditions such as low-light conditions as RGB model accuracy is highly affected by lighting [ 4 ] . A crucial part in developing robust models capable of detecting pedestrians in such conditions is large quantities of labelled data. A large limitation in the labelling process is time. In this research, we propose an automated Infrared(IR) to RGB labelling pipeline aiming to solve the issues posed by nighttime/low-light conditions, omitting the need for human input. For this goal we leverage the lighting invariance of infrared cameras as the visibility of infrared light is not affected by the lack of visible light. In our approach, we utilise the benefits of infrared images to detect pedestrians in infrared and then transfer the labels to the corresponding RGB image pair. Our proposed approach relies on aligned infrared and RGB images, which can be conveniently collected with a research vehicle equipped with suitable sensor setup. The developed pipeline enables automated labelling with no manual human effort, leaving only data collection as manual work. The proposed pipeline shows a range of results. As a method the proposed pipeline has not been previously proposed for automated labelling. We allow the reuse and further development by open-sourcing the implementation. The experimental results show that the labels generated from the pipeline can match and in many cases outperform ground truth label performance. II Related Work II-A Pedestrian Detection Aiming to enable AVs and ADAS to detect pedestrians reliably, multiple approaches using various sensors and sensor combinations have been proposed. Multiple camera-based solutions have been proposed over the years [ 5 ] , targeting use cases with favourable lighting conditions. A recent advancement in purely camera-based pedestrian detection is [ 6 ] , where a modified YOLOv5 model was proposed resulting in mAP@50 76.9% and mAP@50-95 48.3% mAP scores increase on the WiderPerson dataset [ 7 ] and a reduced number of floating point operations making the architecture more suitable for real-time applications. In a similar approach [ 8 ] proposed a modified YOLOv8 network achieving an mAP@50 of 54.7% mAP@50-95 of 32.6% and a lower number of floating point operations on the WiderPerson dataset. In [ 9 ] , an infrared camera was utilised for pedestrian detection. Saliency maps were extracted from infrared images and used as an attention mechanism. The approach was used for enhanced pedestrian detection. The results on the KAIST dataset showed a lowered miss rate of 13.4% for daytime and 19.3% for nighttime compared to the baseline in day and night. For low-light pedestrian detection, more diverse approaches have been proposed to solve the challenges posed by the poor lighting conditions. To achieve improved focus on pedestrian features [ 10 ] proposed a fore-background attention mechanism that enhances pedestrian features while reducing background noise, resulting in improved low-light pedestrian detection. The proposed method scored accurate results across multiple datasets compared to the baseline and other state-of-the-art nighttime pedestrian detection methods. Sensor fusion approaches are a common solution for pedestrian detection, as they offer increased robustness to a wide variety of conditions, including low-light scenarios. Common sensor fusion-based approaches utilize a RGB-Lidar sensor combination. Following the RGB-Lidar approach [ 11 ] proposed a two-branch multilevel pedestrian detection network, and when tested on the KITTI dataset [ 12 ] achieved an mAP0.5 of 91.6% and 26.7 fps on the Jetson Orin, making the application both accurate and efficient for real-time applications. Similarly, in [ 13 ] , using the RGB-Lidar sensor combination and applying a stable diffusion-based approach an improvement of the mAP0.5 metric was achieved of 4.2% for BEVDepth and 4.6% for BEVStereo on the nuScenes dataset. Similarly to the RGB-Lidar methods a wide range of approaches has been suggested for RGB-Infrared/Thermal sensor combination. With [ 14 ] proposing a dual network architecture based on YOLOv5, tested on a wide range of publicly available datasets and achieving [email protected] of 96.6%-INRIA, 89.2% CVC09, 90.5% LSIFIR, 56% FLIR-ADAS, 79.8% CVC14, 72.3% Nightowls, 53.3%-KAIST. Using an SSD-like halfway fusion model network was proposed in [ 15 ] , where features were extracted from thermal and RGB images with two separate networks before being fused, yielding results for KAIST LLVIP and CVC-14, exceeding state-of-the-art performance for mAP metrcis. II-B Automatic Labelling Targeting domain adaptation across different datasets, [ 16 ] proposed the usage of pseudo-labels for training pedestrian detection models. The approach used an initial dual-input model trained on a baseline dataset using both RGB and thermal images. This was followed by generating and filtering pseudo labels based on confidence on the target dataset using the pretrained model. The model is then trained on the newly annotated dataset and the entire process is repeated until the model performance becomes stable. The proposed method yielded an

Read the complete text