YOLOv8-SMOT: An Efficient and Robust Framework for Real-Time Small Object Tracking via Slice-Assisted Training and Adaptive Association

Xiang Yu, Xinyao Liu, Guang Liang · 2025

Read YOLOv8-SMOT: An Efficient and Robust Framework for Real-Time Small Object Tracking via Slice-Assisted Training and Adaptive Association by Xiang Yu, Xinyao Liu, Guang Liang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12087.txt.

Introduction

Xiang Yu, Xinyao Liu, and Guang Liang present a winning system for tracking many small flying objects, such as birds, from a drone. Small targets give few looks to learn from, the camera and the birds both move, and dense flocks hide and swap identities. Their entry won a 2025 challenge on this task.

On the spotting side, training photos are sliced in a full-coverage plan, with random tweaks per slice, so small objects get enough lessons. On the tracking side, the system ignores looks entirely and leans on motion: a smoothed heading plus a match score that widens boxes and penalizes distance. The method topped the public test set for the challenge.

Catalog record

CREATORXiang Yu, Xinyao Liu, Guang Liang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-12087

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

YOLOv8-SMOT: An Efficient and Robust Framework for Real-Time Small Object Tracking via Slice-Assisted Training and Adaptive Association Xiang Yu, Xinyao Liu, Guang Liang Abstract Tracking small, agile multi-objects (SMOT), such as birds, from an Unmanned Aerial Vehicle (UAV) perspective is a highly challenging computer vision task. The difficulty stems from three main sources: the extreme scarcity of target appearance features, the complex motion entanglement caused by the combined dynamics of the camera and the targets themselves, and the frequent occlusions and identity ambiguity arising from dense flocking behavior. This paper details our championship-winning solution in the MVA 2025 ”Finding Birds” Small Multi-Object Tracking Challenge (SMOT4SB), which adopts the tracking-by-detection paradigm with targeted innovations at both the detection and association levels. On the detection side, we propose a systematic training enhancement framework named SliceTrain . This framework, through the synergy of ’deterministic full-coverage slicing’ and ’slice-level stochastic augmentation, effectively addresses the problem of insufficient learning for small objects in high-resolution image training. On the tracking side, we designed a robust tracker that is completely independent of appearance information. By integrating a motion direction maintenance (EMA) mechanism and an adaptive similarity metric combining bounding box expansion and distance penalty into the OC-SORT framework, our tracker can stably handle irregular motion and maintain target identities. Our method achieves state-of-the-art performance on the SMOT4SB public test set, reaching an SO-HOTA score of 55.205 , which fully validates the effectiveness and advancement of our framework in solving complex real-world SMOT problems. The source code will be made available at https://github.com/Salvatore-Love/YOLOv8-SMOT . 1 Introduction With the proliferation of Unmanned Aerial Vehicle (UAV) technology in the field of autonomous systems, its application as an aerial perception platform has become increasingly widespread, particularly in areas such as ecological monitoring, agricultural inspection, and public safety [ 10 , 13 ] . While UAVs offer unprecedented flexibility and perspectives for capturing wide-area scenes, they also pose severe challenges to computer vision algorithms. Among these applications, the continuous localization and identity maintenance of multiple small, moving targets in video sequences, known as Small Multi-Object Tracking (SMOT), is a particularly critical and arduous fundamental task. The SMOT task from a UAV perspective, especially when tracking agile creatures like birds, is far more complex than traditional Multi-Object Tracking (MOT) scenarios [ 15 , 30 ] . This complexity arises from the interplay of three core challenges: • Extreme Scarcity of Appearance Information: Targets often occupy only a few dozen pixels, containing almost no distinguishable texture or color features. This fundamentally invalidates classic tracking paradigms that rely on appearance models for re-identification (Re-ID), such as DeepSORT [ 22 ] . • Complex Motion Entanglement [ 25 ] : The tracker must not only handle the target’s free, non-linear movement in three-dimensional space but also contend with the drastic camera motion caused by the UAV’s own complex translations, rotations, and altitude changes. The superposition of these two motion patterns results in extremely complex and unpredictable apparent motion of the target in the image plane, causing frequent tracking failures for traditional methods that rely on linear motion models like the Kalman filter [ 2 ] . • Dense Flocking Dynamics [ 18 ] : The unique flocking behavior of birds leads to frequent and severe occlusions among targets, with high similarity in appearance and motion patterns between individuals. This poses an extreme test for maintaining individual identity continuity solely through motion information without relying on appearance features, making it highly susceptible to numerous Identity Switch (ID Switch) errors. Although significant progress has been made in general MOT tasks with paradigms based on tracking-by-detection [ 2 , 22 ] , joint detection and tracking [ 21 , 28 ] , and Transformers [ 19 , 26 ] , they struggle to directly address the cumulative effect of the three challenges mentioned above. To systematically advance this field, MVA 2025 organized the ”Finding Birds” Small Multi-Object Tracking Challenge (SMOT4SB) [ 8 ] , providing the first large-scale dataset designed for such extreme scenarios and a new evaluation metric, SO-HOTA [ 9 ] . This paper presents our championship-winning solution for this challenge. We believe that to overcome this problem, it is essential to build a framework that can synergistically address the bottlenecks of both detection and association. To this end, we propose an efficient tracking-by-detection system whose core contributions lie in two aspects, each precisely addressing the aforementioned challenges: 1. Detector Optimization for Information Scarcity: To fundamentally solve the problem of detecting small objects, we propose a systematic training data enhancement framework called SliceTrain . Through a two-stage process combining ”deterministic full-coverage slicing” and ”slice-level stochastic augmentation,” this framework significantly enriches the diversity and information density of training samples without sacrificing information integrity. This allows the detector (YOLOv8) to be trained efficiently with a larger batch size under limited computational resources, thereby significantly enhancing its feature capture and localization capabilities for tiny objects [ 17 ] . 2. Robust Tracker for Complex Dynamics: To address the association challenges posed by motion entanglement and flocking behavior, we designed a tracker that is completely independent of appearance features. We have deeply enhanced the OC-SORT [ 3 ] framework by introducing a motion direction maintenance mechanism to smooth out noise from non-linear motion and designing an adaptive similarity metric . This metric combines bounding box expansion and distance penalty, effectively solving the matching difficulties caused by the small size of targets and frequent close-range intersections. Our method achieves state-of-the-art performance on the SMOT4SB dataset, reaching an SO-HOTA score of 55.205 on the public test set, which validates the advancement and effectiveness of our framework in solving complex real-world SMOT tasks. 2 Related Work Multi-Object Tracking (MOT). The predominant paradigm in the MOT field is ”tracking-by-detection” [ 2 , 22 ] , which decouples detection and association, allowing for independent optimization of each module. Classic algorithms like SORT [ 2 ] and DeepSORT [ 22 ] use a Kalman filter for motion prediction and combine it with IoU or appearance features for data association. In recent years, researchers have proposed joint detection and tracking frameworks [ 21 , 28 ] and end-to-end Transformer architectures [ 19 ] to improve efficiency and accuracy. However, these general MOT methods mostly rely on datasets like the MOTChallenge series [ 15 ] , where the primary targets are pedestrians or vehicles, which are typically large and have distinct appearance features, a significant difference from SMOT scenarios. Small Object Detection (SOD). Small Object Detection (SOD) aims to solve the problem of limited appearance cues due to the small size of the target [ 13 ] . Traditional methods improve performance through multi-scale feature fusion (such as Feature Pyramid Networks, FPN [ 12 ] ) and data augmentation [ 31 ] . The demands on detectors are particularly stringent in scenes like aerial imagery, where targets are tiny and dense. The emergence of benchmark datasets like VisDrone [ 30 ] has spurred development in this area. At the data level, while traditional Random Cropping can increase data diversity, its sampling process is stochastic. For sparse small objects in high-resolution images, it may fail to sample them effectively over many iterations, leading to insufficient information utilization. Methods like Slicing

Read the complete text