MVA 2025 Small Multi-Object Tracking for Spotting Birds Challenge: Dataset, Methods, and Results
Yuki Kondo 1,†, Norimichi Ukita 2,†, Riku Kanayama 2,†, Yuki Yoshida 2,†, Takayuki Yamaguchi 3,†, Xiang Yu 4, Guang Liang 4, Xinyao Liu 5, Guan-Zhang Wang 6, Wei-Ta Chu 6, Bing-Cheng Chuang 7, Jia-Hua Lee 7, Pin-Tseng Kuo 7, I-Hsuan Chu 7, Yi-Shein Hsiao 7, Cheng-Han Wu 7, Po-Yi Wu 8, Jui-Chien Tsou · 2025
Read MVA 2025 Small Multi-Object Tracking for Spotting Birds Challenge: Dataset, Methods, and Results by Yuki Kondo 1,†, Norimichi Ukita 2,†, Riku Kanayama 2,†, Yuki Yoshida 2,†, Takayuki Yamaguchi 3,†, Xiang Yu 4, Guang Liang 4, Xinyao Liu 5, Guan-Zhang Wang 6, Wei-Ta Chu 6, Bing-Cheng Chuang 7, Jia-Hua Lee 7, Pin-Tseng Kuo 7, I-Hsuan Chu 7, Yi-Shein Hsiao 7, Cheng-Han Wu 7, Po-Yi Wu 8, Jui-Chien Tsou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12832.txt.
Introduction
Tracking birds in drone footage is hard because each bird may cover only a few dozen pixels, so appearance clues fail. Yuki Kondo and co-authors report a community challenge built around that problem, run at the MVA 2025 conference. They released a dataset of 211 drone video sequences with more than 108,000 annotated frames, filmed under varied real conditions where camera and birds both move freely.
The organizers also introduced a scoring metric that judges positions by distance rather than box overlap, which wobbles too much at this size. Seventy-eight participants sent in 308 entries, and the winning method improved on the baseline more than fivefold. The team offers the dataset and benchmark as a foundation for tracking work with uses in bird-strike avoidance, farming, fisheries, and wildlife monitoring.
Catalog record
| CREATOR | Yuki Kondo 1,†, Norimichi Ukita 2,†, Riku Kanayama 2,†, Yuki Yoshida 2,†, Takayuki Yamaguchi 3,†, Xiang Yu 4, Guang Liang 4, Xinyao Liu 5, Guan-Zhang Wang 6, Wei-Ta Chu 6, Bing-Cheng Chuang 7, Jia-Hua Lee 7, Pin-Tseng Kuo 7, I-Hsuan Chu 7, Yi-Shein Hsiao 7, Cheng-Han Wu 7, Po-Yi Wu 8, Jui-Chien Tsou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-12832
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MVA 2025 Small Multi-Object Tracking for Spotting Birds Challenge: Dataset, Methods, and Results Yuki Kondo 1,†, Norimichi Ukita 2,†, Riku Kanayama 2,†, Yuki Yoshida 2,†, Takayuki Yamaguchi 3,†, Xiang Yu 4, Guang Liang 4, Xinyao Liu 5, Guan-Zhang Wang 6, Wei-Ta Chu 6, Bing-Cheng Chuang 7, Jia-Hua Lee 7, Pin-Tseng Kuo 7, I-Hsuan Chu 7, Yi-Shein Hsiao 7, Cheng-Han Wu 7, Po-Yi Wu 8, Jui-Chien Tsou 8, Hsuan-Chi Liu 8, Chun-Yi Lee 8, Yuan-Fu Yang 9, Kosuke Shigematsu 10, Asuka Shin 10, Ba Tran 11, 1 Toyota Motor Corporation, 2 Toyota Technological Institute, 3 Iwate Prefecture Coastal Regional Development Bureau, 4 Nanjing University, 5 University of Science and Technology of China, 6 National Cheng Kung University, 7 National Tsing Hua University, 8 National Taiwan University, 9 National Yang Ming Chiao Tung University, 10 National Institute of Technology, Oita College, 11 Axelspace Corporation Abstract \finalcopy Abstract Small Multi-Object Tracking (SMOT) is particularly challenging when targets occupy only a few dozen pixels, rendering detection and appearance-based association unreliable. Building on the success of the MVA2023 SOD4SB challenge, this paper introduces the SMOT4SB challenge, which leverages temporal information to address limitations of single-frame detection. Our three main contributions are: (1) the SMOT4SB dataset, consisting of 211 UAV video sequences with 108,192 annotated frames under diverse real-world conditions, designed to capture motion entanglement where both camera and targets move freely in 3D; (2) SO-HOTA, a novel metric combining Dot Distance with HOTA to mitigate the sensitivity of IoU-based metrics to small displacements; and (3) a competitive MVA2025 challenge with 78 participants and 308 submissions, where the winning method achieved a 5.1× improvement over the baseline. This work lays a foundation for advancing SMOT in UAV scenarios with applications in bird strike avoidance, agriculture, fisheries, and ecological monitoring. † † footnotetext: † indicates the organizers of the Challenge. The other authors participated in the challenge. Appendix A contains the authors’ team names and affiliations. Figure 1 : Overview of the SMOT4SB dataset and evaluation metric. (Top) SMOT4SB extends the SOD4SB dataset [ 1 ] from SOD to SMOT in UAV scenarios, with 211 videos and 2,240 annotated tracks. (Bottom) We introduce SO-HOTA, which incorporates DotD [ 2 ] into the HOTA framework [ 3 ] to reduce over-sensitivity to minor localization errors. The comparison assumes a vertical displacement of x px from the ground truth, with a fixed bounding box size of 16 px. While conventional HOTA scores drop sharply to zero under minor displacements, SO-HOTA provides a more stable and discriminative evaluation for small object tracking. 1 Introduction Multi-Object Tracking (MOT) represents a fundamental computer vision task that extends object detection to temporal sequences, enabling continuous identification and localization of multiple target objects across video frames [ 4 , 5 ] . Significant progress has been achieved in general MOT scenarios through advances in detection-based tracking [ 6 , 7 ] , joint detection and tracking [ 8 , 9 ] , and transformer-based approaches [ 10 , 11 ] . Although these developments have improved overall MOT performance, Small Multi-Object Tracking (SMOT) remains a particularly challenging frontier. SMOT introduces unique technical complexities that distinguish it from conventional MOT frameworks. Objects spanning merely a few pixels suffer from severe information scarcity, making appearance-based association unreliable [ 12 , 13 ] . Background clutter and rapid scale changes exacerbate detection consistency problems, while traditional tracking methods exhibit significant performance degradation when object sizes fall below 32\times 32 pixels as established by MS COCO standards [ 14 ] . As a preliminary step toward SMOT, the organizers previously addressed the problem of small object detection by organizing the MVA2023 Small Object Detection Challenge for Spotting Birds (SOD4SB) [ 1 ] . Focused on UAV-based wild bird detection, SOD4SB demonstrated the feasibility of detecting small, distant, and fast-moving objects under real-world environmental conditions. With 223 participants, the challenge not only advanced small object detection but also suggested promising applications in autonomous UAV systems for avoiding bird strikes [ 15 ] , protection against bird-related damage in fields, aviation, and fisheries [ 16 , 17 , 18 ] , and ecological monitoring through automated bird population surveys [ 19 ] . However, SOD4SB’s constraint to single-frame detection fundamentally limited both the detection performance and practical system robustness. When appearance features are insufficient due to small object regions in each frame, detection becomes unreliable under challenging conditions such as occlusions, motion blur, and background clutter. This limitation directly constrains the reliability of subsequent tracking processes, as inconsistent detection forms a bottleneck for temporal association and identity preservation in SMOT scenarios. Building upon this foundation, the organizers extend SOD4SB to Small Multi-Object Tracking for Spotting Birds (SMOT4SB) to address the fundamental limitations of single-frame detection. SMOT4SB explores how temporal information can compensate for the information scarcity of small objects by integrating spatial and motion cues. This hypothesis is supported by recent work showing that motion-guided features from aligned video frames significantly improve small object detection when appearance cues are weak or missing [ 20 ] , consistent with the biological role of the dorsal stream in motion perception [ 21 ] . Moreover, SMOT4SB introduces a substantially more challenging and diverse computer vision problem setting that promotes methodological innovation. Unlike most conventional MOT and SMOT scenarios [ 5 , 22 , 23 , 24 ] that assume fixed cameras or objects constrained to planar motion, SMOT4SB presents a scenario where both the camera platform and the target objects move freely in three-dimensional space. This scenario requires consideration of what the organizers term motion entanglement —the intertwined state of ego-motion and subject motion that must be disentangled for effective tracking. Furthermore, the flocking behavior exhibited by some bird species introduces fascinating opportunities to model interactions between individual and collective motion dynamics, presenting compelling research questions from a Social Force Model perspective [ 25 , 26 ] . To realize this challenging problem setting, the organizers establish the research infrastructure necessary for the systematic exploration of SMOT4SB. While standard MOT benefits from well-established datasets and evaluation protocols, the unique characteristics of tracking small birds from UAV platforms require dedicated research foundations. The combination of extreme object scales, motion entanglement , and dynamic 3D environments presents distinct challenges that existing MOT resources cannot adequately address. Additionally, while SMOT research has largely adopted standard MOT evaluation metrics, the specific characteristics of small objects warrant reconsideration of these evaluation approaches. This work contributes to building a comprehensive research infrastructure and advancing algorithmic development through the following three key components: 1. SMOT4SB Dataset : The organizers introduce a large-scale dataset comprising 211 video sequences with 183,192 annotated frames, representing the first dataset specifically designed for small object tracking in UAV scenarios (Fig. 1 ). 2. SO-HOTA Metric : The organizers propose Small Object Higher Order Tracking Accuracy (SO-HOTA), the first evaluation metric specifically tailored for small object tracking tasks, which integrates the Dot Distance (DotD) measure [ 2 ] with the Higher Order Tracking Accuracy HOTA metric [ 3 ] to address the excessive sensitivity of IoU-based metrics to small object displacement (Fig. 1 ). 3. Comprehensive Benchmark : The organizers provide a competitive challenge with 78 participants and 308 submissions to explore technical approaches for