Using Cross-Domain Detection Loss to Infer Multi-Scale Information for Improved Tiny Head Tracking

Jisu Kim, Alex Mattingly, Eung-Joo Lee and Benjamin Riggan Department of Electrical and Computer Engineering, University of Nebraska-Lincoln, NE, USA Department of Electrical and Computer Engineering, University of Maryland, MD, USA Department of Electrical and Computer Engineering, University of Ar · 2025

Read Using Cross-Domain Detection Loss to Infer Multi-Scale Information for Improved Tiny Head Tracking by Jisu Kim, Alex Mattingly, Eung-Joo Lee and Benjamin Riggan Department of Electrical and Computer Engineering, University of Nebraska-Lincoln, NE, USA Department of Electrical and Computer Engineering, University of Maryland, MD, USA Department of Electrical and Computer Engineering, University of Ar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22677.txt.

Introduction

Jisu Kim and co-authors present a 2025 framework for tracking tiny heads in video. Head detection supports many later tasks, but strong methods often need large computing budgets that add delay and tie up hardware. The team aimed to raise accuracy for very small heads while keeping costs low.

Their framework joins three parts. A cross domain loss helps a small detector learn from a larger one. A multi scale module captures fine detail at several sizes during training. A small receptive field detector then spots the tiny heads themselves. Tests on two crowd data sets, CroHD and CrowdHuman, showed better tracking accuracy and detection scores. The authors present the approach as a fit for crowded scenes.

Catalog record

CREATORJisu Kim, Alex Mattingly, Eung-Joo Lee and Benjamin Riggan Department of Electrical and Computer Engineering, University of Nebraska-Lincoln, NE, USA Department of Electrical and Computer Engineering, University of Maryland, MD, USA Department of Electrical and Computer Engineering, University of Ar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-22677

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Using Cross-Domain Detection Loss to Infer Multi-Scale Information for Improved Tiny Head Tracking Jisu Kim, Alex Mattingly, Eung-Joo Lee and Benjamin Riggan Department of Electrical and Computer Engineering, University of Nebraska-Lincoln, NE, USA Department of Electrical and Computer Engineering, University of Maryland, MD, USA Department of Electrical and Computer Engineering, University of Arizona, AZ, USA Abstract Head detection and tracking are essential for downstream tasks, but current methods often require large computational budgets, which increase latencies and ties up resources (e.g., processors, memory, and bandwidth). To address this, we propose a framework to enhance tiny head detection and tracking by optimizing the balance between performance and efficiency. Our framework integrates (1) a cross-domain detection loss, (2) a multi-scale module, and (3) a small receptive field detection mechanism. These innovations enhance detection by bridging the gap between large and small detectors, capturing high-frequency details at multiple scales during training, and using filters with small receptive fields to detect tiny heads. Evaluations on the CroHD and CrowdHuman datasets show improved Multiple Object Tracking Accuracy (MOTA) and mean Average Precision (mAP), demonstrating the effectiveness of our approach in crowded scenes. I INTRODUCTION Head detection and tracking are critial prerequisite system components that are necessary for down-stream tasks, such as recognition, expression analysis, head pose estimation, gaze estimation, and person counting. However, the problem is that existing methods [ 10 , 25 , 45 ] often rely on large computational and energy resources (e.g., over 60 million parameters [ 25 ] , more than 100 Billion Floating-Point Operations Per Second (BFLOPs) [ 45 ] , or consuming upwards of 200 watts of power) [ 25 ] ), which imposes severe limitations and bottlenecks for down-stream tasks. Moreover, these resource-intensive detection and tracking methods further hinder system scalability when considering operating in crowded environments (with greater than 50 persons in the field of view) [ 18 , 33 ] . Thus, it is critical to achieve accurate detection and tracking across various resolutions, while also alleviating computational complexity (as shown in Figure 1 ). Current approaches in head detection and tracking focus on achieving high accuracy, often at the expense of computational efficiency. Methods like Single Shot MultiBox Detector (SSD) [ 29 ] , Faster R-CNN [ 34 ] , and RetinaNet [ 27 ] leverage deep neural networks to provide robust detection capabilities. However, these methods are computationally expensive, limiting their applicability in resource-constrained environments. Techniques such as Feature Pyramid Networks (FPNs) [ 26 ] and EfficientDet [ 39 ] have been developed to address multi-scale detection, yet they still require significant computational resources. Although there are existing “small” or efficient variants of detection architectures, such as recen You Only Look Once (YOLO) models [ 42 , 45 , 9 ] , these variants often exhibit significant reductions in performance. Moreover, these existing methods often under perform when detecting tiny objects due to (1) down-sampling large images and (2) designing detectors to have relatively larger receptive fields. Fig. 1: Comparison of head detection performance between the base models (top, middle) and our framework (bottom). The top model has high computational cost with good accuracy but lacks the small receptive field detection block, domain adaptation, and multi-scale processing. The middle model has lower computational cost but worse accuracy, and it also lacks these features. In contrast, our framework achieves better accuracy with lower computational cost by incorporating the small receptive field detection block, domain adaptation, and multi-scale processing. In contrast, our framework aims to balance performance and computational efficiency by leveraging a cross-domain detection loss, a multi-scale module, and small receptive field detection mechanism. The cross-domain detection loss function bridges the gap between large and small detectors, while the multi-scale module captures additional high-frequency details early in the detection pipeline. By computing multi-scale information only during training, our proposed framework is able to infer multi-scale information without increasing computational complexity during inference—effectively enhancing the performance and efficiency trade-off. Additionally, the inclusion of a small receptive field detection mechanism enables predictions from early layers, which exploits local, fine-grained information to promote robust detection of tiny heads. The key contributions of our framework include: • A new cross-domain detection loss —which promotes optimal performance from resource constrained models, • A new multi-scale module —that combines features from different input resolutions during training, enabling this information to be inferred by our domain adaptive detection framework without explicit computational overhead, • A newly integrated small receptive field detection mechanism —which promotes the robust detection of relatively smaller (i.e., tiny) heads in crowded environments. Moreover, our proposed framework employs a tracking by detection approach, which like recent tracking algorithms (e.g., ByteTrack [ 46 ] and Lee et al. [ 23 ] ), facilitates robust assignment of individual detection to consistent tracks. By enhancing the detection capabilities for tracking, our proposed framework achieves more accurate trajectory predictions using and improved tracking performance in real-time applications. In summary, our framework addresses the limitations of existing head detection and tracking models by improving accuracy while also reducing computational complexity. By incorporating a cross-domain detection loss, a multi-scale module, and a small receptive field mechanism, the framework achieves a balanced trade-off between performance and efficiency. The approach shows consistent improvements on challenging datasets like Crowd of Heads Dataset (CroHD) [ 38 ] and CrowdHuman [ 37 ] , proving effective for tiny head detection in crowded scenes and suitable for real-time use. II RELATED WORK In this section, existing approaches for head detection, head tracking, domain adaptation, and integrating multi-scale information are reviewed and contrasted with the proposed methodology. II-A Head Detection Prominent detection frameworks like SSD [ 29 ] and Faster R-CNN [ 34 ] balance speed and accuracy. Pyramid structures, such as FPN [ 26 ] and RetinaFace [ 15 ] , integrate features across layers for robust detection. Lightweight models like BlazeFace [ 4 ] are efficient for real-time applications. Efforts like Zhu et al. [ 49 ] and Chen et al. [ 13 ] enhance detection under challenging conditions using feature enhancement and adversarial learning. Our approach enhances tiny head detection by integrating multi-scale training and cross-domain loss to improve accuracy in occluded and varied lighting scenarios. II-B Head Tracking Tracking-by-detection generates bounding boxes per frame and associates them to create trajectories [ 2 ] . This technique is effective with deep learning-based object detection solutions [ 1 ] . Kalman filters [ 22 ] , particle filters [ 3 ] , and correlation filters like MOSSE [ 10 ] provide robust tracking. Recent deep learning advances, such as SiamFC [ 6 ] and DCF-CSR [ 32 ] , enhance tracking accuracy. Multi-object tracking algorithms, like SORT [ 7 ] and DeepSORT [ 44 ] , manage crowded scenes effectively. Methods like LDES [ 8 ] improve robustness under occlusions and varying lighting. YOLOv8 [ 42 ] offers high accuracy and speed for real-time applications, handling different resolutions and object sizes, even in crowded scenes. YOLOv8 employs three key loss functions for object detection: Complete Intersection over Union (CIoU) [ 48 ] loss, Distributed Focal Loss (DFL) [ 24 ] , and Binary Cross-Entropy (BCE) [ 19 ] loss. These losses are defined as follows L_{\text{CIoU}}=1-\text{IoU}+\frac{\rho^{2}(b,b_{gt})}{c^{2}}+\alpha v, (1) L_{DFL}=-((\hat{y}_{i+1}-y)\log(p_{i})+(y-\hat{y}_{i})\log(p_{i+1})), (2)

Read the complete text