CD-FKD: Cross-Domain Feature Knowledge Distillation for Robust Single-Domain Generalization in Object Detection
Junseok Lee, Sungho Shin, Seongju Lee, Kyoobin Lee · 2026
Read CD-FKD: Cross-Domain Feature Knowledge Distillation for Robust Single-Domain Generalization in Object Detection by Junseok Lee, Sungho Shin, Seongju Lee, Kyoobin Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16439.txt.
Introduction
Lee and co-authors harden object detectors against domain shift with CD-FKD. A detector trained on one domain often fails under new weather or light. Their method distills features from a teacher into a student. The teacher sees clean source images. The student trains on downscaled and corrupted copies. Matching happens at both global and instance levels. Tests on hard scenes beat prior methods on new domains. Source-domain scores also improved.
Catalog record
| CREATOR | Junseok Lee, Sungho Shin, Seongju Lee, Kyoobin Lee |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34815 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.16439
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CD-FKD: Cross-Domain Feature Knowledge Distillation for Robust Single-Domain Generalization in Object Detection Junseok Lee, Sungho Shin, Seongju Lee, Kyoobin Lee Abstract Single-domain generalization is essential for object detection, particularly when training models on a single source domain and evaluating them on unseen target domains. Domain shifts, such as changes in weather, lighting, or scene conditions, pose significant challenges to the generalization ability of existing models. To address this, we propose Cross-Domain Feature Knowledge Distillation (CD-FKD), which enhances the generalization capability of the student network by leveraging both global and instance-wise feature distillation. The proposed method uses diversified data through downscaling and corruption to train the student network, whereas the teacher network receives the original source domain data. The student network mimics the features of the teacher through both global and instance-wise distillation, enabling it to extract object-centric features effectively, even for objects that are difficult to detect owing to corruption. Extensive experiments on challenging scenes demonstrate that CD-FKD outperforms state-of-the-art methods in both target domain generalization and source domain performance, validating its effectiveness in improving object detection robustness to domain shifts. This approach is valuable in real-world applications, like autonomous driving and surveillance, where robust object detection in diverse environments is crucial. I INTRODUCTION In recent years, deep learning-based object detection technologies have made remarkably advanced, playing a critical role in various visual perception tasks [ 2 , 24 , 17 , 16 ] . These technologies achieve strong performance when the training and testing data share the same domain distribution, but this is rarely the case in real-world scenarios. In fields such as autonomous driving, industrial automation, and video surveillance, environmental changes caused by lighting, weather, or time of day result in domain shifts, which significantly degrade the performance of trained models [ 9 , 25 ] . To address this, methodologies such as unsupervised domain adaptation (UDA) [ 19 , 4 ] and domain generalization (DG) [ 3 , 14 ] have been proposed. UDA aligns data distributions between the source and target domains to ensure model performance. However, it requires access to target domain data, limiting its ability to generalize across environments. DG focuses on training models to maintain performance on unseen target domains by leveraging diverse source domain data, making it a more challenging problem compared with UDA. Traditional DG methods aim to learn shared representations across multiple source domains or enhance data diversity via augmentation. However, these approaches often need multiple source domains, which can be impractical owing to time and cost constraints. Fig. I: Overview of results of our proposed CD-FKD. The top panel qualitatively compares our method with DivAlign [ 7 ] and Faster R-CNN [ 26 ] , on an Dusk-Rainy. The bottom panel shows a radar chart comparing relative performance. Single-domain generalization (SDG) focuses on improving performance across diverse target domains using only a single source domain, offering a practical solution to the challenges of domain generalization [ 33 , 30 ] . Unlike domain generalization (DG) methods, which require multiple source domains or domain-level annotations and thus increase complexity, SDG reduces both data requirements and costs. Traditional approaches typically rely on data augmentation and feature disentanglement. Feature disentanglement separates domain-invariant (object-centric) features from domain-specific (background-centric) features, using only the invariant features for object detection. However, this neglects the surrounding background, limiting the detector’s ability to understand the full context of the image. Although data augmentation can improve generalization across environments, it has been shown to reduce performance on the source domain [ 15 ] . To address these issues, the proposed method enables the detector to extract object-centric features while maintaining a comprehensive understanding of the image’s context. This not only enhances generalization performance on target domains but also improves detection on the source domain. We propose a novel methodology that effectively operates across both the source and target domains by understanding causal features and learning the global context of images. To achieve this, we introduce C ross- D omain F eature K nowledge D istillation (CD-FKD) for single domain generalized object detection. The proposed method comprises two core components: (1) cross-domain knowledge distillation (KD) framework and (2) cross-domain feature distillation loss. The cross-domain KD framework bridges domain gaps between teacher and student networks. The teacher network receives original source domain data, whereas the student network learns from diversified source data with various scales and corruptions. The primary goal of CD-FKD is to train the network to effectively extract object-centric features even in data with various distortions. The proposed feature distillation process comprises two key steps: (1) global feature distillation, which enables the network to learn the global context of an image and (2) instance-wise feature distillation, which helps the network focus on object-specific features. The instance-wise feature distillation component ensures that the network effectively extracts object-centric features, whereas the global feature distillation component focuses on learning the overall context of the image. These distillation techniques prevent the network from overfitting to a specific domain and enable robust learning under various distortion conditions. Consequently, the student network is capable of performing reliably under diverse distortions while maintaining strong performance on the source domain data. This approach enhances the generalization between the source and target domains, enabling robust object detection across a wide range of domain environments. As illustrated in Figure I , the proposed method achieves superior SDG performance compared with state-of-the-art (SOTA) methods. In summary, the main contributions of this study are as follows: • We propose CD-FKD, a novel cross-domain FKD method for single-domain generalized object detection. • We evaluate the proposed method against other SDG approaches on the SDG benchmark dataset and demonstrate that the proposed method outperforms previous methods. Also, we present comprehensive analyses that contribute to an improved understanding of the proposed framework. II Related Work II-A Single Domain Generalization SDG focuses on training models with a single source domain while ensuring they generalize well to unseen target domains, a key task when collecting data from multiple domains is difficult. SDG methods are divided into data augmentation [ 29 , 33 ] and domain-invariant feature learning [ 34 ] . Data augmentation generates synthetic samples to improve robustness against distribution shifts, whereas domain-invariant feature learning aims to extract stable features across domains. Recent studies on single-domain generalized object detection have progressed with methods such as S-DGOD [ 34 ] , which uses contrastive learning and self-distillation to improve generalization. CLIP-Gap [ 28 ] leverages CLIP for text-based augmentations to enhance object detection without requiring target domain data. G-NAS [ 35 ] reduces overfitting using differentiable NAS and OoD-aware G-loss. UFR [ 21 ] improves generalization with scene-level causal attention and object-level prototypes. Danish et al. [ 7 ] introduced carefully selected augmentations to diversify the source domain and a classification and localization alignment method to enhance out-of-domain detections. Li et al. [ 18 ] proposed a dynamic object-centric perception network with prompt learning to adapt to image complexity and improve cross-domain generalization. Despite these advancements, we propose a novel cross-domain feature distillation approach within a knowledge distillation (KD) framework that outperforms existing methods. Fig. II: Illustration of the proposed single-domain generalized object detection using cross-domain FKD. As a KD framework, the frozen teacher network (represented