Context Aware Grounded Teacher for Source Free Object Detection

Tajamul Ashraf, Rajes Manna, Partha Sarathi Purkayastha, Tavaheed Tariq, Janibul Bashir · 2025

Read Context Aware Grounded Teacher for Source Free Object Detection by Tajamul Ashraf, Rajes Manna, Partha Sarathi Purkayastha, Tavaheed Tariq, Janibul Bashir (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15404.txt.

Introduction

Tajamul Ashraf and co-authors propose Grounded Teacher, a framework for source-free object detection, in a 2025 paper. Source-free detection must adapt a model to a new domain without the original training data. Class imbalance and noisy pseudo-labels make teacher-student training unstable, and context bias is often ignored.

Grounded Teacher grounds the teacher through relational and semantic regularization. A relational context module tracks cross-domain bias with a moving average, while semantic augmentation boosts minority and confusable classes through adaptive MixUp. A semantic-aware loss steadies learning under biased pseudo-labels, and a frozen expert branch from large vision models refines label quality. The design targets more reliable detection, especially in medical data where rare classes matter.

Catalog record

CREATORTajamul Ashraf, Rajes Manna, Partha Sarathi Purkayastha, Tavaheed Tariq, Janibul Bashir
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE84 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-15404

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Context Aware Grounded Teacher for Source Free Object Detection Tajamul Ashraf, Rajes Manna, Partha Sarathi Purkayastha, Tavaheed Tariq, Janibul Bashir Abstract Source-free object detection (SFOD) faces persistent challenges due to class imbalance–driven context bias and instability in teacher–student training under noisy pseudo-labels. Existing techniques tend to ignore the context bias and class imbalance shift, especially in medical data. To tackle this, we propose Grounded Teacher ( GT ), a bias-aware source-free framework that grounds the teacher model through relational and semantic regularization.. To explicitly model directional confusions between classes, GT introduces a Relational Context Module (RCM), which maintains an exponential moving average (EMA) estimate of cross-domain contextual bias. Building upon this, a Semantic Augmentation (SA) strategy selectively augments minority and confusable classes through adaptive MixUp in both source-similar and source-dissimilar target regions, improving minority recall without overfitting dominant categories. To stabilize learning under biased pseudo-labels, we design a Semantic-Aware Loss (SAL) that applies diagonally normalized weights, preventing gradient explosion while emphasizing minority majority corrections. Additionally, a frozen Expert branch derived from large vision foundation models (LVFMs) serves as a supervisory reference during training, refining pseudo-label quality without adding inference overhead. GT’s behavior-driven bias quantification makes it broadly applicable across domains without relying on dataset priors. Evaluations on Cityscapes→Foggy (50.8 mAP) and medical transfers ( +5.9 AP 50 on DDSM→INBreast) show consistent gains and improved minority-class detection, with less than 12% additional training cost. Code and model are available at https://github.com/Tajamul21/Grounded-Teacher . keywords Generalization, Source-Free Domain Adaptation, Context Bias, Semi-Supervised Learning, Large Vision Foundation Models, Knowledge Distillation † † equal-contributors: These authors contributed equally to this work. † † equal-contributors: These authors contributed equally to this work. Accepted in International Journal of Computer Vision 1 Introduction Medical object detection is a well-studied problem in computer vision Carion et al. (2020) ; Dosovitskiy et al. (2020) ; Zhu et al. (2020) ; Zhang et al. (2022b) ; Yang et al. (2022a) . The success of deep learning techniques for the problem has been supported by the abundance of extensively annotated detection datasets Cordts et al. (2016b) ; Everingham et al. (2010) ; Geiger et al. (2013) ; Lin et al. (2014) ; Yu et al. (2020b) , which facilitates the supervised training of deep object detection models. However most of the medical data is not available due to policy and privacy reasons. Unsupervised Domain Adaptation ( UDA ) offers a strategy for adapting object detectors to new domains where labeled data is not available. This arises from the growing reliance on medical data, where annotations are not only expensive to obtain but also prone to errors in complex or ambiguous scenarios. It has been widely observed that deep object detection models often struggle to generalize to new visual domains despite their effectiveness in familiar visual contexts. UDA is a popular solution strategy Chen et al. (2017) ; Ganin et al. (2016) ; Hoffman et al. (2018) ; Hoffman et al. (2016) ; Lo et al. (2022) ; Saito et al. (2018) ; Tzeng et al. (2017) , which bridges the gap between source and target domains by aligning the feature distributions Chen et al. (2018b) ; He and Zhang (2019) ; Inoue et al. (2018) ; Saito et al. (2019b) ; VS et al. (2023a) ; Huang et al. (2022b) ; Zhao et al. (2023b) . However, the strategy requires access to source-domain data at the adaptation stage, which severely limits its applicability in medical imaging Liang et al. (2020) ; Liu et al. (2021) ; Xia et al. (2021) . This motivates us to focus on Source-Free Object Detection ( SFOD ) in this work. Source-free domain Adaptation ( SFDA ) has received significant attention for the image classification task in recent years Yang et al. (2022b) ; Zhang et al. (2022c) ; Wang et al. (2022) ; Jing et al. (2022) ; Dong et al. (2021) ; Huang et al. (2021) ; Yang et al. (2021) . However, there are relatively fewer works specifically addressing SFOD Huang et al. (2021) ; VS et al. (2023b) ; Oza et al. (2023) ; Liu et al. (2023) ; Chu et al. (2023) . Given the complexities of cluttered backgrounds, viewpoint variations, and a large number of negative samples in medical images, directly applying conventional SFOD methods for classification tasks to object detection in medical imaging leads to unsatisfactory performance. As these methods ignore the critical issue of context imbalance, which is a problem in many real-life scenarios, such as medical imaging. Thus, there is a need to develop SFOD techniques specially tailored for medical imaging due to clinical relevance Ashraf et al. (2024) . Figure 1: Effect of pseudo-label noise and EMA drift. Visualization of target-domain detections (Cityscapes \rightarrow Foggy) over training epochs for (a) Mean Teacher (ST), (b) its source-free variant (SF-ST), and (c) Grounded Teacher (GT). Our framework maintains spatially consistent, low-noise predictions through its RCM, SA/SAL, and expert supervision, mitigating drift and improving stability. Moreover, many popular SFOD techniques utilize a self-supervised approach in a student-teacher ( ST ) framework. These methods bootstrap by training on pseudo-labels generated by a source-pretrained model Li et al. (2022a) ; Xiong et al. (2021a) ; Li et al. (2021) ; Chu et al. (2023) ; Vs et al. (2022) . However, if the source data is biased or the domain shift between source and target domains is significant, there is noise in the pseudo-labels, which impacts the training of a student model Deng et al. (2021) . Since the pseudo-label error is significant, the Exponential Moving Average ( EMA ) step, which updates the teacher model from the student model’s weight, ends up corrupting the teacher model as well, leading to an exploding grading and model collapses Ali et al. (2024) . This phenomenon of progressive degradation, especially in source-free settings where source data is not available during adaptation, is visually evident in Figure 1 , where traditional Mean Teacher frameworks and SF-Student-Teacher frameworks suffer from declining detection quality over time, while our method remains robust over the epochs. Prior works have documented pseudo-label noise and EMA instabilities in teacher–student adaptation, including in SFOD baselines and variants inspired by Unbiased Teacher/Mean-Teacher families VS et al. (2023a) . Our contribution is not simply the observation of these issues, but a coherent, source-free solution to address them. In this paper, we introduce our Grounded Teacher ( GT ), specifically designed to tackle context imbalance and mode collapse in the SFOD setting, which comprises a behavioral confusion estimator (RCM) with dual use in data-space augmentation (SA) and loss-space reweighting (SAL), along with training-only LVFM Expert guidance to stabilize the teacher. Together, these mechanisms target context bias and teacher drift without any source images or inference-time cost. This is typically not a problem in the UDA setting, as supervised data from the source domain acts as an anchor and prevents error accumulation in the student. Then the EMA step ensures that the teacher model does not get corrupted at any point in the adaptation. The Relation-Contextual Module ( RCM ) explicitly models class biases and inter-class dynamics within the training data. Leveraging prior insights, we implement a semantic augmentation strategy that enhances minority class representation by

Read the complete text