FedExchange : Bridging the Domain Gap in Federated Object Detection for Free

Haolin Yuan, Jingtao Li, Weiming Zhuang Chen Chen Lingjuan Lyu · 2025

Read FedExchange : Bridging the Domain Gap in Federated Object Detection for Free by Haolin Yuan, Jingtao Li, Weiming Zhuang Chen Chen Lingjuan Lyu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-10503.txt.

Introduction

Haolin Yuan and four co-authors present FEDEXCHANGE, a federated object detection framework, in this 2025 computer vision study. Federated learning lets many clients train one shared detector without pooling their private images, but a model trained on sunny streets may stumble in the rain. Bridging that domain gap usually costs the edge devices extra computation, which they can ill afford.

FEDEXCHANGE moves the fix to the server. Rounds alternate between ordinary model aggregation and model exchange, where local models are clustered by distance and swapped so each client learns from other domains' models, never from raw data. Clients do no extra work. Tests show mean average precision up to 1.6 times better in hard domains like rainy scenes, while using only four-fifths of the baseline computation.

Catalog record

CREATORHaolin Yuan, Jingtao Li, Weiming Zhuang Chen Chen Lingjuan Lyu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-10503

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FedExchange : Bridging the Domain Gap in Federated Object Detection for Free Haolin Yuan, Jingtao Li, Weiming Zhuang Chen Chen Lingjuan Lyu Abstract Federated Object Detection (FOD) enables clients to collaboratively train a global object detection model without accessing their local data from diverse domains. However, significant variations in environment, weather, and other domain-specific factors hinder performance, making cross-domain generalization a key challenge. Existing FOD methods often overlook the hardware constraints of edge devices and introduce local training regularizations that incur high computational costs, limiting real-world applicability. In this paper, we propose FedExchange , a novel FOD framework that bridges domain gaps without introducing additional local computational overhead. FedExchange employs a server-side dynamic model exchange strategy that enables each client to gain insights from other clients’ domain data without direct data sharing. Specifically, FedExchange allows the server to alternate between model aggregation and model exchange. During aggregation rounds, the server aggregates all local models as usual. In exchange rounds, FedExchange clusters and exchanges local models based on distance measures, allowing local models to learn from a variety of domains. As all operations are performed on the server side, clients can achieve improved cross-domain utility without any additional computational overhead. Extensive evaluations demonstrate that FedExchange enhances FOD performance, achieving 1.6 × \times better mean average precision in challenging domains, such as rainy conditions, while requiring only 0.8 × \times the computational resources compared to baseline methods. Introduction Federated Learning (FL) ( McMahan et al. 2023 ; Yang et al. 2023 ; Li et al. 2020b ; Yuan et al. 2022 ; Yuan et al. 2024 ; Shokri and Shmatikov 2015 ) is a privacy-aware learning framework that facilitates collaborative training among clients while maintaining data locality and privacy. Over recent years, FL has shown great potential in diverse fields, including healthcare for predictive diagnostics ( Yuan et al. 2024 ; Xu et al. 2021 ; Nguyen et al. 2022 ), finance for fraud detection ( Zheng et al. 2021 ; Zhang et al. 2022 ), and various computer vision applications ( Zhuang et al. ; Sun et al. 2021 ). Although FL has been widely adopted in various computer vision tasks, its application to object detection ( He et al. 2022a ; Zheng et al. 2020 ) presents distinct challenges and remains largely under-explored. Object detection is an important task for numerous high-impact applications, including autonomous driving ( Hu et al. 2023 ), surveillance systems ( Oh et al. 2011 ; Yang et al. 2024 ), augmented reality ( Lepetit and Berger 2000 ; Liu et al. 2020 ), and robotics ( Maiettini et al. 2020 ; Coates and Ng 2010 ). Unlike classification or segmentation, object detection demands precise localization and recognition of multiple objects, often at varying scales and spatial configurations. These requirements introduce substantial algorithmic and computational complexity. In addition, the annotation process for object detection is highly labor-intensive, as it involves detailed bounding box annotations for each object instance. This overhead often results in limited labeled data, which in turn hinders the generalization ability of models across diverse domains and real-world scenarios. Given these challenges, federated learning (FL) presents a promising paradigm by enabling collaborative model training across distributed data silos without sharing raw data. However, the presence of significant domain heterogeneity among clients makes its application to object detection particularly complex. In contrast to classification tasks—where heterogeneity often arises from differences in class distribution—object detection encounters more profound discrepancies in visual characteristics. For example, data captured by autonomous vehicles or surveillance systems can vary dramatically in viewpoints, geographic locations, and environmental conditions ( He et al. 2022a ; Deng et al. 2023 ; Li et al. 2022 ; Zheng et al. 2020 ) . Such domain-specific variations pose substantial challenges for conventional FL algorithms, highlighting the necessity of designing FL frameworks specifically tailored to the demands of object detection. Figure 1: Comparison of memory and communication costs between (1) traditional FL settings using foundation models with fully learnable backbones and decoders, (2) lightweight models such as MobileNet, and (3) our practical federated object detection (FOD) setting with a frozen backbone and learnable decoder. Notably, a fully learnable ViT-adapter plus decoder setup incurs approximately 7× the GPU memory usage and 3× the communication cost compared to our proposed setting. Existing approaches ( Kim et al. 2024 ) primarily focus on training a generalized model that performs reasonably well across diverse client domains. However, due to the inherent variability in cross-domain data and the nature of weighted model aggregation, clients with limited or significantly different data distributions are often marginalized. As demonstrated in our evaluation (Section Experiments ), after the global aggregation, a client in a cross-domain person detection task achieves only 13.58 mean average precision (mAP), compared to the global mAP of 30.57, revealing considerable disparities in model performance. Moreover, current work ( Kim et al. 2024 ) overlooks the practical constraints imposed by real-world federated object detection settings. Edge devices, which are commonly used in such deployments, often lack the capacity to train even lightweight object detection models. Although models like MobileNet-V2 ( Sandler et al. 2019 ) paired with SSDlite ( Liu et al. 2016 ) are designed for efficiency, devices such as the Nvidia Jetson Nano ( Swaminathan, Silver, and Akilan 2024 ) can barely support training them. Despite the small model footprint, Figure 1 shows that GPU memory consumption becomes prohibitive when training on batches of 16 with 480 \times 640 resolution images, largely due to the computational demands of backpropagation. These limitations underscore the importance of developing FL systems that are both domain-adaptive and computationally efficient. With the emergence of foundation models (FMs) in vision ( Zhuang, Chen, and Lyu 2023 ) , which exhibit strong adaptability across diverse visual domains and tasks, we propose a practical setting that addresses key real-world constraints. In our framework, a foundation model backbone is first distributed to all clients. Each client then initializes a local object detection decoder for training and participates in federated aggregation. As illustrated in Figure 1 , freezing the FM backbone introduces minimal GPU memory overhead, resulting in consumption comparable to that of MobileNet-V2, while retaining the advanced feature extraction capabilities of the FM. This setup offers two key benefits: it significantly reduces computational costs and lowers communication overhead, making the framework particularly suitable for deployment in edge-based federated object detection scenarios. Additionally, the decoder—typically composed of a Region Proposal Network (RPN) head and a Region of Interest (RoI) head—provides more effective feature extraction than the linear layers commonly used in classification tasks. This motivates the development of a practical and efficient solution tailored to federated object detection (FOD). We introduce FedExchange , a novel FOD framework designed to improve model performance across heterogeneous domains without introducing additional computational overhead on clients. The key innovation of FedExchange is a dynamic model exchange mechanism that enables models to acquire cross-domain knowledge through a server-side, cluster-based exchange strategy. After clients upload their decoder weights, the global server decides whether to perform aggregation or model exchange. For aggregation, FedExchange follows the standard FedAvg protocol ( McMahan et al. 2023 ) . For model exchange, the server clusters decoders based on a distance metric and

Read the complete text