Is Intermediate Fusion All You Need for UAV-based Collaborative Perception?

Jiuwu Hao, Liguo Sun, Yuting Wan, Yueyang Wu, Ti Xiang, Haolin Song, Pin Lv · 2025

Read Is Intermediate Fusion All You Need for UAV-based Collaborative Perception? by Jiuwu Hao, Liguo Sun, Yuting Wan, Yueyang Wu, Ti Xiang, Haolin Song, Pin Lv (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-21774.txt.

Introduction

Jiuwu Hao and six co-authors ask whether intermediate fusion is all that drone-based collaborative perception needs, in work from 2025. Teams of unmanned aerial vehicles can share what they sense, but older methods ignore the drone view and cost much bandwidth. Their framework, called LIF, is built on late-intermediate fusion.

LIF shares compact detection results, then fuses at the feature level. Vision-guided positional embedding and a box-based virtual feature method merge data from distinct agents. An uncertainty-driven rule selects only high-quality areas to share. Tests show strong results with minimal bandwidth, which the authors present as proof of both effectiveness and practicality. Code and models are shared online.

Catalog record

CREATORJiuwu Hao, Liguo Sun, Yuting Wan, Yueyang Wu, Ti Xiang, Haolin Song, Pin Lv
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-21774

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Is Intermediate Fusion All You Need for UAV-based Collaborative Perception? Jiuwu Hao, Liguo Sun, Yuting Wan, Yueyang Wu, Ti Xiang, Haolin Song, Pin Lv Abstract Collaborative perception enhances environmental awareness through inter-agent communication and is regarded as a promising solution to intelligent transportation systems. However, existing collaborative methods for Unmanned Aerial Vehicles (UAVs) overlook the unique characteristics of the UAV perspective, resulting in substantial communication overhead. To address this issue, we propose a novel communication-efficient collaborative perception framework based on late-intermediate fusion, dubbed LIF . The core concept is to exchange informative and compact detection results and shift the fusion stage to the feature representation level. In particular, we leverage vision-guided positional embedding (VPE) and box-based virtual augmented feature (BoBEV) to effectively integrate complementary information from various agents. Additionally, we innovatively introduce an uncertainty-driven communication mechanism that uses uncertainty evaluation to select high-quality and reliable shared areas. Experimental results demonstrate that our LIF achieves superior performance with minimal communication bandwidth, proving its effectiveness and practicality. Code and models are available at https://github.com/uestchjw/LIF . I INTRODUCTION Vision-centric 3D object detection is a fundamental requirement for modern transportation systems, which helps robotic agents to achieve accurate and robust understanding of the surrounding environment. Perception system based on Unmanned Aerial Vehicles (UAVs), offering broader sensing range and enhanced deployment flexibility compared to vehicle- or roadside-based solutions, has attracted rising attention from both academia and industry [ 1 , 2 , 3 ] . To address the limitations of single-agent perception, collaborative perception has emerged as a new paradigm that integrates complementary information from multiple agents to improve environmental awareness [ 4 , 5 ] . Therefore, multi-UAV collaborative perception holds significant potential for advancing intelligent transportation systems. Communication efficiency is essential in practical collaborative systems. Most existing multi-UAV collaborative perception methods focus on intermediate fusion strategies [ 6 , 7 , 8 , 9 , 10 ] , which originate from the autonomous driving domain, and involve transmitting and fusing neural features to optimize the performance-bandwidth trade-off. However, these methods overlook the unique characteristics of UAV platforms, resulting in unnecessary communication overhead. First, compared to vehicle-mounted or roadside devices, the limited communication capacity and computational resources of UAVs impose stricter constraints on transmission bandwidth. While extensive works have been devoted to improving communication efficiency [ 11 , 12 , 13 , 14 , 15 ] , the high-dimensional nature of intermediate features inevitably leads to substantial bandwidth consumption. Second, operating at higher altitude with reduced occlusion, UAVs provide more accurate predictions than ground-based perspectives. This makes efficient collaboration based on the exchange of detection results a feasible solution, as the outputs already contain sufficient and reliable scene information. Thus, the question is raised: Is intermediate fusion all we need for UAV-based collaborative perception? In this work, we propose a novel late-intermediate fusion framework, dubbed LIF , to reduce communication redundancy in collaborative perception. The core idea is to transmit compact perception results among collaborating agents and integrate them with the ego-agent’s intermediate features through a learnable approach; see Fig. 1 . By shifting the fusion stage, we mitigate the information loss and performance degradation commonly associated with late fusion. Moreover, each agent transmits only predictions, alleviating the heavy communication overhead of intermediate fusion. Specially, LIF consists of three key components: i) Vision-guided positional embedding VPE, which leverages 2D perception results to refine spatial attention, enabling the model to focus more on critical regions; ii) Box-based virtual augmented feature BoBEV, which effectively integrates complementary information from other agents into the Bird’s-Eye-View (BEV) representation; iii) Uncertainty-driven communication, which filters high-quality and trustworthy perception outputs through uncertainty estimation. To validate the effectiveness of our LIF , we conduct extensive experiments on the multi-UAV collaborative perception dataset UAV3D [ 7 ] . Experimental results show that LIF outperforms state-of-the-art (SOTA) methods with minimal communication overhead, achieving 72.1% mAP and 61.4% NDS. Fig. 1 : Comparison of various collaborative strategies. (a) Intermediate fusion exchanges and aggregates high-dimensional neural features among agents, resulting in substantial communication overhead. (b) Late fusion focuses on integrating detection results directly, which leads to the scene information loss and degraded performance. (c) Our proposed late-intermediate fusion ( LIF ) shares compact prediction outputs and incorporates them into the ego-agent’s BEV features, effectively reducing communication redundancy while maintaining perception performance. In summary, our contributions are as follows: • We present a novel late-intermediate fusion framework for multi-UAV collaborative perception, namely LIF , which significantly reduces communication redundancy while maintaining detection performance. • We propose two feature enhancement modules, vision-guided positional embedding VPE and box-based virtual augmented feature BoBEV, which facilitate the effective integration of complementary information. • We design a novel uncertainty-driven communication mechanism, which prioritizes high-quality and reliable perception outputs during information exchange process. • Extensive experiments show that LIF achieves superior performance with minimal communication bandwidth, demonstrating its feasibility in real-world collaborative scenarios. II RELATED WORKS Collaborative Perception. As an emerging perception paradigm of multi-agent cooperation, collaborative perception has attracted widespread attention [ 16 , 5 , 17 , 18 ] . Collaborative perception can be categorized into early fusion, intermediate fusion, and late fusion based on the cooperation stage. Early fusion [ 19 ] transmits raw sensor data, such as images or point clouds, which preserves the most complete perception information but consumes a large amount of transmission bandwidth. Late fusion [ 4 ] shares each agent’s perception results, using minimal communication volume, but can lead to a degradation in perception performance. Most prevailing works explore intermediate fusion [ 20 , 21 , 22 ] , where implicit features from intermediate layers are exchanged among collaborating agents, aiming to achieve a trade-off between performance and bandwidth. Recently, several studies [ 7 , 6 , 9 , 8 ] introduce UAVs into collaborative perception system in urban traffic scenarios. Similarly, in this work, we focus on multi-UAV collaboration and propose a pragmatic and robust cooperative framework to enhance communication efficiency. Communication-efficient Collaboration. Due to the stringent limitation on transmission capacity in real-world applications, previous studies are dedicated to developing efficient communication strategies to reduce bandwidth usage. Traditional intermediate fusion methods that transmit BEV feature maps primarily reduce transmission overhead through the selection of collaborators [ 13 , 14 ] , spatial filtering [ 12 , 23 , 24 , 25 ] , and compression of message representations [ 26 , 20 , 11 ] . Another branch of methods reduces communication redundancy by transmitting instance-level query features [ 27 , 21 ] . However, operating at the feature level inherently leads to the transmission of high-dimensional information, which inevitably incurs significant communication cost. A contemporaneous work, Which2comm [ 15 ] , proposes leveraging bounding-box-based object-level sparse features, but it still transmits redundant hidden features. The work most closest to our approach is CoSDH [ 28 ] , which introduces a late-intermediate hybridization mode to address the challenge of limited communication bandwidth. However, it does not fully integrate the detection results between agents. In contrast to these prior works, we propose transmitting only detection results and introduce a novel fusion method to effectively extract and integrate semantic information among collaborators. III METHODOLOGY Fig. 2 : The overall architecture of the proposed LIF . Each

Read the complete text