Class-Adaptive Cooperative Perception for Multi-Class LiDAR-based 3D Object Detection in V2X Systems
Blessing Agyei Kyem, Joshua Kofi Asamoah, Armstrong Aboah · 2026
Read Class-Adaptive Cooperative Perception for Multi-Class LiDAR-based 3D Object Detection in V2X Systems by Blessing Agyei Kyem, Joshua Kofi Asamoah, Armstrong Aboah (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10305.txt.
Introduction
Kyem, Asamoah, and Aboah propose class-tuned cooperative view for many-class 3D object detection from LiDAR. Most joint finders fuse all classes alike, missing the shape of small and large objects, and narrow tests stress single classes. Their model joins multi-size window focus with scale routing, split fusion for small and large objects, top boost, and even weighting. On the benchmark across five teamwork settings, it beats middle rivals, with the largest gains on trucks, clear gains on walkers, and close results on cars.
Catalog record
| CREATOR | Blessing Agyei Kyem, Joshua Kofi Asamoah, Armstrong Aboah |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72199 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.10305
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Class-Adaptive Cooperative Perception for Multi-Class LiDAR-based 3D Object Detection in V2X Systems Blessing Agyei Kyem, Joshua Kofi Asamoah, Armstrong Aboah Abstract Cooperative perception enables connected vehicles and roadside infrastructure to share sensor observations, producing a fused scene representation that surpasses what any single platform can perceive alone. However, most cooperative 3D object detectors apply a uniform fusion strategy across all object categories, limiting their ability to accommodate the distinct geometric and sampling characteristics of different classes. This limitation is compounded by narrow evaluation protocols that typically focus on a single dominant class or a restricted set of cooperation patterns, leaving reliable multi-class detection across diverse vehicle-to-everything interaction modes insufficiently addressed. To bridge this gap, this paper presents a class-adaptive cooperative perception architecture for multi-class 3D object detection using LiDAR data. The architecture introduces four integrated components: multi-scale window attention with learned scale routing to capture features at varying spatial scales, a class-specific fusion stage that directs small and large objects through separate attentive pathways, bird’s-eye-view enhancement through parallel dilated convolution and channel recalibration for multi-resolution context, and class-balanced objective weighting to counteract bias toward frequent categories. Extensive experiments on the V2X-Real benchmark span vehicle-centric, infrastructure-centric, vehicle-to-vehicle, infrastructure-to-infrastructure, and vehicle-to-infrastructure cooperation settings, with identical backbone and training configurations across all compared methods. The proposed system consistently outperforms strong intermediate-fusion baselines in mean detection quality, achieving the largest improvements on trucks, clear gains for pedestrians, and competitive performance on cars. These findings demonstrate that aligning fusion and feature extraction with class-dependent geometry and point density yields more balanced cooperative perception in realistic vehicle-to-everything deployments. I Introduction Autonomous driving has emerged as one of the most transformative technologies in intelligent transportation systems, with perception serving as the foundational module upon which planning and control decisions critically depend [ 9 ] . Despite significant advances in sensor technology and deep learning, single-agent perception remains fundamentally limited by occlusions, finite sensor range, and environmental clutter [ 36 ] . Cooperative perception has emerged as a promising paradigm to overcome these limitations, enabling connected vehicles and roadside infrastructure to share perceptual information and collectively construct a more complete understanding of the surrounding environment [ 9 , 37 ] . The success of this paradigm hinges on how effectively multiple agents fuse and utilize one another’s sensor data. Vehicle-to-Everything (V2X) cooperative perception systems address this challenge by fusing sensor data from multiple agents, including vehicles and infrastructure, through strategies ranging from early feature-level fusion to late object-level fusion [ 36 , 6 ] . Among these strategies, intermediate fusion has demonstrated strong detection performance [ 9 ] . Nevertheless, the field exhibits two important gaps. First, most existing work evaluates cooperative perception under a limited subset of collaboration modes, typically vehicle-to-vehicle (V2V) or vehicle-to-infrastructure (V2I), rather than across the full spectrum of real-world V2X scenarios, which encompasses vehicle-centric (VC), infrastructure-centric (IC), vehicle-to-vehicle (V2V), infrastructure-to-infrastructure (I2I), and vehicle-to-infrastructure (V2I) configurations [ 33 ] . Compounding this limitation, cooperative 3D object detection has remained largely vehicle-centric: widely adopted benchmarks such as OPV2V [ 37 ] and V2XSet [ 36 ] target vehicle detection exclusively, and the majority of methods [ 23 , 27 , 1 ] are designed and evaluated with vehicles as the primary object class, leaving multi-class scenarios involving pedestrians, trucks, and other categories underexplored. Second, and more fundamentally, these methods apply a uniform fusion strategy to all object classes, treating vehicles, pedestrians, and trucks identically despite their vastly different spatial scales, LiDAR return densities, and localization requirements [ 36 , 9 ] . This one-size-fits-all design may be suboptimal when object classes exhibit heterogeneous detection characteristics, and benchmark results lend support to this concern [ 24 ] . Empirical evidence reveals pronounced performance disparities across classes [ 19 , 44 , 2 ] . Vehicles, which occupy larger regions in bird’s-eye view and receive abundant LiDAR returns, achieve relatively high detection accuracy [ 15 , 38 , 40 ] . In contrast, pedestrians and trucks, representing smaller and larger scales respectively, often underperform [ 25 ] . These disparities arise from several factors: small objects are compressed into roughly a single feature cell by typical backbone downsampling [ 18 , 43 ] ; sparse LiDAR coverage yields weaker feature responses for compact targets [ 28 ] ; and vehicle-dominated datasets cause gradient signals from underrepresented classes to be overwhelmed during optimization. In light of such heterogeneity, the uniform-fusion assumption, that a single processing strategy suffices for all classes, appears inadequate. Yet to our knowledge, class-adaptive or class-specific fusion mechanisms for V2X cooperative perception remain largely unexplored [ 9 ] . These problems motivate our central hypothesis: tailoring the fusion architecture and training objectives to the distinct requirements of different object classes can yield meaningful improvements in multi-class detection performance. To test this hypothesis, we propose a class-adaptive cooperative perception architecture that integrates four design principles into a unified framework. To align receptive fields with the spatial extent of each object class, the architecture employs multi-scale window attention. It further incorporates a class-specific fusion block that routes features through dedicated attention pathways tailored to small and large objects, a multi-scale bird’s-eye view (BEV) enhancement module that captures context at multiple receptive scales, and a class-balanced loss that up-weights gradients from underrepresented classes during training [ 19 ] . We evaluate this architecture on the V2X-Real dataset [ 33 ] , the first large-scale real-world benchmark for V2X cooperative perception, across all five cooperation modes: VC, IC, V2V, I2I, and V2I. Under this evaluation protocol, the architecture achieves consistent improvements in mean average precision (mAP) across all cooperation types and object classes. Our contributions are summarized as follows: • We propose a cooperative perception architecture that routes features through class-adaptive attention pathways, addressing the uniform-fusion assumption of existing V2X methods and improving multi-class detection performance. • We integrate multi-scale window attention and multi-scale BEV enhancement, improving localization across object classes with disparate spatial scales. • We adopt a class-balanced loss to counteract dataset imbalance, leading to gains for underrepresented classes while maintaining or improving overall mAP. • We conduct comprehensive experiments on V2X-Real across all five cooperation types (VC, IC, V2V, I2I, V2I), providing detailed ablation studies and an analysis of class-specific performance and resolution limitations. The remainder of this paper is organized as follows. Section II reviews related work. Section III presents our class-adaptive architecture. Section IV describes the experimental setup. Section V provides comparative results, ablations, and analysis. Section VI concludes the paper. II Related Work This section reviews prior work relevant to class-adaptive cooperative perception for multi-class 3D object detection. Section II-A surveys V2X cooperative perception methods and benchmarks. Section II-B examines multi-class 3D object detection challenges and solutions. Section II-C discusses class-adaptive and attention-based architectures. II-A V2X Cooperative Perception Cooperative perception addresses the inherent limitations of single-agent systems (occlusions, limited sensing range, and sparse distant observations) by enabling connected vehicles and roadside infrastructure to share sensory information through Vehicle-to-Everything (V2X) communication [ 6 , 37 , 9 ] . The design space is shaped by fusion strategy: early fusion aggregates raw sensor data [ 1 ] , late fusion merges independent detections [ 1 ] , and intermediate fusion shares learned features [ 6