Fusion4CA: Boosting 3D Object Detection via Comprehensive Image Exploitation
Kang Luo, Xin Chen, Yangyi Xiao, Hesheng Wang · 2026
Read Fusion4CA: Boosting 3D Object Detection via Comprehensive Image Exploitation by Kang Luo, Xin Chen, Yangyi Xiao, Hesheng Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05305.txt.
Introduction
Kang Luo and team offer Fusion4CA, built on BEVFusion to exploit visual input for bird's-eye-view finding from LiDAR and RGB. Current methods over-rely on LiDAR with insufficient RGB exploration. Fusion4CA aligns image features against 3D shape contrastively and adds a camera branch mining RGB information. An off-the-shelf mind adapter exploits pretrained weights, and coordinate attention boosts fusion. On nuScenes it reaches 69.7% mean average precision in only 6 training epochs with few added parameters, beating a 20-epoch baseline. Simulated lunar tests validate effectiveness and generalization.
Catalog record
| CREATOR | Kang Luo, Xin Chen, Yangyi Xiao, Hesheng Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27424 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.05305
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fusion4CA: Boosting 3D Object Detection via Comprehensive Image Exploitation Kang Luo, Xin Chen, Yangyi Xiao, Hesheng Wang Abstract Nowadays, an increasing number of works fuse LiDAR and RGB data in the bird’s-eye view (BEV) space for 3D object detection in autonomous driving systems. However, existing methods suffer from over-reliance on the LiDAR branch, with insufficient exploration of RGB information. To tackle this issue, we propose Fusion4CA, which is built upon the classic BEVFusion framework and dedicated to fully exploiting visual input with plug-and-play components. Specifically, a contrastive alignment module is designed to calibrate image features with 3D geometry, and a camera auxiliary branch is introduced to mine RGB information sufficiently during training. For further performance enhancement, we leverage an off-the-shelf cognitive adapter to make the most of pre-trained image weights, and integrate a standard coordinate attention module into the fusion stage as a supplementary boost. Experiments on the nuScenes dataset demonstrate that our method achieves 69.7% mAP with only 6 training epochs and a mere 3.48% increase in inference parameters, yielding a 1.2% improvement over the baseline which is fully trained for 20 epochs. Extensive experiments in a simulated lunar environment further validate the effectiveness and generalization of our method. Our code will be released through Fusion4CA . I INTRODUCTION 3D Object detection is an indispensable module in modern autonomous driving systems, which demands reliable recognition, precise 3D localization, and accurate geometry estimation of complex targets in dynamic driving scenarios [ 40 , 1 ] . LiDAR has been the primary sensor for mainstream 3D detection pipelines [ 31 , 41 , 8 ] , but its performance is inevitably constrained by inherent bottlenecks, including the sparsity of raw point clouds, sensitivity to the reflectivity of the surface, and performance degradation in adverse weather [ 30 , 17 ] . To mitigate these limitations, a mainstream research paradigm focuses on fusing RGB data captured by on-board cameras, leveraging their dense texture and rich semantic information to complement LiDAR measurements and further enhance detection performance [ 13 , 2 , 10 ] . If taking one modality as the dominant one and embedding the features of the other modality into it, the final fused representation will be inherently constrained by the intrinsic characteristics of the primary modality [ 20 ] . Consequently, how to effectively fuse the texture and semantic advantages of images with the spatial geometric advantages of LiDAR has become a key research priority. Recently, the BEV-based perception method has become the mainstream fusion paradigm for Camera-LiDAR-based 3D object detection [ 20 , 19 ] , due to its unified view representation and natural compatibility with downstream tasks in autonomous driving. However, most existing BEV-based approaches still suffer from an excessive reliance on the LiDAR modality, with insufficient exploitation of the camera modality [ 20 , 43 ] . This critical drawback results in only marginal performance improvements of multi-modal fusion schemes compared with LiDAR-only detection methods. We attribute this long-standing performance bottleneck to the following points: (1) The encoded image features are not geometrically calibrated before entering the view transform stage; (2) The standalone supervision signal struggles to effectively guide the optimization of the camera branch when LiDAR information alone is sufficient to accomplish most tasks; (3) Full-parameter fine-tuning fails to fully unleash the representation potential of pre-trained weights from the image encoder due to large-scale networks; (4) The fusion module lacks an efficient mechanism to capture discriminative information from each individual modality. Fig. 1: Key components of our Fusion4CA framework, consisting of Contrastive Alignment Module, Camera Auxiliary Branch, Cognitive Adapter and Coordinate Attention Module. Our model outperforms BEVFusion by 5% mAP at six epochs and surpasses its 20-epoch counterpart by 1.2% mAP. In this work, we propose Fusion4CA, an improved camera-LiDAR fusion framework built upon BEVFusion [ 20 ] to better exploit visual information. As illustrated in Fig. 1 , we introduce four complementary components to alleviate the over-reliance on the LiDAR modality and fully unlock the potential of RGB data. Specifically, a Contrastive Alignment Module is designed to perform calibration on the encoded image features before they enter the view transform stage, ensuring the alignment between image features and 3D spatial structure. To tackle the insufficient guidance of standalone supervision signals under LiDAR dominance, we propose a Camera Auxiliary Branch, which provides additional supervision for the optimization of the camera branch, promoting the full exploration of texture and semantic information. We further adopt an off-the-shelf Cognitive Adapter [ 36 ] to effectively utilize pre-trained image weights, and integrate a standard Coordinate Attention Module [ 11 ] to capture discriminative cross-modal features. Notably, all these components are plug-and-play and can be readily integrated into other baseline frameworks. Our contributions are as follows: • We propose Fusion4CA, an effective Camera-LiDAR fusion framework built upon BEVFusion, which alleviates the over-dependence on LiDAR signals and fully exploits the representation power of RGB images for 3D Object Detection. • We design a Contrastive Alignment Module to enforce alignment between visual features and 3D spatial geometry, together with a Camera Auxiliary Branch that provides extra supervision to mitigate the LiDAR-dominated training bias and enhance the exploitation of image texture and semantics. • Our method achieves competitive 3D detection performance on the nuScenes dataset with only 6 training epochs and negligible extra inference overhead, while promising results on our custom-built simulated lunar environment further validate its effectiveness and strong generalization capability. II RELATED WORK II-A 3D Object Detection with Camera Modality Mainstream approaches for camera-based 3D object detection can generally be divided into depth-based methods and network-based methods. Depth-based schemes [ 16 , 22 , 21 ] explicitly estimate depth and project image features into BEV space with camera parameters. Nevertheless, such methods are highly dependent on implicit depth estimation, which tends to suffer performance degradation in ambiguous depth scenarios, especially for distant objects and texture-less regions. By contrast, network-based methods [ 18 , 35 , 14 ] implicitly lift image features to the BEV space through neural networks, typically Transformers. Despite recent progress, these approaches still exhibit obvious limitations. They require large-scale training data and massive computational resources for stable convergence, and full-parameter fine-tuning of Transformer structures also introduces excessive GPU memory overhead and high training costs [ 36 ] . II-B 3D Object Detection with LiDAR Modality LiDAR-based 3D object detection methods are mainly categorized into point-based approaches and grid-based approaches according to the point cloud feature extraction paradigm. Point-based methods [ 24 , 25 , 9 ] operate directly on raw LiDAR point clouds by exploiting the unordered nature of point sets to capture geometric information with max pooling. Alternatively, grid-based methods [ 44 , 15 , 34 ] first partition the LiDAR point cloud into pre-defined regular voxels or pillars and then apply convolutions on the grid representation. However, such methods are limited by the inherent properties of point clouds, whose features are often sparse and sensitive to object surface reflectance and adverse weather conditions. II-C 3D Object Detection with Multi-Modalities 3D perception via multi-modal fusion can be categorized into three paradigms based on the type of fused features: primary-auxiliary modality fusion (with either image or point cloud as the primary modality), BEV-based feature fusion, and Query-based fusion. The