BRUM: Robust 3D Vehicle Reconstruction from 360° Sparse Images
Davide Di Nucci, Matteo Tomei, Guido Borghi, Luca Ciuffreda, Roberto Vezzani, Rita Cucchiara · 2025
Read BRUM: Robust 3D Vehicle Reconstruction from 360° Sparse Images by Davide Di Nucci, Matteo Tomei, Guido Borghi, Luca Ciuffreda, Roberto Vezzani, Rita Cucchiara (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12095.txt.
Introduction
Davide Di Nucci and co-authors rebuild vehicles in 3D from few photos in a 2025 paper. Inspectors and planners often need full models of buses and cars. Popular rebuilding tools demand dense photo sets shot all around. Real inspections rarely allow that many views of a vehicle.
Their method leans on depth maps and a stronger pose guessing step. A selective loss trains only on pixels the system trusts most. They also release a data set of real and synthetic transit vehicles. Tests show top results even when the input views stay sparse.
Catalog record
| CREATOR | Davide Di Nucci, Matteo Tomei, Guido Borghi, Luca Ciuffreda, Roberto Vezzani, Rita Cucchiara |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-12095
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BRUM: Robust 3D Vehicle Reconstruction from 360° Sparse Images Davide Di Nucci, Matteo Tomei, Guido Borghi, Luca Ciuffreda, Roberto Vezzani, Rita Cucchiara Abstract Accurate 3D reconstruction of vehicles is vital for applications such as vehicle inspection, predictive maintenance, and urban planning. Existing methods like Neural Radiance Fields and Gaussian Splatting have shown impressive results but remain limited by their reliance on dense input views, which hinders real-world applicability. This paper addresses the challenge of reconstructing vehicles from sparse-view inputs, leveraging depth maps and a robust pose estimation architecture to synthesize novel views and augment training data. Specifically, we enhance Gaussian Splatting by integrating a selective photometric loss, applied only to high-confidence pixels, and replacing standard Structure-from-Motion pipelines with the DUSt3R architecture to improve camera pose estimation. Furthermore, we present a novel dataset featuring both synthetic and real-world public transportation vehicles, enabling extensive evaluation of our approach. Experimental results demonstrate state-of-the-art performance across multiple benchmarks, showcasing the method’s ability to achieve high-quality reconstructions even under constrained input conditions. Code and data are publicly available at https://aimagelab.ing.unimore.it/go/brum . I Introduction Novel view synthesis and 3D scene representation have been driven by techniques such as Neural Radiance Fields (NeRF) [ 1 ] and Gaussian splatting (GS) [ 2 ] in the last few years. Both are capable of generating captures of complex scenes from input views with their corresponding camera poses: NeRF leverages an implicit representation through a neural network which models color and density of the scene as a function of the spatial coordinates and viewing directions; GS employs an explicit representation of the scene using a set of 3D Gaussian primitives with associated attributes ( e.g. , color, opacity). While the focus of these methods has often been on general (both synthetic and real-world) scenes or human-centered tasks, their application to specific object classes – e.g. , the vehicle domain – is still under-investigated. Accurate 3D vehicle reconstruction is essential for several critical applications. One primary motivation is automated vehicle inspection [ 3 , 4 ] , where precise 3D models enable detailed analysis of structural integrity, surface condition, and potential defects. In addition, 3D reconstruction facilitates tracking the status of vehicles over time, providing a digital record of wear, modifications, or damage, and supporting predictive maintenance. Autonomous driving is increasingly benefiting from novel view synthesis techniques, too [ 5 , 6 ] . Beyond individual monitoring, these models can also enhance fleet management systems by providing actionable insights into vehicle health and optimizing operations. Building on these advantages, the public transportation sector stands to benefit significantly from accurate reconstruction. Furthermore, in the context of smart cities, 3D models of public transportation vehicles can contribute to broader initiatives such as traffic management, urban planning, and environmental monitoring [ 7 , 8 , 9 ] . In practical scenarios, such as tracking a vehicle’s condition over time ( e.g. , daily inspections for buses), capturing images quickly and consistently is crucial. While video recordings enable rapid data collection, they are often constrained by significant storage and processing requirements. Human-operated data collection could be significantly faster and more reliable if it required only a predetermined set of sparse images. Fixed camera setups offer a cost-effective alternative for image acquisition but inherently limit the number of available views to the number of cameras deployed. In this work, we tackle the challenge of 3D vehicle reconstruction under the constraint of limited sparse views. Specifically, starting with a handful of scene captures and their associated camera parameters, we leverage ground truth or estimated depth maps to project view-dependent point clouds into synthetic camera poses. These new poses are generated by systematically rotating and translating the original camera positions within a constrained range, effectively augmenting the available views for downstream Gaussian splatting training. Importantly, for these views, the photometric loss is applied exclusively to pixels with high-confidence re-projection. Camera position estimation for real-world scenes is traditionally performed using standard structure-from-motion (S f M) pipelines, such as COLMAP [ 10 ] . Moreover, these methods often struggle or fail to converge when provided with only a few images or when image overlap is minimal [ 4 , 11 ] . To address this limitation, we leverage the recently proposed DUSt3R architecture [ 12 ] for estimating both camera poses and an initial point cloud. We show that our proposed method achieves results comparable or even better than the state of the art in forward-facing 360° vehicle scenes from the Carpatch [ 3 ] and KRONC [ 4 ] datasets, using as few as 4-8 images, without adding considerable computation time. To assess the effectiveness of our approach in large public transportation vehicle scenes, we also introduce the BRUM-dataset with both synthetic and realistic bus instances, highlighting promising results on it. To sum up, our key contributions can be outlined as follows: • We enhance Gaussian splatting robustness in sparse-view forward-facing 360° vehicle scenes. Our method (BRUM) synthesizes novel images from coarse point clouds, effectively augmenting the input data. • We adopt DUSt3R as a replacement for the standard COLMAP and incorporate a masking strategy to exclude low-confidence pixels from the loss computation. • We present the BRUM-dataset featuring 6 synthetic and 6 real public transportation vehicles. Our method achieves state-of-the-art performance on this dataset and other standard car inspection benchmarks. II Related Work Novel View Synthesis. Novel view synthesis aims to generate photorealistic renderings of a 3D scene from unseen viewpoints. In recent years, this challenge has been predominantly addressed by NeRF-like approaches [ 1 ] , with various works proposing solutions to overcome the limitations of the original formulation. For faster training, [ 13 ] proposed to encode the 3D space using a multiresolution hash table, followed by a small MLP. Plenoxels [ 14 ] replaces neural networks with a voxel grid that directly stores density and spherical harmonic coefficients at each voxel, optimized using the standard MSE reconstruction loss. Other works focus on removing the dependency on S f M preprocessing: [ 15 , 16 ] use bundle adjustment to refine camera parameters starting from noisy ones, [ 17 ] optimizes predicted depth maps distortion parameters and camera poses together with NeRF, [ 18 ] introduces a feature synthesizer to render a dense feature map based on a coarse absolute camera pose predicted by an absolute pose regressor, minimizing the error between this feature map and the output of a pre-trained feature extractor. Recently, Gaussian splatting [ 2 ] has gained traction as a promising alternative to NeRF, providing advantages in training and rendering speed without compromising image quality. To address its shortcomings, the research community has undertaken various efforts. For instance, several studies have focused on reducing the storage footprint and memory requirements for deployment on edge devices, by compressing the Gaussian representation [ 19 , 20 , 21 , 22 ] . Other research has explored scene segmentation in 3D to enable editing capabilities [ 23 , 24 , 25 ] . Moreover, text-to-3D scene generation is rapidly emerging as a prominent task, combining 3D Gaussian splatting with the generative power of 2D diffusion models [ 26 , 27 , 28 , 29 ] . These methods highlight the capabilities of novel view synthesis