SLAM&Render: A Benchmark for the Intersection Between Neural Rendering, Gaussian Splatting and SLAM

Samuel Cerezo, Gaetano Meli, Tomás Berriel Martins, Kirill Safronov, Javier Civera · 2025

Read SLAM&Render: A Benchmark for the Intersection Between Neural Rendering, Gaussian Splatting and SLAM by Samuel Cerezo, Gaetano Meli, Tomás Berriel Martins, Kirill Safronov, Javier Civera (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13713.txt.

Introduction

Samuel Cerezo, Gaetano Meli, Tomás Berriel Martins, Kirill Safronov, and Javier Civera release a benchmark that sits where robot mapping meets neural scene rendering, in a research paper from 2025. New rendering methods are being used inside SLAM systems, which track a device's motion while mapping a scene. Older data sets miss the joint challenges of both fields.

Their data set was recorded with a robot arm for precise motion. It holds forty sequences with color and depth images, motion sensor readings, and exact ground-truth poses. Five object setups appear under four lighting setups, with separate training and test paths. Baseline results show the set is a relevant test for this growing area.

Catalog record

CREATORSamuel Cerezo, Gaetano Meli, Tomás Berriel Martins, Kirill Safronov, Javier Civera
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-13713

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SLAM&Render: A Benchmark for the Intersection Between Neural Rendering, Gaussian Splatting and SLAM Samuel Cerezo, Gaetano Meli, Tomás Berriel Martins, Kirill Safronov, Javier Civera Abstract Models and methods originally developed for Novel View Synthesis and Scene Rendering, such as Neural Radiance Fields (NeRF) and Gaussian Splatting, are increasingly being adopted as representations in Simultaneous Localization and Mapping (SLAM). However, existing datasets fail to include the specific challenges of both fields, such as sequential operations and, in many settings, multi-modality in SLAM or generalization across viewpoints and illumination conditions in neural rendering. Additionally, the data are often collected using sensors which are handheld or mounted on drones or mobile robots, which complicates the accurate reproduction of sensor motions. To bridge these gaps, we introduce SLAM&Render , a fully controlled benchmark designed to isolate and evaluate specific challenges arising at the intersection of SLAM, Neural Rendering, and Gaussian Splatting. Recorded with a robot manipulator, it uniquely includes 40 sequences with time-synchronized RGB-D images, IMU readings, robot kinematic and ground-truth data. By releasing robot kinematic data, the dataset also enables the assessment of recent integrations of SLAM methods within robotic applications. The dataset features five setups with consumer and industrial objects under four controlled lighting conditions, each with separate training and test trajectories. All sequences are static with different levels of object rearrangements and occlusions. Our experimental results, obtained with several baselines from the literature, validate SLAM&Render as a relevant benchmark for this emerging research area. The dataset can be accessed through this link: https://tinyurl.com/SLAMRender . I Introduction Simultaneous Localization and Mapping (SLAM) is a key enabler for autonomous robot navigation and scene understanding. Its goal is to estimate the robot’s pose while building a consistent map using only onboard sensors. Several high-performing multimodal [ 1 ] and unimodal [ 2 , 3 ] methods are available today, although open challenges still remain [ 4 , 5 ] . SLAM differs from alternative approaches to 3D reconstruction (e.g., Structure from Motion [ 6 ] ) mainly by its online, real-time and multimodal features, making it well-suited for robotic applications. Emerging works [ 7 , 8 , 9 ] show the benefits of combining SLAM with robot kinematic data in the presence of uncertainties in the kinematic model and/or actuators. Moreover, robot kinematics alone does not inherently address shifts in the extrinsic parameters [ 10 ] , cross-session relocalization and map merging, and high-quality 3D reconstruction, which are paramount for workspace exploration, maintenance and inspection tasks. Novel View Synthesis (NVS), seemingly distant from robot SLAM, has experienced a resurgence due to groundbreaking research in Neural Radiance Fields (NeRFs) [ 11 ] . It has been quickly adopted as a map representation in visual [ 12 , 13 ] and LiDAR [ 14 ] SLAM pipelines. On the other hand, Gaussian Splatting [ 15 ] , developed as a much faster alternative to NeRFs, has had an even bigger impact in visual SLAM [ 16 , 17 ] . Motivated by the growing convergence of visual SLAM, Neural Rendering, and Gaussian Splatting, and by the lack of dedicated benchmarks, we introduce SLAM&Render . Recorded with a robot manipulator, it ensures accurate reproductions of camera motions, split in separate train and test trajectories. The dataset provides 40 static sequences with synchronized RGB-D images, IMU readings, robot kinematic data, camera parameters, and ground-truth data. It comprises five setups with consumer and industrial objects under four controlled lighting conditions, showcasing object rearrangements with varying levels of occlusion. All data will be made available online under CC-BY 4.0 license at our website. Additional information, software tools, and videos for visual inspection of the dataset will also be included. Fig. 1: Illustration of the capture setup for our SLAM&Render dataset, recorded from a Intel RealSense at the end effector of a robotic arm that moves around a set of objects on a table. See the four different light conditions present in our dataset: a) natural, b) cold, c) warm, and d) dark II Related Work Year Dataset Use RGB Depth IMU Enc. GT Ill. Rearr. TS. 2014 DTU [ 18 ] NVS ✓ ✓ ✗ ✗ ✓ ✓ ✗ ✗ 2014 JIGSAWS [ 19 ] Motion Model. ✓ ✗ ✗ ✓ ✗ ✗ ✗ ✗ 2015 YCB object and Model set [ 20 ] Robotic Manip. ✓ ✓ ✗ ✗ ✓ ✗ ✗ ✗ 2016 EuRoC [ 21 ] SLAM ✓ ✗ ✓ ✗ ✓ ✓ ✗ ✓ 2017 Tanks and Temples [ 22 ] NVS ✓ ✓ ✗ ✗ ✗ ✗ ✗ ✗ 2018 TUM VI [ 23 ] Odom. ✓ ✗ ✓ ✗ (✓) ✗ ✗ ✗ 2019 OpenLORIS-Scene [ 24 ] SLAM ✓ ✓ ✓ ✓ ✓ ✗ ✗ ✓ 2019 Replica [ 25 ] SLAM & NVS ✓ ✓ ✓ ✗ ✓ ✗ ✗ ✓ 2020 Newer College [ 26 ] SLAM & NVS ✓ ✗ ✓ ✗ ✓ ✗ ✗ ✓ 2021 Mip-NeRF360 [ 27 ] NVS ✓ ✗ ✗ ✗ ✗ ✗ ✗ ✗ 2023 ScanNet++ [ 28 ] SLAM & NVS ✓ ✓ ✗ ✗ ✓ ✗ ✗ ✓ 2025 Oxford Spires [ 29 ] SLAM & NVS ✓ ✓ ✓ ✗ ✓ ✗ ✗ ✓ 2025 SLAM&Render SLAM & NVS ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ TABLE I: Overview of commonly used datasets for SLAM and NVS, including available sensor modalities (RGB, Depth, IMU, Encoders), ground-truth camera pose (GT), illumination variations (Ill.), scene rearrangements (Rearr.), and time synchronization (TS). Publicly available datasets have played a crucial role in advancing research in SLAM and NVS. Table I provides an overview of the most relevant datasets in this field. Unless otherwise stated, the following datasets do not feature (i) robot kinematic data, (ii) full control of lighting conditions, (iii) reproducible sensor motions with high accuracy, and (iv) object rearrangements across sequences. II-A Datasets for SLAM The EuRoC dataset [ 21 ] provides visual–inertial data from a micro aerial vehicle organized into two batches: industrial hall sequences for SLAM evaluation, and indoor room sequences for 3D reconstruction. Several challenges, such as varying natural light conditions and dynamic scenes, are included. The TUM VI dataset [ 23 ] is designed for evaluating odometry algorithms. It contains RGB images, photometric calibration, synchronized IMU data, and ground-truth camera poses, while depth images are not included. The OpenLORIS-Scene dataset [ 24 ] consists of visual–inertial, LiDAR and odometry data (i.e., encoder readings) from a mobile robot to benchmark SLAM and scene understanding in everyday scenarios. The Newer College [ 26 ] and the Oxford Spires [ 29 ] datasets provide visual-inertial, and LiDAR data from handheld devices. Both include time-synchronized data, calibration parameters for all the involved sensors, loop closures, and cluttered sequences observed from varying viewpoints. The Replica dataset [ 25 ] includes 18 photorealistic indoor multi-scale reconstructions with dense meshes, rich textures, and reflective surfaces. Fig. 2: Illustration of the objects included in SLAM&Render : a-b) supermarket goods, c) industrial goods, d) – h) object arrangements of the five setups. II-B Datasets for Novel View Synthesis Despite the popularity of NeRFs, most datasets used for evaluation sample frames along a single camera trajectory, often lacking the diversity and complexity of real-world settings. DTU [ 18

Read the complete text