CU-Multi: A Dataset for Multi-Robot Collaborative Perception
Doncey Albin, Daniel McGann, Miles Mena, Annika Thomas, Harel Biggie, Xuefei Sun, Steve McGuire, Jonathan P. How, Christoffer Heckman · 2025
Read CU-Multi: A Dataset for Multi-Robot Collaborative Perception by Doncey Albin, Daniel McGann, Miles Mena, Annika Thomas, Harel Biggie, Xuefei Sun, Steve McGuire, Jonathan P. How, Christoffer Heckman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-19463.txt.
Introduction
Robots that explore together must merge their separate views into one map, and Doncey Albin and eight co-authors supply a benchmark dataset for that problem. Existing multi-robot datasets are scarce, and many evaluations cheat by slicing one robot's path into fake teammates. Available sets also tend to be short, with little overlap between robots and few loop closures. CU-Multi was collected over several days at two large outdoor sites on the University of Colorado Boulder campus.
Four synchronized runs start together with controlled overlap, imitating a real team's distinct viewpoints. Sensors include color-and-depth cameras, precision GPS, and semantic laser scanning, with refined ground-truth odometry. Dense semantic annotations ride along with the overlap variation. The authors offer the dataset as a foundation for reproducible comparison of collaborative perception methods, a field that badly needs shared yardsticks.
Catalog record
| CREATOR | Doncey Albin, Daniel McGann, Miles Mena, Annika Thomas, Harel Biggie, Xuefei Sun, Steve McGuire, Jonathan P. How, Christoffer Heckman |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-19463
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CU-Multi: A Dataset for Multi-Robot Collaborative Perception Doncey Albin, Daniel McGann, Miles Mena, Annika Thomas, Harel Biggie, Xuefei Sun, Steve McGuire, Jonathan P. How, Christoffer Heckman Abstract A central challenge for multi-robot systems is fusing independently gathered perception data into a unified representation. Despite progress in Collaborative SLAM (C-SLAM), benchmarking remains hindered by the scarcity of dedicated multi-robot datasets. Many evaluations instead partition single-robot trajectories, a practice that may only partially reflect true multi-robot operations and, more critically, lacks standardization, leading to results that are difficult to interpret or compare across studies. While several multi-robot datasets have recently been introduced, they mostly contain short trajectories with limited inter-robot overlap and sparse intra-robot loop closures. To overcome these limitations, we introduce CU-Multi, a dataset collected over multiple days at two large outdoor sites on the University of Colorado Boulder campus. CU-Multi comprises four synchronized runs with aligned start times and controlled trajectory overlap, replicating the distinct perspectives of a robot team. It includes RGB-D sensing, RTK GPS, semantic LiDAR, and refined ground-truth odometry. By combining overlap variation with dense semantic annotations, CU-Multi provides a strong foundation for reproducible evaluation in multi-robot collaborative perception tasks. The dataset, support code, and updates are available at https://arpg.github.io/cumulti. Fig. 1: Overhead view of the all paths overlaid on map from env1 (top) and env2 (bottom) environments in the CU-Multi Dataset. TABLE I: Comparison of real-world multi-robot Datasets. Note: only datasets with LiDAR have been listed. Dataset # Robots Environments Multi-Session RGB-D GPS IMU Annotated LiDAR Longest Trajectory (km) GRACO [ 1 ] 1 GW, 2 A 8 Out ✗ ✓ ✓ ✓ ✗ 0.82 Kimera-Multi [ 2 ] 8 GW 1 Out, 1 In, 1 Hybrid ✗ ✓ ✗ ✓ ✗ 1.40 S3E [ 3 ] 3 GW 13 Out, 5 In ✗ ✓ ✓ ✓ ✗ 1.95 DiTer++ [ 4 ] 2 GL 3 Out ✓ ✓ ✗ ✓ ✗ N/A Lamp 2.0 [ 5 ] 4 GW, 3 GL 1 Out, 3 Sub ✗ ✓ ✗ ✓ ✗ 2.20 CoPeD [ 6 ] 3 GW, 2 A 3 In, 3 Out ✗ ✓ ✓ ✓ ✗ 0.36 CU-Multi (ours) 4 GW 2 Out ✓ ✓ ✓ ✓ ✓ 4.01 GW , GL , and A denote ground-wheeled, ground-legged, and aerial robots, respectively. In , Out , and Hybrid represent indoor, outdoor, and a mix of both, respectively. I Introduction Multi-robot systems significantly enhance capabilities across diverse domains, particularly in large-scale environments, by accelerating exploration through distributed sensing and collaborative decision-making [ 7 ] . A central challenge in realizing these advantages lies in fusing perception data collected independently by multiple robots into a unified global representation, complicated by spatial and temporal misalignment. This challenge is further compounded in many practical scenarios where external positioning methods (e.g. GPS, motion capture) are impractical, unreliable, or hazardous. Multi-robot Collaborative SLAM (C-SLAM) algorithms are typically first developed and validated offline using datasets before doing field tests in real-world conditions, where system-level issues often arise. Consequently, the availability of realistic, well-structured multi-robot datasets is essential for supporting reproducible research and bridging the gap between offline development and real-world deployment. Several multi-robot datasets have recently been introduced for C-SLAM verification [ 3 , 6 , 1 ] . These datasets include synchronized multi-agent sensor data collected across both indoor and/or outdoor environments. While these datasets represent strong starting points, there remains a need for longer-trajectory multi-robot datasets with explicitly varied overlap (see Table I ). Despite recent advancements in multi-robot datasets, there remains a prevalent practice of artificially segmenting a single trajectory into multiple parts to simulate a multi-robot scenario for verification [ 8 ] . Single-robot SLAM datasets still offer a few benefits over many of the existing multi-robot datasets, such as large trajectories with multiple loop closures, as well as the availability of both camera and LiDAR semantics [ 8 , 9 ] . However, without careful consideration, arbitrary segmentation may not accurately represent realistic observational overlap typically encountered in multi-robot operations [ 10 ] . In this paper, we introduce CU-Multi, a dataset designed to support the evaluation of methods relevant to multi-robot perception. These methods include C-SLAM, LiDAR and visual data association, and multi-session LiDAR-based place recognition. CU-Multi offers the following key features: 1. A multi-robot dataset consisting of two large-scale environments, each with four robots. Our dataset contains a total of eight diverse trajectories, spanning a combined length of 16.7 km across the CU Boulder campus (Figure 1 ). 2. Systematically varied trajectory overlaps and a rendezvous-based trajectory design , enabling evaluation of multi-robot perception tasks under different levels of observational redundancy and variation. 3. Refined ground truth poses using RTK GPS, a digital elevation model, lidar-inertial SLAM, and a highly accurate scan-matching algorithm, calculated at each LiDAR timestamp. 4. Semantic labels for all LiDAR scans, dataset tools for interacting with the data, as well as initial benchmarks on a well-known C-SLAM and LiDAR place recognition method to demonstrate dataset usability and utility of the provided tools. II Related Work Although single-robot SLAM has long benefited from curated datasets, extending SLAM to multi-robot systems introduces challenges that demand more representative data of a true multi-robot system. A common practice is to simulate multi-robot scenarios by splitting single-robot trajectories, but this raises concerns about realism and consistency. This section surveys single-robot datasets, the trajectory-splitting strategies applied to them, and existing multi-robot datasets, motivating the need for our proposed contribution. II-A Single-Robot SLAM Datasets One of the most widely used datasets for evaluating single-robot SLAM and global localization pipelines is the KITTI Odometry Benchmark [ 11 ] , a large-scale computer vision dataset collected in Karlsruhe, Germany using a sensor-equipped automobile. It features stereo imagery, LiDAR, and GPS/IMU data across 22 driving sequences in urban and rural environments. In 2019, SemanticKITTI [ 12 ] expanded the original KITTI dataset to include dense point-wise annotations for all LiDAR scans, enabling tasks such as semantic segmentation and scene completion. KITTI-360 [ 13 ] , released in 2022, was also collected in Karlsruhe and contains broader city coverage, improved GPS accuracy, and consistent 2D/3D semantic instance annotations across panoramic imagery and LiDAR scans. Although originally intended for single-robot perception tasks, these datasets are commonly repurposed for verifying and benchmarking multi-robot C-SLAM pipelines through segmenting a single trajectory into multiple parts to simulate independent robots. II-B Trajectory Splitting on Single-Robot Datasets Early work by Cieslewski and Scaramuzza demonstrated the approach of using a single-robot dataset for C-SLAM [ 14 , 15 ] , and subsequent methods including DOOR-SLAM [ 16 ] , DiSCO-SLAM [ 17 ] , and RDC-SLAM [ 18 ] adopted similar practices. More recent systems, such as DCL-SLAM [ 8 ] , Wi-Closure [ 19 ] , and SWARM-SLAM [ 9 ] , continue to rely on partitioning KITTI or KITTI-360 sequences, often supplemented with small multi-robot datasets like GRACO [ 1 ] or S3E [ 3 ] . While splitting provides convenient large-scale data, its limitations are well documented. Lajoie et al. cautioned that partitioning trajectories at overlapping regions creates unrealistic assumptions, as identical viewpoints and lighting are unlikely to occur simultaneously in true multi-robot operations [ 10 ] . Despite this, most works do not