Diversity You Can Actually Measure: A Fast, Model-Free Diversity Metric for Robotics Datasets
Sreevardhan Sirigiri, Nathan Samuel de Lara, Christopher Agia, Florian Shkurti, Fabio Ramos · 2026
Read Diversity You Can Actually Measure: A Fast, Model-Free Diversity Metric for Robotics Datasets by Sreevardhan Sirigiri, Nathan Samuel de Lara, Christopher Agia, Florian Shkurti, Fabio Ramos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11634.txt.
Introduction
Sirigiri and co-authors build a way to measure diversity in robotics data sets. Imitation data mixes long paths of states, actions, and video, so plain counts mislead. The team extends Shannon and von Neumann entropy with signature kernels over demonstrations. Their curation algorithm, FAKTUAL, picks the subset of demonstrations with the highest entropy for a fixed budget. It needs no policy access and adds almost no overhead. Across RoboMimic, MetaWorld, and four real tasks, diverse picks beat random ones.
Catalog record
| CREATOR | Sreevardhan Sirigiri, Nathan Samuel de Lara, Christopher Agia, Florian Shkurti, Fabio Ramos |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 96303 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.11634
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Diversity You Can Actually Measure: A Fast, Model-Free Diversity Metric for Robotics Datasets Sreevardhan Sirigiri, Nathan Samuel de Lara, Christopher Agia, Florian Shkurti, Fabio Ramos Abstract Robotics datasets for imitation learning typically consist of long-horizon trajectories of different lengths over states, actions, and high-dimensional observations (e.g., RGB video), making it non-trivial to quantify diversity in a way that respects the underlying trajectory structure and geometry. We extend Shannon and von Neumann entropy to this setting by defining signature transform-based entropy on the Gram matrix of a signature kernel over demonstrations, yielding entropy and diversity metrics that operate directly on the demonstration dataset. Building on these metrics, we study how dataset diversity affects generalization performance in robot imitation learning and propose a simple, model-free way to curate diverse demonstrations. We introduce FAKTUAL (FAst trajectory Kernel enTropy cUration for imitation Learning), a data curation algorithm that selects a subset of demonstrations maximizing entropy given a subset-size budget. FAKTUAL is fully model-free, requires no access to the imitation policy or rollouts, and adds negligible overhead relative to policy training. We evaluate our approach on image and state-based RoboMimic and MetaWorld benchmarks, as well as four real-world manipulation tasks. Across tasks and architectures, diversity-aware curation with FAKTUAL consistently improves downstream success rates over random selection, while being substantially more computationally efficient compared to recent robot data curation methods. Our results suggest that the entropy of demonstration datasets is a practical tool for understanding and improving dataset diversity in robot imitation learning. † † footnotetext: 1 The University of Sydney. 2 University of Toronto. 3 Stanford University. 4 Allen Institute for Artificial Intelligence. 5 NVIDIA, USA † † footnotetext: Preprint under review. I Introduction Although many of the most prominent advances in deep learning have been driven by architectural innovations and increases in dataset scale, the diversity of the training data is also a crucial determinant of model performance. Diversity of datasets is a desirable criterion across many areas of machine learning, including dataset curation, generative modeling, reinforcement learning, active learning, and decoding algorithms [ 22 ] . Robotics, in particular imitation learning (IL), is no exception to this [ 52 , 5 , 29 , 23 , 67 ] . Recent works on large and (anecdotally) diverse datasets have been a central driver of scaling in robot imitation learning [ 52 , 34 , 8 , 82 , 50 , 36 , 5 , 29 ] . Despite growing interest in leveraging large robot datasets, there remains no widely accepted measure of diversity for such data. Moreover, quantifying diversity in robotics datasets in a principled way is difficult and non-trivial. This challenge stems from two main reasons: (1) demonstrations are often long-horizon trajectories/paths of varying lengths and consist of multiple modalities such as states, actions/control inputs and high-dimensional sensory observations (e.g., video); and (2) a diversity metric requires a mathematical notion of similarity between demonstrations that goes beyond pointwise distance and instead respects the underlying trajectory structure and geometry. In this work, we leverage the signature kernel to define a notion of diversity. The signature transform and its associated signature kernel [ 41 , 12 ] provide a principled way to represent and compare paths/trajectories of variable length while preserving important aspects of their geometric and sequential structure. Hence, the signature kernel induces a similarity measure that respects trajectory structure and geometry rather than relying on pointwise distances. Prior work has demonstrated that signature-kernel-based methods discriminate between robotic paths in applications such as trajectory optimization, path planning, and ergodic search [ 2 , 69 ] . Additionally, the signature kernel’s mathematical properties are meaningful for robot trajectories and can provide a solution for the challenges mentioned earlier. Fig. 1 : A graphical depiction of FAKTUAL . First, for each demonstration in the dataset, we embed the observations—specifically, the RGB images—into a ViT feature space, or alternatively extract low-dimensional representations of the objects of interest (e.g., point clouds) from the images. We then flatten any additional modalities present in the demonstrations, such as states and actions, if required, so that each demonstration can be represented as a paths or trajectories in space (detailed steps can be found in Appendix A ). Using these path representations, we compute signature-based entropy and diversity metrics, which we then use to select a subset of the dataset that maximizes the entropy or diversity. In addition to spanning a diverse and broad set of behaviors and states, a dataset must also provide sufficient coverage around those behaviors and states, i.e., enough local “ density ” of demonstrations for a reliable IL policy rather than merely observe isolated (and possibly outlying) trajectories. Demonstration quality is likewise essential: a dataset can hinder learning if large portions of the data are suboptimal or inconsistent [ 43 ] . In this sense, quality, diversity, density are complementary properties that jointly determine downstream policy performance. Curating datasets using principled diversity metrics as a first-class signal remains largely unexplored, and existing pipelines often do not explicitly preserve diversity during selection. Moreover, when overall dataset quality is already high across demonstration trajectories, the importance of diversity and balanced coverage/density (i.e., a uniform coverage of states and behaviors) can become even more pronounced [ 53 ] . In fact, recent work has devoted considerable attention to data curation for improving the quality of robot imitation learning datasets [ 39 , 26 , 10 , 11 , 1 ] . A largely successful approach is to retain only demonstrations judged to be beneficial according to a heuristic, task-agnostic notion of quality, producing a smaller dataset curated offline [ 26 ] . A limitation of several curation approaches (e.g., [ 26 , 11 , 10 , 1 ] ) is that they typically rely on training an auxiliary model to compute heuristic scores, often incurring large upfront costs comparable to training the target policy itself. Moreover, due to the computational intensity of these approaches, they are often best applied to smaller, task-specific fine-tuning datasets (e.g., post-training) than to large-scale multi-task datasets (e.g., pre-training). However, if diversity can be computed cheaply and reliably, it can provide a practical dataset-level signal for curation without requiring an additional learned scoring model and could be applied to large datasets. Such a curation approach would be complementary to quality based curation, meaning the methods could be combined to create datasets with positive quality and diversity properties. Furthermore, while diversity is not itself a direct measure of task success, it can nevertheless provide an explicit dataset-level signal that relates the composition of the training set to downstream performance. Indeed, we show later in the paper that demonstration diversity correlates well with policy success rate, suggesting that diversity can serve as a practical and informative criterion for curation. Contributions: Our main contributions are two-fold. (1) We compute Shannon entropy and von Neumann entropy on the eigenvalues of the signature kernel, providing a computationally cheap and principled way to measure the entropy and diversity of robotics datasets; our construction explicitly incorporates states, actions, videos and other modalities when defining this entropy-based diversity metric. (2) We propose a data curation strategy, FAKTUAL ( FA st trajectory K ernel en T ropy c U ration for imitation L earning) grounded