High-Performance Reinforcement Learning on Spot: Optimizing Simulation Parameters with Distributional Measures
A.J. Miller, Fangzhou Yu, Michael Brauckmann, Farbod Farshidian · 2025
Read High-Performance Reinforcement Learning on Spot: Optimizing Simulation Parameters with Distributional Measures by A.J. Miller, Fangzhou Yu, Michael Brauckmann, Farbod Farshidian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17857.txt.
Description
AJ Miller, Fangzhou Yu, Michael Brauckmann, and Farbod Farshidian report on training a reinforcement learning policy for the Spot robot, in a paper from two thousand twenty-five. Spot is Boston Dynamics' quadruped robot. Their work is cast as the first public end-to-end learning pipeline on Spot with code released for all to use.
Rules trained in simulation often stumble on real hardware. The team gauges that sim-to-real gap with two scores for how far apart two data sets sit: Wasserstein distance and maximum mean discrepancy. They set the data from the real robot and from runs side by side, head-on. Those scores drive an evolution strategy that tunes unknown simulation parameters. The tuned simulator then gives rise to better rules for the robot. Low-level motor access came through the Spot RL Researcher Development Kit. The training ran in Nvidia IsaacLab.
Catalog record
| CREATOR | A.J. Miller, Fangzhou Yu, Michael Brauckmann, Farbod Farshidian |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-17857