High-Performance Reinforcement Learning on Spot: Optimizing Simulation Parameters with Distributional Measures

A.J. Miller, Fangzhou Yu, Michael Brauckmann, Farbod Farshidian · 2025

Read High-Performance Reinforcement Learning on Spot: Optimizing Simulation Parameters with Distributional Measures by A.J. Miller, Fangzhou Yu, Michael Brauckmann, Farbod Farshidian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17857.txt.

Description

AJ Miller, Fangzhou Yu, Michael Brauckmann, and Farbod Farshidian report on training a reinforcement learning policy for the Spot robot, in a paper from two thousand twenty-five. Spot is Boston Dynamics' quadruped robot. Their work is cast as the first public end-to-end learning pipeline on Spot with code released for all to use.

Rules trained in simulation often stumble on real hardware. The team gauges that sim-to-real gap with two scores for how far apart two data sets sit: Wasserstein distance and maximum mean discrepancy. They set the data from the real robot and from runs side by side, head-on. Those scores drive an evolution strategy that tunes unknown simulation parameters. The tuned simulator then gives rise to better rules for the robot. Low-level motor access came through the Spot RL Researcher Development Kit. The training ran in Nvidia IsaacLab.

Catalog record

CREATORA.J. Miller, Fangzhou Yu, Michael Brauckmann, Farbod Farshidian
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-17857

Browse the full library · About the Tower of Babel