SPLASH! Sample-efficient Preference-based inverse reinforcement learning for Long-horizon Adversarial tasks from Suboptimal Hierarchical demonstrations

Peter Crowley, Zachary Serlin, Tyler Paine, Makai Mann, Michael Benjamin, Calin Belta · 2025

Read SPLASH! Sample-efficient Preference-based inverse reinforcement learning for Long-horizon Adversarial tasks from Suboptimal Hierarchical demonstrations by Peter Crowley, Zachary Serlin, Tyler Paine, Makai Mann, Michael Benjamin, Calin Belta (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08707.txt.

Description

Peter Crowley and co-authors present SPLASH, a method that teaches robots from imperfect human demonstrations, in a research paper from 2025. The approach belongs to inverse reinforcement learning, where a robot infers the goal behind shown behavior. Expert demos are often missing in practice, and flawed demos break many past methods, above all on long or contested tasks.

SPLASH learns from ranked preferences over layered, suboptimal demos, and it does so with few examples. The team tested it on a maritime capture-the-flag game in simulation. It beat leading rivals at recovering the true reward behind the demos. Runs moved from simulation to real self-driving surface boats showed the method can work outside the lab.

Catalog record

CREATORPeter Crowley, Zachary Serlin, Tyler Paine, Makai Mann, Michael Benjamin, Calin Belta
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-08707

Browse the full library · About the Tower of Babel