What Matters for Batch Online Reinforcement Learning in Robotics?
Perry Dong Suvir Mirchandani Dorsa Sadigh Chelsea Finn · 2025
Read What Matters for Batch Online Reinforcement Learning in Robotics? by Perry Dong Suvir Mirchandani Dorsa Sadigh Chelsea Finn (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08078.txt.
Description
Perry Dong, Suvir Mirchandani, Dorsa Sadigh, and Chelsea Finn ask what helps robots learn from batches of self-collected data, in a paper from 2025. Robots that gather their own practice data could improve with little human help. In practice, many methods fail to gain much from such data or stall at weak performance.
The team varied three choices in a broad set of tests: method type, how actions are picked from a policy, and how flexible the policy is. Methods guided by value scores beat those based on copying alone. Picking the best sampled action proved key, and flexible policies beat stiff ones. Their proposed method builds on all three lessons.
Catalog record
| CREATOR | Perry Dong Suvir Mirchandani Dorsa Sadigh Chelsea Finn |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08078