Safe Exploration via Policy Priors
Manuel Wendl, Yarden As, Manish Prajapat, Anton Pollak, Stelian Coros, Andreas Krause · 2026
Read Safe Exploration via Policy Priors by Manuel Wendl, Yarden As, Manish Prajapat, Anton Pollak, Stelian Coros, Andreas Krause (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19612.txt.
Description
Manuel Wendl and five colleagues make reinforcement learning safer to use outside simulations. An agent that learns by acting in the real world can cause harm while it explores. The authors start from policies that are imperfect but cautious. Such policies can come from offline data or from simulators.
They use these conservative policies as priors, a base behaviour the learner stays near. Exploration then improves on a safe starting point instead of wandering freely. The prior guides the agent away from known danger while it learns. Safe exploration is a key step for robots and systems that learn on the job. The work offers a practical way to borrow caution from existing controllers.
Catalog record
| CREATOR | Manuel Wendl, Yarden As, Manish Prajapat, Anton Pollak, Stelian Coros, Andreas Krause |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 131 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-19612