Safe Exploration via Policy Priors

Manuel Wendl, Yarden As, Manish Prajapat, Anton Pollak, Stelian Coros, Andreas Krause · 2026

Read Safe Exploration via Policy Priors by Manuel Wendl, Yarden As, Manish Prajapat, Anton Pollak, Stelian Coros, Andreas Krause (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19612.txt.

Description

Manuel Wendl and five colleagues make reinforcement learning safer to use outside simulations. An agent that learns by acting in the real world can cause harm while it explores. The authors start from policies that are imperfect but cautious. Such policies can come from offline data or from simulators.

They use these conservative policies as priors, a base behaviour the learner stays near. Exploration then improves on a safe starting point instead of wandering freely. The prior guides the agent away from known danger while it learns. Safe exploration is a key step for robots and systems that learn on the job. The work offers a practical way to borrow caution from existing controllers.

Catalog record

CREATORManuel Wendl, Yarden As, Manish Prajapat, Anton Pollak, Stelian Coros, Andreas Krause
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE131 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-19612

Browse the full library · About the Tower of Babel