Safe Reinforcement Learning with Minimal Supervision

Alexander Quessy, Thomas Richardson, Sebastian East · 2025

Read Safe Reinforcement Learning with Minimal Supervision by Alexander Quessy, Thomas Richardson, Sebastian East (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-04481.txt.

Description

Alexander Quessy, Thomas Richardson, and Sebastian East study how to teach safe trial and error learning when demos are few, in a 2025 arXiv paper. A learning agent in the real world must explore without harm. The best known route learns a safe zone from past data, then explores inside it.

The catch is that demos may be scarce or weak, above all for tasks with wide goal zones. Hand built drivers and human demos cost too much to scale. The team instead lets an unsupervised learner gather the start data on its own. They show that the amount and grade of that data shapes how well safe rules can be learned later. They also add a trick, optimistic forgetting, that helps when data stays thin.

Catalog record

CREATORAlexander Quessy, Thomas Richardson, Sebastian East
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-04481

Browse the full library · About the Tower of Babel