Toward Information Theoretic Active Inverse Reinforcement Learning

Ondrej Bajgar, Dewi Sid William Gould, Jonathon Liu, Oliver Newcombe, Rohan Narayan Langford Mitta, Jack Golden · 2025

Read Toward Information Theoretic Active Inverse Reinforcement Learning by Ondrej Bajgar, Dewi Sid William Gould, Jonathon Liu, Oliver Newcombe, Rohan Narayan Langford Mitta, Jack Golden (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-00381.txt.

Description

Ondrej Bajgar and co-authors present a 2024 paper on learning human preferences with fewer demonstrations. Robots and self-driving cars cannot have their reward rules written by hand. Inverse reinforcement learning infers those rules from examples of good behavior. Examples are costly, so active versions pick the most telling scenarios to show a human.

Most past work asked for a single action at a time. This team studies asking for whole trajectories instead. They build a score, grounded in information theory, for how much a demonstration would teach the learner. A fast approximation makes that score practical. Gridworld tests show the picker working as hoped. The authors frame the study as groundwork for broader settings.

Catalog record

CREATOROndrej Bajgar, Dewi Sid William Gould, Jonathon Liu, Oliver Newcombe, Rohan Narayan Langford Mitta, Jack Golden
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-00381

Browse the full library · About the Tower of Babel