Toward Information Theoretic Active Inverse Reinforcement Learning
Ondrej Bajgar, Dewi Sid William Gould, Jonathon Liu, Oliver Newcombe, Rohan Narayan Langford Mitta, Jack Golden · 2025
Read Toward Information Theoretic Active Inverse Reinforcement Learning by Ondrej Bajgar, Dewi Sid William Gould, Jonathon Liu, Oliver Newcombe, Rohan Narayan Langford Mitta, Jack Golden (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-00381.txt.
Description
Ondrej Bajgar and co-authors present a 2024 paper on learning human preferences with fewer demonstrations. Robots and self-driving cars cannot have their reward rules written by hand. Inverse reinforcement learning infers those rules from examples of good behavior. Examples are costly, so active versions pick the most telling scenarios to show a human.
Most past work asked for a single action at a time. This team studies asking for whole trajectories instead. They build a score, grounded in information theory, for how much a demonstration would teach the learner. A fast approximation makes that score practical. Gridworld tests show the picker working as hoped. The authors frame the study as groundwork for broader settings.
Catalog record
| CREATOR | Ondrej Bajgar, Dewi Sid William Gould, Jonathon Liu, Oliver Newcombe, Rohan Narayan Langford Mitta, Jack Golden |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-00381