Explainable Reinforcement Learning Agents Using World Models
Madhuri Singh, Amal Alabdulkarim, Gennie Mansi, Mark O. Riedl · 2025
Read Explainable Reinforcement Learning Agents Using World Models by Madhuri Singh, Amal Alabdulkarim, Gennie Mansi, Mark O. Riedl (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08073.txt.
Description
Explaining why a reinforcement learning agent acted as it did is hard because its choices unfold over time. Madhuri Singh, Amal Alabdulkarim, Gennie Mansi, and Mark Riedl use world models, which predict how the world changes when the agent acts, to generate counterfactual trajectories showing what could have happened instead. They add a reverse world model that predicts what the world would have needed to look like for the agent to prefer a different action the user had in mind.
Explanations showing what the world should have been like raised users' understanding of the agent's policy significantly. The authors suggest such explanations can also teach users how to steer an agent by changing its environment.
Catalog record
| CREATOR | Madhuri Singh, Amal Alabdulkarim, Gennie Mansi, Mark O. Riedl |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08073