Inverse Q-Learning Done Right: Offline Imitation Learning in Q π Q^{\pi} -Realizable MDPs
Antoine Moulin, Gergely Neu, Luca Viano · 2025
Read Inverse Q-Learning Done Right: Offline Imitation Learning in Q π Q^{\pi} -Realizable MDPs by Antoine Moulin, Gergely Neu, Luca Viano (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-19946.txt.
Description
Antoine Moulin, Gergely Neu, and Luca Viano present an offline imitation learning algorithm with firm guarantees, in a 2025 paper. The task is to copy an expert's behavior from recorded state-action pairs alone, with no further practice in the environment. Recent work assumed the expert comes from a known, simple policy class.
Their approach instead assumes the environment's value functions have a learnable form. The resulting algorithm provably matches any expert within a small error using a modest number of samples, in both linear and broader settings. Tests on standard benchmarks beat plain behavior cloning and rivaled leading methods. The analysis also suggests a new training loss for critic networks.
Catalog record
| CREATOR | Antoine Moulin, Gergely Neu, Luca Viano |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 104 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-19946