Inverse Q-Learning Done Right: Offline Imitation Learning in Q π Q^{\pi} -Realizable MDPs

Antoine Moulin, Gergely Neu, Luca Viano · 2025

Read Inverse Q-Learning Done Right: Offline Imitation Learning in Q π Q^{\pi} -Realizable MDPs by Antoine Moulin, Gergely Neu, Luca Viano (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-19946.txt.

Description

Antoine Moulin, Gergely Neu, and Luca Viano present an offline imitation learning algorithm with firm guarantees, in a 2025 paper. The task is to copy an expert's behavior from recorded state-action pairs alone, with no further practice in the environment. Recent work assumed the expert comes from a known, simple policy class.

Their approach instead assumes the environment's value functions have a learnable form. The resulting algorithm provably matches any expert within a small error using a modest number of samples, in both linear and broader settings. Tests on standard benchmarks beat plain behavior cloning and rivaled leading methods. The analysis also suggests a new training loss for critic networks.

Catalog record

CREATORAntoine Moulin, Gergely Neu, Luca Viano
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE104 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-19946

Browse the full library · About the Tower of Babel