Inverse Reinforcement Learning via Convex Optimization
Hao Zhu, Yuan Zhang, Joschka Boedecker · 2025
Read Inverse Reinforcement Learning via Convex Optimization by Hao Zhu, Yuan Zhang, Joschka Boedecker (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15957.txt.
Description
Hao Zhu and co-authors make inverse reinforcement learning a convex problem in a 2025 note. The task: guess the reward behind expert behavior in a Markov decision process. Most solvers face nonconvex math, which hurts trust and repeatability. A convex form was proposed long ago but stayed hard to use.
The team restate it so the CVXPY language can solve it directly. Trajectory data, not just a known expert policy, can now feed the solver. Inconsistent expert moves are handled by loosened constraints. Theory and code for automatic tuning come along. Practitioners without convex training can now apply the method to their own problems.
Catalog record
| CREATOR | Hao Zhu, Yuan Zhang, Joschka Boedecker |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-15957