Building surrogate models using trajectories of agents trained by Reinforcement Learning
Julen Cestero, Marco Quartulli, Marcello Restelli · 2025
Read Building surrogate models using trajectories of agents trained by Reinforcement Learning by Julen Cestero, Marco Quartulli, Marcello Restelli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01285.txt.
Description
Surrogate models stand in for costly simulations, but they need good sample points, and wide state spaces make sampling wasteful. Julen Cestero, Marco Quartulli, and Marcello Restelli propose sampling a simulated environment with agents trained by reinforcement learning. Those agents visit states in ways that plain random draws may miss.
The team compares their approach with Latin hypercube sampling and with active learning paired with Kriging, checking results across all sampled data sets. A mixed data set worked best, combining samples from random agents, expert agents, and agents trained to seek states where transitions are least predictable. Cestero and the co-authors conclude the method improves on the prior state of the art and opens the way to surrogate-aided policy learning, where cheap stand-ins guide costly training.
Catalog record
| CREATOR | Julen Cestero, Marco Quartulli, Marcello Restelli |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-01285