Building surrogate models using trajectories of agents trained by Reinforcement Learning

Julen Cestero, Marco Quartulli, Marcello Restelli · 2025

Read Building surrogate models using trajectories of agents trained by Reinforcement Learning by Julen Cestero, Marco Quartulli, Marcello Restelli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01285.txt.

Description

Surrogate models stand in for costly simulations, but they need good sample points, and wide state spaces make sampling wasteful. Julen Cestero, Marco Quartulli, and Marcello Restelli propose sampling a simulated environment with agents trained by reinforcement learning. Those agents visit states in ways that plain random draws may miss.

The team compares their approach with Latin hypercube sampling and with active learning paired with Kriging, checking results across all sampled data sets. A mixed data set worked best, combining samples from random agents, expert agents, and agents trained to seek states where transitions are least predictable. Cestero and the co-authors conclude the method improves on the prior state of the art and opens the way to surrogate-aided policy learning, where cheap stand-ins guide costly training.

Catalog record

CREATORJulen Cestero, Marco Quartulli, Marcello Restelli
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-01285

Browse the full library · About the Tower of Babel