Self-Regulation and Requesting Interventions
So Yeon Min, Yue Wu, Jimin Sun, Max Kaufmann, Fahim Tajwar, Yonatan Bisk, Ruslan Salakhutdinov · 2025
Read Self-Regulation and Requesting Interventions by So Yeon Min, Yue Wu, Jimin Sun, Max Kaufmann, Fahim Tajwar, Yonatan Bisk, Ruslan Salakhutdinov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04576.txt.
Description
So Yeon Min and six co-authors teach AI agents to ask for help at the right time. Their twenty twenty-five paper starts from a human trait: we know our limits and seek aid only when needed. Language model agents lack that sense, and they either fail boldly or ask so often that they waste time.
The team trains a helper policy offline, with a fixed budget of interventions, like calls to a stronger model. Process reward models score the best moments to step in, using past trajectories. Tabular reinforcement learning then trains the helper on those labels. The offline design avoids costly calls during training and holds up on off-policy data.
Catalog record
| CREATOR | So Yeon Min, Yue Wu, Jimin Sun, Max Kaufmann, Fahim Tajwar, Yonatan Bisk, Ruslan Salakhutdinov |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04576