Learning When to Act or Refuse: Guarding Agentic Reasoning Models for Safe Multi-Step Tool Use
Aradhye Agarwal, Gurdit Siyan, Yash Pandya, Joykirat Singh, Akshay Nambi, Ahmed Awadallah · 2026
Read Learning When to Act or Refuse: Guarding Agentic Reasoning Models for Safe Multi-Step Tool Use by Aradhye Agarwal, Gurdit Siyan, Yash Pandya, Joykirat Singh, Akshay Nambi, Ahmed Awadallah (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03205.txt.
Description
Aradhye Agarwal, Gurdit Siyan, Yash Pandya, and colleagues teach tool-using agents to pause, check, and sometimes refuse. A chat model's worst slip is a bad sentence, but an agent's single misstep, opening files or typing credentials, can cause irreversible harm. Their 2026 framework, MOSAIC, makes the safety decision an explicit, learnable step.
Inference follows a loop: plan, check, then act or refuse and replan. Training uses preference comparisons between whole trajectories, avoiding the need for labeled steps and catching safety contrasts that single scores miss. Across three model families and fresh benchmarks covering harmful tasks, prompt injection, and privacy leaks, harmful behavior fell by up to half. Refusals of injected attacks rose, leakage dropped, and benign task performance held or improved.
Catalog record
| CREATOR | Aradhye Agarwal, Gurdit Siyan, Yash Pandya, Joykirat Singh, Akshay Nambi, Ahmed Awadallah |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71133 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.03205