Learning When to Act or Refuse: Guarding Agentic Reasoning Models for Safe Multi-Step Tool Use

Aradhye Agarwal, Gurdit Siyan, Yash Pandya, Joykirat Singh, Akshay Nambi, Ahmed Awadallah · 2026

Read Learning When to Act or Refuse: Guarding Agentic Reasoning Models for Safe Multi-Step Tool Use by Aradhye Agarwal, Gurdit Siyan, Yash Pandya, Joykirat Singh, Akshay Nambi, Ahmed Awadallah (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03205.txt.

Description

Aradhye Agarwal, Gurdit Siyan, Yash Pandya, and colleagues teach tool-using agents to pause, check, and sometimes refuse. A chat model's worst slip is a bad sentence, but an agent's single misstep, opening files or typing credentials, can cause irreversible harm. Their 2026 framework, MOSAIC, makes the safety decision an explicit, learnable step.

Inference follows a loop: plan, check, then act or refuse and replan. Training uses preference comparisons between whole trajectories, avoiding the need for labeled steps and catching safety contrasts that single scores miss. Across three model families and fresh benchmarks covering harmful tasks, prompt injection, and privacy leaks, harmful behavior fell by up to half. Refusals of injected attacks rose, leakage dropped, and benign task performance held or improved.

Catalog record

CREATORAradhye Agarwal, Gurdit Siyan, Yash Pandya, Joykirat Singh, Akshay Nambi, Ahmed Awadallah
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71133
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.03205

Browse the full library · About the Tower of Babel