Position: Safety Must Precede the Deployment of Open-Ended AI Agents

Ivaxi Sheth, Jan Wehner, Sahar Abdelnabi, Ruta Binkyte, Mario Fritz · 2025

Read Position: Safety Must Precede the Deployment of Open-Ended AI Agents by Ivaxi Sheth, Jan Wehner, Sahar Abdelnabi, Ruta Binkyte, Mario Fritz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04512.txt.

Description

Ivaxi Sheth and co-authors argue in a 2025 position paper that safety must come before open-ended AI agents spread. Such agents invent new behaviors and goals as they run, with no fixed end. That freedom drives their promise in discovery and self-improvement.

The same freedom brings risks that set models do not pose. Behavior grows hard to predict, goals can drift out of line, and control can slip as the system outgrows its first design. Old safety frames, built for fixed tools, may not stretch to fit. The paper sorts the risks into a taxonomy and maps research paths. It calls for joint action now, before wide release makes the risks hard to recall.

Catalog record

CREATORIvaxi Sheth, Jan Wehner, Sahar Abdelnabi, Ruta Binkyte, Mario Fritz
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04512

Browse the full library · About the Tower of Babel