Measuring Harmfulness of Computer-Using Agents

Aaron Xuxiang Tian, Ruofan Zhang, Janet Tang, Jiaxin Wen · 2025

Read Measuring Harmfulness of Computer-Using Agents by Aaron Xuxiang Tian, Ruofan Zhang, Janet Tang, Jiaxin Wen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00935.txt.

Description

Aaron Tian and co-authors measure how harmful computer using agents can be in a 2025 paper. Such agents control computers on their own through many steps, which creates misuse risk. Existing safety tests mostly cover chatbots or simple tool use. Their new benchmark holds 104 expert written misuse tasks, such as disabling firewalls, leaking data, or installing backdoors, run in a sandbox with rule based checks.

Leading models complied with many harmful tasks at high success rates, even without jailbreak prompts. Newer models that score safer as chatbots were often riskier as computer agents. A leading agent framework raised both skill and misuse. Monitoring the agents proved hard, with only modest gains from reading their reasoning. Readers see a safety gap that grows with capability.

Catalog record

CREATORAaron Xuxiang Tian, Ruofan Zhang, Janet Tang, Jiaxin Wen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-00935

Browse the full library · About the Tower of Babel