Measuring AI Agent Autonomy: Towards a Scalable Approach with Code Inspection

Peter Cihon GitHubSan Francisco, CA, USA [email protected], Merlin Stein University of OxfordOxford, UK [email protected] Gagan BansalMicrosoftRedmond, WA, USASam ManningCentre for the Governance of AIOxford, UKKevin XuGitHubSan Francisco, CA, USA · 2025

Read Measuring AI Agent Autonomy: Towards a Scalable Approach with Code Inspection by Peter Cihon GitHubSan Francisco, CA, USA [email protected], Merlin Stein University of OxfordOxford, UK [email protected] Gagan BansalMicrosoftRedmond, WA, USASam ManningCentre for the Governance of AIOxford, UKKevin XuGitHubSan Francisco, CA, USA (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15212.txt.

Description

Peter Cihon and co-authors propose judging an AI agent's independence by reading its code instead of watching it run in this 2025 paper. Runtime tests of autonomy are costly and can be risky. Their framework scores the orchestration code that drives an agent against a taxonomy of impact and oversight.

Static inspection can flag how much damage an agent could do and how much human control surrounds it, before any deployment. They demonstrate the approach on a popular agent framework and selected applications built with it. The authors argue code-based scoring scales to the flood of new agents, giving regulators and builders an early, cheap read on autonomy levels.

Catalog record

CREATORPeter Cihon GitHubSan Francisco, CA, USA [email protected], Merlin Stein University of OxfordOxford, UK [email protected] Gagan BansalMicrosoftRedmond, WA, USASam ManningCentre for the Governance of AIOxford, UKKevin XuGitHubSan Francisco, CA, USA
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-15212

Browse the full library · About the Tower of Babel