Measuring AI Agent Autonomy: Towards a Scalable Approach with Code Inspection
Peter Cihon GitHubSan Francisco, CA, USA [email protected], Merlin Stein University of OxfordOxford, UK [email protected] Gagan BansalMicrosoftRedmond, WA, USASam ManningCentre for the Governance of AIOxford, UKKevin XuGitHubSan Francisco, CA, USA · 2025
Read Measuring AI Agent Autonomy: Towards a Scalable Approach with Code Inspection by Peter Cihon GitHubSan Francisco, CA, USA [email protected], Merlin Stein University of OxfordOxford, UK [email protected] Gagan BansalMicrosoftRedmond, WA, USASam ManningCentre for the Governance of AIOxford, UKKevin XuGitHubSan Francisco, CA, USA (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15212.txt.
Description
Peter Cihon and co-authors propose judging an AI agent's independence by reading its code instead of watching it run in this 2025 paper. Runtime tests of autonomy are costly and can be risky. Their framework scores the orchestration code that drives an agent against a taxonomy of impact and oversight.
Static inspection can flag how much damage an agent could do and how much human control surrounds it, before any deployment. They demonstrate the approach on a popular agent framework and selected applications built with it. The authors argue code-based scoring scales to the flood of new agents, giving regulators and builders an early, cheap read on autonomy levels.
Catalog record
| CREATOR | Peter Cihon GitHubSan Francisco, CA, USA [email protected], Merlin Stein University of OxfordOxford, UK [email protected] Gagan BansalMicrosoftRedmond, WA, USASam ManningCentre for the Governance of AIOxford, UKKevin XuGitHubSan Francisco, CA, USA |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-15212