A Conceptual Framework for AI Capability Evaluations

María Victoria Carro, Denise Alejandra Mester, Francisca Gauna Selasco, Luca Nicolás Forziati Gangi, Matheo Sandleris Musa, Lola Ramos Pereyra, Mario Leiva, Juan Gustavo Corvalan, Maria Vanina Martinez, Gerardo Simari · 2025

Read A Conceptual Framework for AI Capability Evaluations by María Victoria Carro, Denise Alejandra Mester, Francisca Gauna Selasco, Luca Nicolás Forziati Gangi, Matheo Sandleris Musa, Lola Ramos Pereyra, Mario Leiva, Juan Gustavo Corvalan, Maria Vanina Martinez, Gerardo Simari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-18213.txt.

Description

Carro and co-authors propose a shared lens for examining how AI systems are tested for what they can do. Well-run tests now guide governance choices, since they supply evidence about abilities and risks. Yet methods and terms vary so much that comparing tests is hard. Their 2025 framework describes evaluations in a structured way without forcing new labels or rigid formats.

The lens aims to make tests clearer, easier to compare, and easier to read across fields. Researchers can use it to spot weak methods, builders to design stronger tests, and policymakers to pick through complex test reports. The authors pitch the framework as common ground for a fast-moving practice. No new test or ranking is introduced.

Catalog record

CREATORMaría Victoria Carro, Denise Alejandra Mester, Francisca Gauna Selasco, Luca Nicolás Forziati Gangi, Matheo Sandleris Musa, Lola Ramos Pereyra, Mario Leiva, Juan Gustavo Corvalan, Maria Vanina Martinez, Gerardo Simari
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-18213

Browse the full library · About the Tower of Babel