Responsible AI measures dataset for ethics evaluation of AI systems

Shalaleh Rismani, Leah Davis, Bonam Mingole, Negar Rostamzadeh, Renee Shelby, AJung Moon · 2025

Read Responsible AI measures dataset for ethics evaluation of AI systems by Shalaleh Rismani, Leah Davis, Bonam Mingole, Negar Rostamzadeh, Renee Shelby, AJung Moon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-12722731.txt.

Description

Judging whether an AI system is fair, open, and privacy-safe requires measures, and the field has proposed hundreds of them in scattered places. Shalaleh Rismani and co-authors gathered those measures into one dataset in 2025, drawn from 257 computing papers published between 2011 and 2023. The set holds 12,067 data points across 791 measures and eleven ethical principles.

Each entry describes the measure, the kind of system it was used on, and the source paper. A companion visual tool lets users explore the set interactively. The authors aim to help practitioners find fitting ways to assess their systems and to help the field critique how it turns broad values into numbers.

Catalog record

CREATORShalaleh Rismani, Leah Davis, Bonam Mingole, Negar Rostamzadeh, Renee Shelby, AJung Moon
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC12722731

Browse the full library · About the Tower of Babel