Responsible AI measures dataset for ethics evaluation of AI systems
Shalaleh Rismani, Leah Davis, Bonam Mingole, Negar Rostamzadeh, Renee Shelby, AJung Moon · 2025
Read Responsible AI measures dataset for ethics evaluation of AI systems by Shalaleh Rismani, Leah Davis, Bonam Mingole, Negar Rostamzadeh, Renee Shelby, AJung Moon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-12722731.txt.
Description
Judging whether an AI system is fair, open, and privacy-safe requires measures, and the field has proposed hundreds of them in scattered places. Shalaleh Rismani and co-authors gathered those measures into one dataset in 2025, drawn from 257 computing papers published between 2011 and 2023. The set holds 12,067 data points across 791 measures and eleven ethical principles.
Each entry describes the measure, the kind of system it was used on, and the source paper. A companion visual tool lets users explore the set interactively. The authors aim to help practitioners find fitting ways to assess their systems and to help the field critique how it turns broad values into numbers.
Catalog record
| CREATOR | Shalaleh Rismani, Leah Davis, Bonam Mingole, Negar Rostamzadeh, Renee Shelby, AJung Moon |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |