A Scoresheet for Explainable AI

Michael Winikoff, John Thangarajah, Sebastian Rodriguez · 2025

Read A Scoresheet for Explainable AI by Michael Winikoff, John Thangarajah, Sebastian Rodriguez (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09861.txt.

Introduction

Michael Winikoff, John Thangarajah, and Sebastian Rodriguez built a scoresheet for explainable AI in a 2025 paper. Explanations support trust in autonomous systems, and standards demand transparency, but they speak too generally to specify what a given system must explain. The authors derived their scoresheet from the needs of the many parties around a system: users, developers, regulators, and others affected.

The sheet can be used two ways, to write explainability requirements before building, or to grade what a finished application actually explains. Worked examples across several domains show its range. Although aimed first at multi-agent systems, the tool applies to AI more broadly. The authors supply guidance on filling it in, turning a vague virtue into checkable rows.

Catalog record

CREATORMichael Winikoff, John Thangarajah, Sebastian Rodriguez
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-09861

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Scoresheet for Explainable AI Michael Winikoff, John Thangarajah, Sebastian Rodriguez Abstract . Explainability is important for the transparency of autonomous and intelligent systems and for helping to support the development of appropriate levels of trust. There has been considerable work on developing approaches for explaining systems and there are standards that specify requirements for transparency. However, there is a gap: the standards are too high-level and do not adequately specify requirements for explainability . This paper develops a scoresheet that can be used to specify explainability requirements or to assess the explainability aspects provided for particular applications. The scoresheet is developed by considering the requirements of a range of stakeholders and is applicable to Multiagent Systems as well as other AI technologies. We also provide guidance for how to use the scoresheet and illustrate its generality and usefulness by applying it to a range of applications. Y. Vorobeychik, S. Das, A. Nowé (eds.) Conference: Proc. of the 24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2025); May 19 – 23, 2025; Detroit, Michigan, USA 367 1. Introduction It is important for autonomous and intelligent systems 1 1 1 Terminology: Since we consider both autonomous systems and other systems that use a range of Artificial Intelligence techniques, we use “autonomous and intelligent systems”, sometimes compressed to just “intelligent systems”. We also avoid the term “model” (unless we are specifically talking about machine learning) in favour of “module”. Finally, we use “behaviour” as shorthand for “behaviour or outcome” which encompasses the system taking action or providing some output (e.g. a classification or recommendation). to be explainable for a range of reasons. Providing explanations can be required by legislation either directly (e.g. GDPR 2 2 2 https://data.consilium.europa.eu/doc/document/ST-5419-2016-INIT/en/pdf ) or indirectly as a consequence of legislation ( Winikoff and Sardelić, 2021 ) . Providing explanations can also play a crucial role in helping to make autonomous and intelligent systems socially acceptable ( Floridi et al., 2018 ) , transparent ( Winfield et al., 2021 ; Anjomshoae et al., 2019 ) , understandable ( Verhagen et al., 2021 ) , accountable ( Cranefield et al., 2018 ) , and to help establish an appropriate level of trust ( Langley et al., 2017 ; Winikoff, 2017 ; Robinette et al., 2016 ; Floridi et al., 2018 ; Rodriguez et al., 2024 ; Rodriguez and Thangarajah, 2024 ) . The importance of explainability has also been recognised by various standards. For instance, the Ethics Guidelines for Trustworthy AI 3 3 3 https://digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai and subsequent Assessment List for Trustworthy Artificial Intelligence (ALTAI) for self-assessment 4 4 4 https://digital-strategy.ec.europa.eu/en/library/assessment-list-trustworthy-artificial-intelligence-altai-self-assessment consider explainability as one of a range of factors (e.g. human agency and oversight, accountability, societal & environmental well-being). IEEE P7001 ( IEEE, 2022 ) also considers explainability as part of transparency, and defines a number of requirements relating to explainability (e.g. that information is provided on how a system works in general, or that the system provides the ability to answer “why?” questions). However, this work does not provide adequate guidance for the development and evaluation of the explainability of systems. The Ethics Guidelines for Trustworthy AI only poses questions that ask whether the decisions and outcomes can be understood and whether an explanation is provided, and the Assessment List has just two questions: ‘‘Did you explain the decision(s) of the AI system to the users?’’ and ‘‘Do you continuously survey the users if they understand the decision(s) of the AI system?’’. Similarly, IEEE P7001 only provides a few explainability requirements (‘‘why?’’ and ‘‘what if?’’ questions, as well as global 5 5 5 A common distinction ( Hoffman et al., 2023c ; Liao et al., 2020 ) is between local explanations that relate to a specific execution (e.g. “why did you do this?”), and global explanations that are not about a specific execution, and hence more general, but necessarily less detailed. explanation - see § 2 ), and Hoffman et al. ( Hoffman et al., 2023a ) assign each system only a single number (1-7). Following IEEE P7001, we propose to provide this guidance in the form of a scoresheet 6 6 6 Our scoresheet does not use numbers, but it contains more than just checkboxes, so we use the term “scoresheet” for consistency with P7001. . The P7001 scoresheet focuses on transparency, and is complementary to our scoresheet: our scoresheet is specifically for explainability, and provides details, whereas P7001 has considerably less detail on explainability (see § 3.1 ). The scoresheet can be used in various ways with the most obvious being to evaluate the explainability of candidate systems. Used this way, the responses affect which system is chosen because the scoresheet captures that a crucial explainability aspect is lacking, or that another system provides it better. Explanations are used by different people for different purposes ( Gregor and Benbasat, 1999 ; Biran and McKeown, 2014 ; Mittelstadt et al., 2019 ; Langer et al., 2021 ; Buiten et al., 2023 ) , and therefore we develop our scoresheet by considering the explainability needs of different stakeholders (§ 2 ). This paper makes a number of contributions. Firstly, we develop (and justify) a scoresheet 7 7 7 The scoresheet was developed iteratively (define, apply, revise); the version presented in § 3 is the final one. for explainability (§ 3 ). Secondly, we provide additional detailed guidance on how to complete the scoresheet (§ 4 ), including an additional checklist for global explanations. Thirdly, we demonstrate that the scoresheet is applicable to a range of systems (§ 5 ), showing that the scoresheet is usable and generic , as well as that it is useful (i.e. that it provides a useful summary). 2. Stakeholder Explainability Needs IEEE P7001 ( Winfield et al., 2021 ; IEEE, 2022 ) defines five stakeholder groups: end users, wider public & bystanders, safety certifiers, incident/accident investigators, and lawyers & expert witnesses. They consider the range of forms of transparency that each requires. For instance, that end users might want to be able to get natural language answers to “why did you do that?” and “what would you do if …?” questions. Or that safety certifiers need information on what steps were taken to verify and validate a system. They go on to propose a simple transparency scale for each of the five stakeholder groups. For example, for an end user, the levels can be summarised as: 0: “no transparency”; 1: information provided on how the system works in general (including, if relevant, on data used); 2: same as 1, but interactive; 3: ability to answer“why?” questions for specific cases; 4: ability to answer hypothetical “what if?” questions; and 5: provision of “continuous explanation …that adapts …based on the user’s information needs and context”. Arya et al. ( Arya et al., 2019 ) argue that different stakeholders require different sorts of explanations. They propose a taxonomy (and associated toolkit) that allows stakeholders to select an explanation method that suits their needs. Their context is narrower than ours (machine learning systems that learn from data). Their taxonomy considers factors such as the following. Are explanations (of data) given as particular features (e.g. income or level of debt), examples, or distributions? Do explanations explain

Read the complete text