Talking Back – human input and explanations to interactive AI systems

Alan Dix, Tommaso Turchi, Ben Wilson, Anna Monreale, Matt Roach · 2025

Read Talking Back – human input and explanations to interactive AI systems by Alan Dix, Tommaso Turchi, Ben Wilson, Anna Monreale, Matt Roach (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04343.txt.

Introduction

Explanations can flow from humans to AI, not only the other way, Alan Dix and co-authors argue in a 2025 paper. Explainable AI focuses on giving human users reasons for machine judgments. The authors ask whether human explanations of their own judgments can guide learning models toward judgments and explanations that align more closely with human concepts, making the partnership richer.

The paper explores varied forms of human input to interactive AI systems. It examines how such input can be captured and used during learning and use. Rather than a single experiment, the work maps a design space for talking back to AI. Readers interested in human-AI teamwork get a set of options for building systems that learn from people in words, not just labels.

Catalog record

CREATORAlan Dix, Tommaso Turchi, Ben Wilson, Anna Monreale, Matt Roach
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-04343

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Talking Back – human input and explanations to interactive AI systems Alan Dix, Tommaso Turchi, Ben Wilson, Anna Monreale, Matt Roach Abstract While XAI focuses on providing AI explanations to humans, can the reverse – humans explaining their judgments to AI – foster richer, synergistic human-AI systems? This paper explores various forms of human inputs to AI and examines how human explanations can guide machine learning models toward automated judgments and explanations that align more closely with human concepts. [orcid=0000-0002-5242-7693, [email protected], url=https://alandix.com/, ] [orcid=0000-0001-6826-9688,[email protected]] [orcid=0009-0004-5663-5854,[email protected]] [orcid=0000-0001-8541-0284,[email protected]] [orcid=000-0002-1486-5537,[email protected]] keywords human-AI interaction ,explainable AI ,synergistic human-AI systems ,user interface ,artificial intelligence ,design ,adaptive interfaces ,user experience † † copyrightyear: 2025 † † copyright: Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: Joint Proceedings of the ACM IUI Workshops 2025, March 24-27, 2025, Cagliari, Italy. † † address: Cardiff Metropolitan University, Wales, UK † † address: Computational Foundry, Swansea University, Wales, UK † † address: Department of Computer Science, University of Pisa, Pisa, Italy 1 Introduction It is now well accepted that it is important for AI systems to offer explanations to users Liao et al. 2020 ; indeed this is embedded in the EU GDPR legislation Council of the European Union 2016 . This paper poses the converse question, “what if users offered explanations of their decisions to an AI system”. One of the reasons for transparency and XAI (explainable AI) is to surface potential bias as first noted by one of the authors in the early 1990s Dix 1992 . This is equally important for humans, especially when their input is being used to train an AI system, which might otherwise embody the trainer’s prejudices. However, human explanations offer other advantages, allowing machine learning (ML) that is more aligned with human reasoning, and can itself be explained in more human-like ways. In the rest of this paper, we will first look more broadly at the ways humans currently engage with AI systems in terms of the kinds of inputs they provide (Section 2 ). We then look at ways in which human explanations might be provided at the user interface level (Section 3 ). This will create a series of examples of different kinds of user explanations, which raises algorithmic (Section 4 ), architectural (Section 5 ), and even social challenges (Section 6 ). Once one thinks in terms of human explanations, it is possible to see elements of this in previous work, not least classic knowledge elicitation techniques Shadbolt and Smart 2015 . However, it appears to be a largely unexplored area, and we hope to encourage others to explore it with us. 2 Human inputs to AI With the exception of chatbots, humans and AI typically take very different kinds of roles during an interaction. Figure 1 show some common ways in which they communicate. During learning a human expert may provide labeled training examples, which are used to create a model such as a neural network, decision tree or rule set. This model is then used in practice when the user makes some sort of query, perhaps presenting an unseen data item to classify, whereupon the AI system provides a predicted classification or other form of advice or answer. Often also an XAI system will create some form of explanation, that to some extent ‘explains’ the AI system’s response. Most commonly this is a local explanation that explains the classification or decision about a particular data item and those close to it, rather than a global explanation of the model as a whole. Figure 1: Common communications between human user and AI. If we focus on the human inputs, we can identify a number of common ways that knowledge is passed to the AI: example data – This may be part of a batch exercise during training, or may be more interactive. For example, in Query-by-Browsing (QbB; see Fig. 2 ), the user looks through a database listing selecting some records of interest and rejecting others; after a while the system infers an SQL query Dix and Patrick 1994 . However, if this query is not correct, the user can simply provide more positive or negative examples of data records, leading to a revised system SQL query. labeling – Training data is often labeled, but users may also be explicitly asked to label data items for which the algorithm has low confidence, or to help verify learnt rules. In particular during interactive learning Ware et al. 2001 ; Fails and Olsen Jr 2003 ; Dudley and Kristensson 2018 , the expert presents training data, but the system may challenge these with counterfactuals, leading to a form of ‘conversation’ where each utterance is a labeled data item. relevance/quality feedback – Often users are asked to give some form of explicit star rating or thumbs up, which is used to incrementally improve relevance models. This can be thought of as a form of post-hoc labeling. implicit sensing – The training data and/or labeling may be captured implicitly from one or more humans, for example using physical sensors for activity recognition, click-through data for search optimisation, or purchase/viewing history for recommender systems. This form of data gathering can be made more effective through careful user interface design, such as epistemic interaction Dix et al. 2024 . Figure 2: Query-by-Browsing – how it works Dix and Patrick 1994 . As well as these common forms of human information provision, there are some less common ones: confirming/rejecting system rules – In some variants of Query-by-Browsing when the system generates a rule, the user can reject it and then the system would search for an alternative rule. editing/amending system rules – When the model used by the AI is a transparent set of rules, it may be possible for the user to tinker with them. One variant of QbB used a genetic algorithm to generate conjunctive rules displayed in a query-by-example-style tableau Dix 1998 . In this case the user could accept a rule, but also edit some of the parts of it, for example, changing the threshold in a ‘greater than’ clause. Similarly, the paper that first introduced the term ‘interactive machine learning’, described a system where the user and machine learning system worked collaboratively to create a decision tree Ware et al. 2001 . confirmation of explanations – When the model is more obscure, local or global explanations may be given. In these cases the user may accept, reject or rate an explanation. This does not mean not so much that the explanation is not correct in the sense of matching the model’s behaviour (one presumes that the XAI engine ensures this), but more whether it is comprehensible or useful. In the case of an expert this might be saying “I agree with the model’s output, but this is not the right reason for it”, for the novice end user more “yes that was helpful”. This can be used as a form of relevance/quality feedback for the XAI engine. editing/amending explanations – FRANK Mazzoni et al. 2024 uses a ‘skeptical learning’ approach Monreale and Teso 2024 , which allows the user to reject or modify an explanation. Similarly Teso and Kersting 2019 ask a human

Read the complete text