Actionable AI: Enabling Non Experts to Understand and Configure AI Systems
Cecile Boulard, Sruthi Viswanathan, Wanda Fey, Thierry Jacquin · 2025
Read Actionable AI: Enabling Non Experts to Understand and Configure AI Systems by Cecile Boulard, Sruthi Viswanathan, Wanda Fey, Thierry Jacquin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-06803.txt.
Introduction
Boulard and co-authors argue for Actionable AI, systems that non-experts can grasp and steer directly. Explanations help, but many users lack domain depth or a stable setting to use them. The team tested a cartpole game run by an AI agent. Twenty-two pairs of players tuned the agent by direct manipulation. They worked under uncertain conditions with no expert help.
Despite that, pairs reached good performance levels. Handling the agent's levers gave them a working grasp of its behavior. That hands-on sense proved enough to hit their goals. The authors draw design lessons for systems that invite direct control. Access, they argue, means agency, not just insight.
Catalog record
| CREATOR | Cecile Boulard, Sruthi Viswanathan, Wanda Fey, Thierry Jacquin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-06803
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Actionable AI: Enabling Non Experts to Understand and Configure AI Systems Cecile Boulard, Sruthi Viswanathan, Wanda Fey, Thierry Jacquin Abstract . Interaction between humans and AI systems raises the question of how people understand AI systems. This has been addressed with explainable AI, the interpretability arising from users’ domain expertise, or collaborating with AI in a stable environment. In the absence of these elements, we discuss designing Actionable AI , which allows non-experts to configure black-box agents. In this paper, we experiment with an AI-powered cartpole game and observe 22 pairs of participants to configure it via direct manipulation. Our findings suggest that, in uncertain conditions, non-experts were able to achieve good levels of performance. By influencing the behaviour of the agent, they exhibited an operational understanding of it, which proved sufficient to reach their goals. Based on this, we derive implications for designing Actionable AI systems. In conclusion, we propose Actionable AI as a way to open access to AI-based agents, giving end users the agency to influence such agents towards their own goals. Conference: CHI conference on Human Factors in Computing Systems; April 26 – May 01, 2025; Yokohama, Japan ISBN: 978-1-4503-XXXX-X/18/06 CHI 2025 ISBN: 2025 CCS: Human-centered computing Human computer interaction (HCI) Figure 1. Hybrid experiment setup for non-expert participants to experience Actionable AI via a cartpole game (Left) and visualisation of the experiment session of participants P9 and P10 (Right). Experiment setup and game vis. 1. Introduction ‘What goes up, must come down.’ While physicists might describe gravity as one of the most misunderstood forces of nature ( Gönen, 2008 ) , a layperson can articulate a sufficient understanding with this common phrase. Similarly, while we may not have an intricate understanding of everyday concepts such as gravity, internet, and banking (as experts in these respective fields do), as everyday users we are able to interact with these systems successfully to get the outcomes we desire. In a similar light, users of AI systems can often come to be everyday users who are neither Machine Learning (ML) experts, nor hold expertise in any particular domain (such as medicine or finance). One of the key aspects of Human-Centred AI (HCAI) research is ensuring control of AI systems to all kinds of users ( Shneiderman, 2022 ) despite their different levels of knowledge and understanding. Designing user-friendly AI systems that are easy to adapt and adopt is the end game for the success of AI in our society ( Dourish, 2003 ) . Today, HCAI efforts aid ML experts, who build, train, and test their ML models, with paradigms such as human-in-the-loop ( Wu et al., 2022 ) , to learn from the domain experts or everyday users. Domain experts without advanced ML knowledge, are supported with interpretable ( Fiebrink et al., 2009 ) and explainable ( Gunning et al., 2019 ) elements to collaborate with AI systems as per their specific needs. Everyday users who have little to no experience with ML, are mostly offered explanations ( Doran et al., 2017 ) and more recently virtual exploration playgrounds ( Dang et al., 2022 ) for interacting with AI systems. However, the success of these concepts largely relies on either or all of the following: (i) the opportunity to instruct users with explanations ( Arrieta et al., 2020 ) , (ii) users’ prior knowledge of ML ( Dudley and Kristensson, 2018 ) or domain ( Ramos et al., 2020 ) , (iii) collaborations with AI in controlled environments ( Caldwell et al., 2022 ) , and (iv) AI systems built on transparent models ( Chao et al., 2010 ) . Everyday users do not engage with Explainable AI ( Miller, 2023 ) . In real-life scenarios, embedded AI in autonomous navigating systems, such as autonomous robots questions these expertise-, explanation-, or environment-dependent HCAI concepts. Having an autonomous robot in houses or large buildings require the ability to adapt its behaviour to ensure performance and safety. In such personal environments, risks, expectations, norms, culture, habits, language are so specific that success of domestic autonomous robots is bounded to an easy way to configure it ( Ackerman, 2020 ) . Rethinking and pre-planning affordances for embedded AI scenarios, at different levels of system, environment, and observer (user) ( Şahin et al., 2007 ) is a need of the hour. We propose the framework of Actionable AI , for proactively instilling affordances in AI systems for interactions with everyday (non-expert) users, facing unexplained (blackbox) models, in uncertain environments. In this contribution, we focused on experimenting the feasibility of this Actionable AI framework, answering the following research question. Research Question: Can non-experts succeed in configuring a black-box agent in an actionable environment to meet their goals without a prior understanding of the rules and goals of the agent? To answer our research question, we bring about Actionable AI, by building on: (i) the environment of real-time strategy video games ( Buro, 2003 ) , (ii) a Human-in-the-loop technique called influences ( Jacquin et al., 2022 ) , and (iii) Open AI Gym’s cartpole agent ( Balawejder, 2021 ) . In the classic cartpole game ( AI, 2006 ) , a pole ( reversed pendulum ) placed on the top of a horizontally moving cart, is controlled by an AI algorithm that tries to keep the pole from falling off as long as possible. In our adapted version of this game (Figure 1 ), players had to move the cartpole in the screen to pass all the gates (vertical lines as in a pseudo ski slalom) using influences (two circles on the screen controlled by the keyboard). Our experimental setup was a black box for non-expert participants who received no explanations, neither about the cartpole, nor about the influences. We ran the experiment, with 30-minute gaming time, in a hybrid setting with 22 teams of two players each (44 participants). Half of the teams (22 out of 44 participants), were informed about the AI’s control of the cartpole before the experiment, while the rest were informed after. For every session, one participant was physically co-located with us and the other was remote. This organisation allowed us to mimic the context of collaborative games. Our findings suggest that 14 out of 22 teams were able to reach a good level of performance in the AI-controlled cartpole and its influences, as they could configure its behaviour for winning the cartpole game with unknown rules. Indeed, their learning curves were fast, and the use of influences was intuitive. 20 out of 22 players who used the influences to control the cartpole developed an understanding of the system that led them to acquire operating knowledge, which proved sufficient for interacting with the cartpole black box. Of the 22 participants who were informed about the presence of an AI in the system, 15 self-reported that they failed to remember it during their interaction. Despite this, they were still able to act on the AI and configure it to meet their needs, without necessarily needing to fully understand its underlying autonomy. This suggests that the participants focused on their ability to adapt/control the AI, rather than the fact that it was autonomous. Our observations also unveil how influences gave