Breakable Machine: A K–12 Classroom Game for Transformative AI Literacy Through Spoofing and eXplainable AI (XAI)

Olli Hilke, Nicolas Pope, Juho Kahila, Henriikka Vartiainen, Teemu Roos, Tuomo Parkki, Matti Tedre · 2025

Read Breakable Machine: A K–12 Classroom Game for Transformative AI Literacy Through Spoofing and eXplainable AI (XAI) by Olli Hilke, Nicolas Pope, Juho Kahila, Henriikka Vartiainen, Teemu Roos, Tuomo Parkki, Matti Tedre (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-14201.txt.

Introduction

Olli Hilke and co-authors present, in twenty twenty-five, a classroom game that teaches school students to think critically about AI. The game, Breakable Machine, is aimed at learners aged ten to fifteen. Students try to fool an image classifier, a tool that labels photos, by changing how they look or what is around them. The aim is to trigger a wrong label given with high confidence. Failure is the lesson, not a flaw.

A special view shows which image parts the model leans on. A class leaderboard lets students compare tactics. The authors say the game builds data agency, ethical sense, and a critical stance. The game and its code are free for others to use.

Catalog record

CREATOROlli Hilke, Nicolas Pope, Juho Kahila, Henriikka Vartiainen, Teemu Roos, Tuomo Parkki, Matti Tedre
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-14201

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Breakable Machine: A K–12 Classroom Game for Transformative AI Literacy Through Spoofing and eXplainable AI (XAI) Olli Hilke, Nicolas Pope, Juho Kahila, Henriikka Vartiainen, Teemu Roos, Tuomo Parkki, Matti Tedre Abstract This paper, submitted to the special track on resources for teaching AI in K–12, presents an eXplainable AI (XAI)-based classroom game “Breakable Machine” for teaching critical, transformative AI literacy through adversarial play and interrogation of AI systems. Designed for learners aged 10–15, the game invites students to spoof an image classifier by manipulating their appearance or environment in order to trigger high-confidence misclassifications. Rather than focusing on building AI models, this activity centers on breaking them—exposing their brittleness, bias, and vulnerability through hands-on, embodied experimentation. The game includes an XAI view to help students visualize feature saliency, revealing how models attend to specific visual cues. A shared classroom leaderboard fosters collaborative inquiry and comparison of strategies, turning the classroom into a site for collective sensemaking. This approach reframes AI education by treating model failure and misclassification not as problems to be debugged, but as pedagogically rich opportunities to interrogate AI as a sociotechnical system. In doing so, the game supports students in developing data agency, ethical awareness, and a critical stance toward AI systems increasingly embedded in everyday life. The game and its source code are freely available. App — [omitted-for-review] Code — [omitted-for-review] Introduction The rapid rise of artificial intelligence (AI) has fueled interest in bringing modern machine learning (ML) concepts into K–12 education, with the trend increasingly extending to pre- and in-service teacher training ( Sanusi et al. 2022 ; Eguchi et al. 2025 ; Grover 2024 ; Rizvi, Waite, and Sentance 2023 ; Martins and Gresse Von Wangenheim 2022 ; Shapiro and Fiebrink 2019 ; Long et al. 2023 ; Olari et al. 2024 ; Zhang, Lee, and Moore 2023 ) . This interest in AI education—focused not on how to use AI, but on understanding how AI systems work—reflects recognition of the influence of AI-driven technology on the future of work, societal structures, and everyday life ( Grover 2024 ; Höper and Schulte 2023 ; Sentance and Waite 2022 , e.g.,) . Current K–12 AI education efforts address AI concepts and techniques at different levels of abstraction—such as classifiers, pattern recognition, or neural networks—as well as broader themes, including AI ethics, curriculum integration, teacher professional development, and AI literacy ( Heintz and Roos 2021 ; Grover 2024 ; Druga, Otero, and Ko 2022 ; Black et al. 2024 ; Lee et al. 2022 ) . Some are focused on data—including topics such as data collection, curation, storage, and processing, with the overarching aim of cultivating students’ data awareness and fostering data agency ( Olari and Romeike 2024 ; Höper and Schulte 2023 ; Vartiainen et al. 2024b ; Morales-Navarro et al. 2024b ; Fagerlund, Palsa, and Mertala 2025 ) . Others are focused on AI techniques—including topics such as neural networks, classifiers, reinforcement learning, language models, word embeddings, and more ( Touretzky et al. 2025 ; Jatzlau et al. 2019 ; Kahila et al. 2024b ; Morales-Navarro, Noh, and Kafai 2025 ; Wiatrek, Verma, and Martin 2025 ) . Many education efforts map their learning outcomes on one or more popular AI content frameworks, such as Long and Magerko’s ( Long and Magerko 2020 ) competency framework, the AI4K12 “Five Big Ideas in AI” framework ( Touretzky, Gardner-McCune, and Seehorn 2023 ) , or UNESCO’s competency framework ( Miao and Shiohira 2024 ) . Some AI education initiatives have advocated for transformative agency, which goes beyond awareness and literacy by focusing on the learners’ capacity to not just critically understand and challenge, but also reshape AI systems and the societal structures in which they are embedded ( Iivari et al. 2024 ; Vartiainen and Tedre 2025 ; Veldhuis et al. 2025 ; Stetsenko 2019 ) . Transformative agency emphasizes the development of ethical-political awareness, volition, and collective action to resist harmful data practices and reimagine more just alternatives—as well as individual and collective efforts to break away from existing practices, take initiative, and design new futures. (a) The game app (b) A view of all students’ profile pictures, shown on the classroom projector. Figure 1: The game players work alone or in small groups, using a mobile phone with constant camera feed. (Fig. 1(a) ). Players try to find props, backgrounds, clothing, and other means to increase the classifier confidence (on label “astronaut” in this case.) At the same time, all player profile pictures and names are shown on the classroom projector (Fig. 1(b) ). AI education interventions employ a wide range of modalities. Many tools allow students to explore AI techniques using a range of gadgets, apps, and games ( Wiatrek, Verma, and Martin 2025 ; Touretzky et al. 2025 ; Kahila et al. 2024a ; Cardenas, Molas, and Puertas 2023 ) . AI auditing activities focus on interrogating existing systems ( Morales-Navarro et al. 2024a ) , and unplugged activities do not require computers ( Lindner, Seegerer, and Romeike 2019 ) . One of the most popular approaches involves training one’s own models—for instance, with Google Teachable Machine, Generation AI Teachable Machine, MIT’s Personal Image Classifier, or IBM’s Machine Learning for Kids ( Carney et al. 2020 ; Pope et al. 2025 ; Tang et al. 2019 ; Lane 2021 ) . A key learning moment in model training arises when the system behaves unexpectedly: the user encounters an “expectation mismatch” between the model’s output and their own expectation of what it should be ( Dhanorkar et al. 2021 ) . Such unexpected or incorrect predictions prompt the learner to dig deeper into the training data and process ( Tedre, Denning, and Toivonen 2021 ; Olari and Romeike 2024 ) . While most prior educational tools have focused on training AI systems, some classroom tools---such as ‘‘Erase Your Face’’ 1 1 1 https://youthradio.github.io/erase-your-face/ ( Abiodun et al. 2020 ) —have instead focused on how to break image classifiers. The tool presented in this paper elaborates the “breaking AI systems” theme by offering a playful, conceptually rich learning experience that highlights the concepts of trust, robustness, and accountability in AI. To better support students’ transformative AI agency, we have developed an eXplainable AI (XAI)-driven classroom game that teaches children about the kinds of failures typical of many AI systems through engaging in spoofing an AI system; i.e., carrying out an adversarial attack against an image recognition system. The Breakable Machine game aims to facilitate the development of a critical, transformative stance toward AI by enabling learners to take control over AI systems through hands-on experimentation, guided reflection, and collective sense-making. In the game, students are challenged to manipulate their appearance—such as what they wear or what is seen in the background—to “trick” an image recognition system into producing a high-confidence classification for a given label (e.g., “doctor”). All students in the class attempt the challenge in parallel, and the system displays each student’s highest-confidence result on a shared leaderboard projected on the teacher’s screen. This technical, non-empirical paper describes the design and pedagogical foundations of the game, illustrated with screenshots and classroom use scenarios. As empirical evaluation of learning outcomes is scheduled for future

Read the complete text