The Imitation Game for Educational AI
Shashank Sonkar, Naiming Liu, Xinghe Chen, Richard G. Baraniuk · 2025
Read The Imitation Game for Educational AI by Shashank Sonkar, Naiming Liu, Xinghe Chen, Richard G. Baraniuk (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15127.txt.
Introduction
Shashank Sonkar, Naiming Liu, Xinghe Chen, and Richard Baraniuk offer a new test for whether a teaching AI truly grasps how a student thinks, in a paper from 2025. Long studies of learning gains are slow and tangled by many side factors.
Their test works in two phases. First, students answer in their own words, which shows their false beliefs. Next, the AI and human experts each craft wrong options for new items, based on that one student errors. If students pick the AI wrong options as often as the expert ones, the AI likely models minds well. The authors prove the test must be tied to each student.
Catalog record
| CREATOR | Shashank Sonkar, Naiming Liu, Xinghe Chen, Richard G. Baraniuk |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-15127
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Imitation Game for Educational AI Shashank Sonkar, Naiming Liu, Xinghe Chen, Richard G. Baraniuk Abstract As artificial intelligence systems become increasingly prevalent in education, a fundamental challenge emerges: how can we verify if an AI truly understands how students think and reason? Traditional evaluation methods like measuring learning gains require lengthy studies confounded by numerous variables. We present a novel evaluation framework based on a two-phase Turing-like test. In Phase 1, students provide open-ended responses to questions, revealing natural misconceptions. In Phase 2, both AI and human experts, conditioned on each student’s specific mistakes, generate distractors for new related questions. By analyzing whether students select AI-generated distractors at rates similar to human expert-generated ones, we can validate if the AI models student cognition. We prove this evaluation must be conditioned on individual responses - unconditioned approaches merely target common misconceptions. Through rigorous statistical sampling theory, we establish precise requirements for high-confidence validation. Our research positions conditioned distractor generation as a probe into an AI system’s fundamental ability to model student thinking - a capability that enables adapting tutoring, feedback, and assessments to each student’s specific needs. 1 Introduction A fundamental challenge in artificial intelligence for education is developing systems that truly understand how students think and reason [ 1 , 2 , 3 , 4 ] . While recent advances have produced AI systems that can engage with students and curate educational content [ 5 , 6 , 7 , 8 , 9 , 10 ] , these systems often lack deep understanding of student cognition - how students develop misconceptions, how they reason incorrectly, and why they make specific mistakes [ 11 , 12 , 3 , 13 ] . This understanding is critical for providing meaningful educational support, whether through tutoring, feedback, or assessment. Currently, it’s difficult to determine whether an AI system possesses this crucial understanding of student thinking [ 14 , 15 , 16 ] . Figure 1: A novel Turing-like test for evaluating AI’s understanding of student cognition through distractor generation conditioned on individual students’ demonstrated misconceptions. In Phase 1 (Response Collection), students solve a mathematical expression Q: 1 + 2 * 3 + 4 = ?, revealing common misconceptions such as solving from left to right (yielding 13) or applying addition before multiplication (yielding 21). In Phase 2 (Conditional Distractor Generation), for a new question Q’: 3 + 4 * 3 + 7 = ?, both AI and human experts generate distractors based on observed student misconceptions. The resulting multiple-choice question presents four options: the correct answer, a human expert-generated distractor, an AI-generated distractor, and a random distractor. By analyzing whether students select AI-generated distractors at rates similar to human expert-generated ones, we can rapidly evaluate if the AI system truly understands student cognition. This ability to model and predict student misconceptions is fundamental to providing effective feedback and tutoring, as an AI system that can accurately anticipate how students will misunderstand new concepts can provide targeted, personalized educational support. Note distractor generation must be conditioned on students’ prior responses, as unconditioned approaches converge to targeting only the most frequent misconception, failing to test AI’s understanding of individual student reasoning. While traditional learning outcome studies require extended periods to validate educational AI systems, this test provides rapid evaluation through conditional distractor generation. Traditional evaluation methods like measuring learning gains, while important, suffer from significant limitations. These studies not only require months or even years to conduct [ 17 , 18 , 19 ] , but their results are confounded by numerous variables - including changes in student motivation and external support, variations in classroom environments and teaching styles, and broader educational policy shifts that occur during the study period [ 20 , 21 ] . Such confounders make it difficult to isolate whether any observed improvements truly stem from the AI system’s deep understanding of student cognition or from other factors entirely. In contrast to traditional studies with their many confounding variables, we propose a two-phase evaluation methodology to directly test an AI system’s understanding of student cognition. In Phase 1, students complete open-ended questions without multiple choice options, providing unbiased samples of natural misconceptions. In Phase 2, for each incorrect answer from Phase 1, the AI must generate a new but related question Q’ and predict what wrong answer A’ the same student would give to Q’. The key innovation is that these predictions are explicitly conditioned on each student’s specific Phase 1 mistakes - without this conditioning, any approach would simply target the most common misconceptions rather than demonstrate understanding of individual reasoning. This creates a personalized test of the AI’s ability to model individual student thinking. The student then receives Q’ as a multiple choice question containing the correct answer, the AI’s predicted wrong answer A’, a human expert’s predicted wrong answer A”, and a random incorrect answer. By analyzing whether students select AI-generated distractors at rates similar to human expert-generated ones, we can directly validate if the AI system genuinely models student cognition. This approach mirrors the Turing test in a compelling way: just as the original test evaluates AI through its ability to produce human-like conversational responses, our framework evaluates AI through its ability to predict student mistakes as accurately as expert teachers do. Success requires two fundamental capabilities: understanding common patterns in student misconceptions and predicting how these misconceptions will manifest for individual students across different problems. An AI system that can match human experts in this prediction task demonstrates genuine understanding of student cognition - it’s not just recognizing statistical patterns, but modeling the underlying reasoning processes that lead students to specific mistakes. This understanding of student cognition, as demonstrated through distractor generation conditioned on a student’s specific errors, is not just a narrow capability but underpins virtually every aspect of AI-supported education. An AI system that can model how a student reasons about a concept, based on observing their specific mistakes, can better adapt its tutoring, feedback, and assessments to that student’s needs. Our research thus positions conditioned distractor generation not merely as an evaluation tool, but as a probe into an AI system’s fundamental ability to model student thinking - a capability essential for meaningful educational support. While predicting wrong answers might seem a narrow technical challenge, we show it requires precisely the kind of deep understanding of student cognition that has been missing from current educational AI systems. This paper makes several key contributions: 1. A Novel Turing-like Test for Educational AI: We introduce a practical and efficient approach to evaluating educational AI systems through a two-phase Turing-like test. Unlike traditional evaluation methods that require lengthy studies of learning outcomes, our test provides a direct measure of an AI system’s ability to model student thinking by having it generate new questions and predict errors based on observed student mistakes. The test evaluates whether these AI-generated predictions are indistinguishable from those created by expert human educators, providing a concrete benchmark for measuring progress in educational AI systems’ ability to understand individual student reasoning. 2. Positioning Conditioned Distractor Generation as a Core Test of Educational AI Capabilities: Building on this testing methodology, we establish that the ability to generate distractors conditioned on a student’s specific