Improving Human-Robot Teaching by Quantifying and Reducing Mental Model Mismatch
Phillip Richter, Heiko Wersing, Anna-Lisa Vollmer · 2025
Read Improving Human-Robot Teaching by Quantifying and Reducing Mental Model Mismatch by Phillip Richter, Heiko Wersing, Anna-Lisa Vollmer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-04755.txt.
Introduction
Phillip Richter, Heiko Wersing, and Anna-Lisa Vollmer study how people teach robots. Problems arise when a person's picture of the robot's learning does not match how the robot in fact learns. Their 2025 paper sets out a score that measures that mismatch. Good teaching, they argue, needs the teacher's picture and the robot's skills to line up.
The team used large language models to read what teachers meant from their words and to give feedback shaped to each teacher. In a study with 150 people teaching a virtual robot a puzzle game, feedback based on intent beat feedback based on scores alone, and beat no feedback. Teachers also grasped the robot's learning better and held fewer wrong ideas about it.
Catalog record
| CREATOR | Phillip Richter, Heiko Wersing, Anna-Lisa Vollmer |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-04755
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improving Human-Robot Teaching by Quantifying and Reducing Mental Model Mismatch Phillip Richter, Heiko Wersing, Anna-Lisa Vollmer Abstract The rapid development of artificial intelligence and robotics has had a significant impact on our lives, with intelligent systems increasingly performing tasks traditionally performed by humans. Efficient knowledge transfer requires matching the mental model of the human teacher with the capabilities of the robot learner. This paper introduces the Mental Model Mismatch (MMM) Score, a feedback mechanism designed to quantify and reduce mismatches by aligning human teaching behavior with robot learning behavior. Using Large Language Models (LLMs), we analyze teacher intentions in natural language to generate adaptive feedback. A study with 150 participants teaching a virtual robot to solve a puzzle game shows that intention-based feedback significantly outperforms traditional performance-based feedback or no feedback. The results suggest that intention-based feedback improves instructional outcomes, improves understanding of the robot’s learning process and reduces misconceptions. This research addresses a critical gap in human-robot interaction (HRI) by providing a method to quantify and mitigate discrepancies between human mental models and robot capabilities, with the goal of improving robot learning and human teaching effectiveness. I Introduction The rapid development of artificial intelligence and robotics has significantly changed many aspects of our lives [ 59 , 46 , 14 , 67 ] . Intelligent systems are increasingly taking over tasks traditionally performed by humans, from industrial production lines to personal assistants in smartphones [ 43 , 25 ] . This automation can simplify our lives by handling repetitive or dangerous tasks. However, teaching robots effectively requires robust feedback mechanisms tailored to human-robot teaching scenarios. Feedback plays a crucial role in ensuring that robots learn efficiently while minimizing misunderstandings arising from misaligned mental models [ 27 , 53 ] . Fig. 1: Interactive user interface used to teach the RiddleBot to solve the puzzle game Superdoku. The interface includes a 3x3 grid for the RiddleBot’s task, an input interface for tokens, and fields for user input and feedback visualization. The interaction between humans and intelligent systems can be complex [ 61 ] . Intelligent systems learn through specific algorithms that differ significantly from human learning behavior [ 30 ] . Humans tend to project their own experiences and perceptions onto the system, resulting in a mental model that often does not match the real functioning of the system [ 48 , 37 ] . This discrepancy, or mental model mismatch, can lead to ineffective teaching methods that fail to take full advantage of the system’s learning capabilities, thereby slowing and hindering the teaching process [ 40 , 23 ] . With this in mind, the research question arises as to whether the inclusion of the human mental model of the intelligent system, explicitly incorporated into the feedback generation process, leads to humans better understanding the architecture of the system and thus being able to teach it more effectively. The relevance of this research derives from the observation that a high mental model mismatch can lead to frustrating and inefficient interactions between humans and intelligent systems [ 5 ] . Misaligned feedback from the system not only fails to aid teaching but can also be counterproductive [ 28 ] . An understanding of the human’s mental model is critical to creating adaptive feedback mechanisms that respond to user expectations, potentially improving overall interaction quality [ 50 ] . This work presents a novel approach: the Mental Model Mismatch (MMM) score , representing the mismatch between a human’s mental model and an intelligent system’s architecture. The MMM score provides a systematic way to quantify and reduce this mismatch, aligning human teaching behaviors with robot learning. Using the user’s natural language input, we abstract a simplified representation of their mental model to generate adaptive feedback. While this method does not fully capture the complexities of human mental models or robot functionality, it provides a practical approach to simplifying and improving human-robot teaching interactions. II Related Work The vision of cooperative intelligence, emphasises the importance of mutual understanding between humans and intelligent systems to achieve synergy towards human-centred values and goals [ 58 , 34 ] . Mental models are intrinsic frameworks that human individuals use to interpret, understand, and engage with the world around them. These cognitive constructs are shaped by personal experiences, education, and cultural background, allowing individuals to predict outcomes, make decisions, and solve problems [ 32 ] . This concept is influential in cognitive psychology, user experience design, and education [ 31 , 66 , 7 ] . In HRI, mental models refer to individuals’ cognitive representations of intelligent systems, such as robots, including beliefs about their capabilities and operation principles [ 62 , 45 ] . These models shape individuals’ expectations and interactions with robots, particularly in scenarios where understanding a robot’s architecture and functionality is critical for effective task performance [ 29 , 62 , 20 ] . Mental models are a key aspect to building understandable robots [ 22 , 26 ] . The Theory of Mind describes the ability to understand that other individuals have thoughts and feelings that are different from one’s own [ 19 ] . This involves creating mental models of other individuals’ mental states in order to predict and explain their behavior [ 65 ] . Further, the Theory of Mind was identified as a crucial component of the mental model for cooperative interactions and efficient joint work performance [ 17 , 10 , 18 ] . Minimizing the mismatch between human and robotic mental models is essential for the comprehension of intelligent agents [ 22 ] . Interactive task learning (ITL) in HRI involves humans teaching new tasks via natural interactions to robots, using techniques such as demonstration, feedback and dialogue [ 35 , 3 ] . This approach improves the adaptability and efficiency of robots in dynamic environments by enabling them to learn skills directly from human users, eliminating the need for extensive pre-programming [ 38 , 6 ] . Recent studies have explored scaffolding techniques, which involve structured guidance during the teaching process, to improve the human teacher’s ability to communicate concepts to robots [ 38 ] . For example, providing visual cues or simplified explanations of the robot’s learning mechanisms has been shown to reduce frustration and improve task performance [ 13 ] . These techniques highlight the potential for well-designed interfaces and feedback systems to enhance user engagement and teaching efficiency. Metrics commonly used to evaluate teaching efficiency include task completion rates, concept acquisition rates, and subjective user satisfaction. However, these metrics often fail to address the alignment of user intentions with robot learning outcomes. Mental models have been identified as a crucial didactic conceptual tool for understanding the process of human teaching in complex subjects like mathematics or physics [ 21 ] . Successful teaching requires aligning the existing and acquired mental models of the student with the teacher’s target mental model. This in turn makes it important for the teacher to observe and estimate the internal mental model of the student to notice any inconsistencies [ 49 ] . A similar approach seems interesting for teaching in HRI. Recent research has investigated the quantification of teaching efficiency of human teachers in robotic manipulation tasks.