Measuring Users’ Mental Models of Speech Translation in Human-AI Collaboration
HyoJung Han Nishant Balepur Jordan Boyd-Graber Marine Carpuat · 2026
Read Measuring Users’ Mental Models of Speech Translation in Human-AI Collaboration by HyoJung Han Nishant Balepur Jordan Boyd-Graber Marine Carpuat (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24644.txt.
Introduction
Han, Balepur, Boyd-Graber, and Carpuat measure what users think speech translation systems can and cannot do. Millions use machine translation daily. Their mental models of system limits are nearly unstudied, though. The team's 2026 framework uses cross lingual question answering as the probe. Users hear foreign language information through translation. They either accept the machine output, or pay for professional re translation before answering.
Behaviour and accuracy across varying translation qualities reveal how well users predict where the system errs, and how that model evolves. Users' mental models grow stronger with practice, especially when they know some of the source language. They rely primarily on surface level error cues. Providing speech transcriptions also measurably improves the models users build. Han's study validates cross lingual question answering as a downstream instrument for studying human AI collaboration, with a direct design implication: expose the cues users actually read.
Catalog record
| CREATOR | HyoJung Han Nishant Balepur Jordan Boyd-Graber Marine Carpuat |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.24644
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Measuring Users’ Mental Models of Speech Translation in Human-AI Collaboration HyoJung Han Nishant Balepur Jordan Boyd-Graber Marine Carpuat Abstract Millions of people use machine translation ( mt ) tools daily, yet little is known about their perception of what systems can and cannot do. This paper studies users’ mental models of speech translation systems through a new framework based on cross-lingual question answering, where users either accept mt output or request professional re-translation to answer questions based on the information presented in a foreign language. By analyzing user behavior and accuracy trends across varying translation qualities, we examine to what extent they can predict where the system is likely to be wrong, and how this mental model evolves. Users develop stronger mental models with practice, especially when they have some knowledge of the source language, primarily by relying on surface-level error cues. Moreover, providing speech transcriptions can help users develop better mental models. Our results show the promise of cross-lingual question answering as a downstream task for studying mt mental models, and advancing our understanding of human– ai collaboration. 1 Introduction Figure 1: Users’ mental model, or their understanding of an mt system’s strengths and weaknesses, is essential for effectively integrating mt system’s output or appropriately intervening on it. Geometric shapes in the figure represent the features of input/output that the users can use in updating their mental model of mt . Figure 2: Our proposed framework for measuring and updating users’ mental models of mt system. ➀ : mt system translates the source passage input. ➁ : users decide which one among each segment to re-translate by a professional translator, and which one to use as-is, forming the final passage. ➂ : the qa system does the qa consuming the passage. ➃ : the user’s reward is by the qa correctness minus how much they re-translated. Millions of people use machine translation ( mt ) tools daily, including in both casual ( Calefato et al. 2016 ; Xiao et al. 2025a ) and high-stakes contexts where errors can have serious consequences ( Liebling et al. 2020 ; Nunes Vieira 2024 ) . To use mt effectively, users must understand inputs and scenarios where systems work reliably and where they fail, so they can make informed choices about e.g., when to trust outputs and when to seek human translation. This is particularly needed in speech translation, where audio inputs further amplify variability in output quality ( Spechbach et al. 2019 ; Han et al. 2024b ) and reflect more realistic user scenarios. This understanding of a mt system’s strengths and limitations is a much needed form of mt literacy ( Bowker and Ciro 2019 ; O’Brien and Ehrensberger-Dow 2020 ) , and it forms the basis of users’ mental model s ( mm s)—their internal understanding of how an ai system works, when it succeeds or fails, and how to act on its outputs ( Norman 1983 ; Hoffman et al. 2023 ) . Such models are critical for integrating ai recommendations into decision-making ( De-Arteaga et al. 2020 ; Sieker et al. 2024 ) . Despite its importance, the study of users’ mental models in mt remains limited. The hci literature provides a starting point for studying the role of mm in human- ai collaboration, but primarily focuses on classification and regression tasks, where models have simpler error boundaries ( Bansal et al. 2019b ; Kelly et al. 2023 ) , and ai predictions directly align with the users’ decision needs ( Liu et al. 2024b ; Vats et al. 2025 ) . As a result, existing methods do not easily port to mt , where natural language outputs can be imperfect in many ways, and users must determine how to use them to make informed downstream decisions. This paper seeks to understand and improve users’ mental models of mt (Figure 1 ) by introducing a framework based on cross-lingual question answering ( qa ), where users aim to maximize task performance by either accepting mt output as-is or intervening with professional re-translation. This process naturally teaches them to recognize mt ’s error patterns and refine their mental models (Figure 2 ). This downstream framing emphasizes the “fitness for purpose” of translations, and encourages users to do a cost-benefit analysis of the impact of potential errors on answers, rather than assessing mt quality in isolation ( Mehandru et al. 2023 ; Xiao et al. 2025a ) . In this setup, users’ efforts to maximize task performance naturally reveal how they form and refine their mental models over the course of the task. This framework lets us study human mm s for speech translation, and investigate how different factors impact their formation: users’ language proficiency, input/output features they rely on, and types of interventions most effective for updating mm s. As we will see, users refine their mm s over time (§ 5.1 ): fluent and intermediate users had consistent improvements, but basic users struggled to update their models (§ 5.2 ). When examining error features, users were most responsive to output surface-level cues such as incompleteness, while topic-related errors remained the hardest to detect (§ 5.3 ). Finally, transcription explanation proved most effective by offering additional clues about error sources, while error span explanation boosted accuracy but encouraged over-reliance, limiting mm development (§ 5.4 ). Overall, this work introduces a concrete framework to measure users’ mental models of mt systems, and provides a foundation for exploring how to promote mt literacy and appropriate mm development in the wild, and for studying mm for a broader range of generation tasks such as summarization, research, and dialogue. 2 Mental Model for Machine Translation We first review how mental models have been defined and studied in prior work (§ 2.1 ), and then describe how we design our study to investigate mental models in the context of mt (§ 2.2 ). 2.1 Background and Prior Work Conceptualizations of mental models have been introduced in contexts ranging from cognitive psychology ( Norman 1983 ; Klein and Hoffman 2008 ; Iida et al. 2024 ) to explainable ai ( Miller 2018 ; Mueller et al. 2019 ; Brachman et al. 2025 ) . We adopt the definition of users’ mental models of an ai system as their understanding of its capabilities and limitations: its strengths, weaknesses, and the boundaries of its errors ( Bansal et al. 2019a ; Kelly et al. 2023 ; Vats et al. 2025 ) . Previous studies place users in human– ai collaborative tasks, where participants are rewarded for making decisions that reflect appropriate expectations of the system’s successes and failures. Kelly et al. 2023 asked participants to predict an ai agent’s accuracy across rounds of 12 trivia questions, with rewards tied to how closely their estimates matched actual performance—thus capturing their mental model of the system. In Bansal et al. 2019a ; Bansal et al. 2019b , participants were tasked with a binary decision of determining whether an object was defective, guided by recommendations from an ai system. They could accept or override the recommendation, with monetary rewards reflecting correct choices and steep penalties for errors, simulating high-stakes decision-making. However, they focus on a classification task in which the