Designing Intent: A Multimodal Framework for Human-Robot Cooperation in Industrial Workspaces
Francesco Chiossi, Julian Rasch, Robin Welsch, Albrecht Schmidt, Florian Michahelles · 2025
Read Designing Intent: A Multimodal Framework for Human-Robot Cooperation in Industrial Workspaces by Francesco Chiossi, Julian Rasch, Robin Welsch, Albrecht Schmidt, Florian Michahelles (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-15293.txt.
Introduction
Francesco Chiossi and co-authors design a framework for robots to communicate intent to human coworkers, in their 2025 arXiv position paper. In shared industrial workspaces, mutual understanding underpins trust, safety and efficiency. Drawing on a project where a person and a collaborative robot assemble parts together, they structure intent communication along several axes.
What is communicated ranges from immediate perceptions to future plans; horizons run from operational to strategic; channels span visual, auditory and touch signals. The design space maps these choices so teams can tailor strategies to changing work contexts. The paper lays groundwork for a design toolkit and a shared research agenda for transparent robot collaboration.
Catalog record
| CREATOR | Francesco Chiossi, Julian Rasch, Robin Welsch, Albrecht Schmidt, Florian Michahelles |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-15293
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Designing Intent: A Multimodal Framework for Human-Robot Cooperation in Industrial Workspaces Francesco Chiossi, Julian Rasch, Robin Welsch, Albrecht Schmidt, Florian Michahelles Abstract As robots enter collaborative workspaces, ensuring mutual understanding between human workers and robotic systems becomes a prerequisite for trust, safety, and efficiency. In this position paper, we draw on the cooperation scenario of the AIMotive project—in which a human and a cobot jointly perform assembly tasks—to argue for a structured approach to intent communication. Building on the Situation Awareness-based Agent Transparency (SAT) framework and the notion of task abstraction levels, we propose a multidimensional design space that maps intent content (SAT1–3), planning horizon (operational to strategic), and modality (visual, auditory, haptic). We illustrate how this space can guide the design of multimodal communication strategies tailored to dynamic collaborative work contexts. With this paper, we lay the conceptual foundation for a future design toolkit aimed at supporting transparent human-robot interaction in the workplace. We highlight key open questions and design challenges, and propose a shared agenda for multimodal, adaptive, and trustworthy robotic collaboration in hybrid work environments. [orcid=0000-0003-2987-7634, [email protected], url=https://www.francesco-chiossi-hci.com/, ] *1 [orcid=0000-0002-9981-6952, [email protected], url=https://julian-rasch.com/, ] [orcid=0000-0002-7255-7890, [email protected], url=https://human-ai-interaction.com/ ] [orcid=0000-0003-3890-1990, [email protected], url=https://uni.ubicomp.net/as/, ] [orcid=0000-0003-1486-0688, [email protected], url=https://informatics.tuwien.ac.at/people/florian-michahelles, ] keywords Human-Robot Interaction ,Intent Communication ,Design Framework ,HCI ,Artificial Intelligence † † copyrightyear: 2025 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: Workshop on The Future of Human-Robot Synergy in Interactive Environments: The Role of Robots at the Workplace @ CHIWORK’25 June 23–25, 2025, Amsterdam, NL † † address: LMU Munich, Munich, Germany † † address: Aalto University, Espoo, Finland † † address: TU Wien, Visual Computing & Human-centered Technology, Vienna, Austria † † corresp: Corresponding author. Figure 1: In a dynamic factory workspace, a human worker and a robotic arm collaborate through a shared language of cues. The robot communicates its next move via a flashing light ( Visual – Operational – SAT1 ), signals a task switch with a beep ( Auditory – Tactical – SAT2 ), announces its long-term goal through speech ( Auditory – Strategic – SAT3 ), and syncs actions with the human via a subtle vibration cue ( Haptic – Tactical – SAT2 ). Each signal is carefully mapped in a three-dimensional design space—capturing what is being communicated, how, and at what level of abstraction—to ensure transparency, coordination, and trust. Image generated using ChatGPT 4o. 1 Introduction The increasing deployment of collaborative robots (cobots) in industrial environments is fundamentally reshaping the nature of work in manufacturing, logistics, and beyond. As humans and autonomous systems are brought into ever-closer cooperation, the ability for workers to understand, predict, and coordinate with robotic partners becomes a central requirement for both productivity and safety Kassem et al. 2022 . However, despite advances in robotics and artificial intelligence, a persistent challenge remains: how can cobots effectively communicate their intentions, what they are about to do, why, and how, to their human collaborators in ways that are both understandable and actionable? This challenge is particularly acute in dynamic, safety-critical settings, where misalignment or misunderstanding can have severe consequences Lee and See 2004 ; Chen and Barnes 2014 . Researchers have long recognized the importance of system transparency, predictability, and trust in human-robot interaction (HRI) and have explored a range of intent communication strategies across domains such as automated driving, smart factories, and service robotics Kassem et al. 2022 ; Dey et al. 2020 ; Mayer et al. 2016 ; Mahadevan et al. 2018 ; Breazeal 2003 . Approaches include visual cues (e.g., lights, displays, path projections), auditory alerts, and haptic feedback, as well as more implicit social signals like gaze and proxemics Wintersberger et al. 2019 ; Moon et al. 2014 ; Walters et al. 2009 . Yet, much of this research remains fragmented, often focusing on single modalities, isolated scenarios, or specific human-robot relationships. As a result, generalizable principles for intent communication remain elusive, and the field lacks a systematic framework for comparing and designing multimodal communication strategies that work across diverse workplace scenarios Hancock et al. 2011 . Addressing this gap is crucial, as effective intent communication is key to fostering trust, safety, and acceptance of cobots in the workplace Endsley 2017 . In response, this paper proposes a multidimensional design space for intent communication in human robot cooperation, grounded in the conceptual and empirical foundations of the AIMotive project. Our framework systematically combines three relevant dimensions: (1) the content of communication as described by the Situation Awareness-based Agent Transparency (SAT) framework Endsley 2017 , (2) the level of task abstraction (operational, tactical, strategic), and (3) the modality of communication (visual, auditory, haptic, or multimodal). This approach enables us to map out how, what, and when intent should be communicated, tailored to different human-robot relationships and workplace contexts. The novelty of our work lies in this integrative, scenario-driven perspective, which aims to bridge the gap between fragmented prior studies and provides practical guidance for the design of transparent, trustworthy, and effective cobot systems Mayer et al. 2016 . Our framework reveals that intent communication must be both multimodal and context-sensitive: the optimal combination of information content, abstraction level, and modality varies depending on the specific cooperation scenario, the criticality of the task, and the user’s role (e.g., bystander, collaborator, shared control). We identify key design opportunities and gaps, such as the need for anticipatory but non-overloading cues, and for communication strategies that generalize across domains like healthcare, logistics, and telepresence. Ultimately, we argue that a structured design space and toolkit of reusable “intent chunks” will be essential for building the next generation of workplace robots that are not only functionally capable but also transparent, predictable, and trustworthy partners for human workers Kassem et al. 2022 ; Wintersberger et al. 2019 . We invite the HCI community to join us in validating, extending, and applying this framework to advance the future of human-robot synergy in interactive environments. 2 Human-Cobot Cooperation in Industrial Workspaces The integration of collaborative robots (cobots) into industrial settings is rapidly transforming traditional work environments into dynamic, hybrid spaces where humans and autonomous systems work side by side Mayer et al. 2016 . A representative scenario, as investigated in the AIMotive project, involves a human worker and a cobot jointly assembling parts on a production line. In such a setting, both agents must coordinate their actions, share goals, and flexibly adapt to each other’s behaviors. For example, a human may align and hold a component while the cobot drills or fastens it, requiring precise turn-taking and mutual awareness Kassem et al. 2022 . This scenario is inspired by real-world applications in smart factories, automotive assembly, and logistics hubs, where the demand for efficient, safe, and adaptive collaboration is driving the adoption of robotic assistants Mayer et al. 2016 . In these environments, the dynamics of human-cobot cooperation are characterized by shared objectives, distributed subtasks, and frequent safety-critical moments. Turn-taking, such as alternating between human and robot actions during assembly, requires clear communication of intent to prevent errors or accidents. Moreover, the ability to anticipate the cobot’s next move is essential for maintaining workflow continuity and ensuring operator safety. The relevance