IM HERE: Interaction Model for Human Effort based Robot Engagement

1 st Dominykas Strazdas, 2 nd Magnus Jung, 3 rd Jan Marquenie, 4 th Ingo Siegert, 5 th Ayoub Al-Hamadi · 2025

Read IM HERE: Interaction Model for Human Effort based Robot Engagement by 1 st Dominykas Strazdas, 2 nd Magnus Jung, 3 rd Jan Marquenie, 4 th Ingo Siegert, 5 th Ayoub Al-Hamadi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03828.txt.

Introduction

Engagement between a person and a robot is easy to feel and hard to define, and vague definitions fail when the setting changes. Dominykas Strazdas and colleagues introduce IM HERE in a 2025 robotics preprint, a model of engagement meant to work for human-human, human-robot, and even robot-robot encounters. The goal is software that analyses social behaviour and acts within social norms.

The model describes every relationship through effort: how much each side invests in the interaction. That bilateral view reduces relationship patterns to a focus placement plus four key states. Mutual relationships, group behaviour, and norm-following actions all fit inside the same scheme. Because the model combines perceived and objective states, it can pinpoint where a miscommunication arises. The authors aim at autonomous systems that pursue their own social goals while integrating smoothly with the people around them.

Catalog record

CREATOR1 st Dominykas Strazdas, 2 nd Magnus Jung, 3 rd Jan Marquenie, 4 th Ingo Siegert, 5 th Ayoub Al-Hamadi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-03828

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

IM HERE: Interaction Model for Human Effort based Robot Engagement 1 st Dominykas Strazdas, 2 nd Magnus Jung, 3 rd Jan Marquenie, 4 th Ingo Siegert, 5 th Ayoub Al-Hamadi Abstract The effectiveness of human-robot interaction often hinges on the ability to cultivate engagement—a dynamic process of cognitive involvement that supports meaningful exchanges. Many existing definitions and models of engagement are either too vague or lack the ability to generalize across different contexts. We introduce IM HERE , a novel framework that models engagement effectively in human-human, human-robot, and robot-robot interactions. By employing an effort-based description of bilateral relationships between entities, we provide an accurate breakdown of relationship patterns, simplifying them to focus placement and four key states . This framework captures mutual relationships, group behaviors, and actions conforming to social norms, translating them into specific directives for autonomous systems. By integrating both subjective perceptions and objective states , the model precisely identifies and describes miscommunication. The primary objective of this paper is to automate the analysis, modeling, and description of social behavior, and to determine how autonomous systems can behave in accordance with social norms for full social integration while simultaneously pursuing their own social goals. I Introduction Human interaction is hard to explain and even harder to model, yet we successfully interact with other humans, machines and objects every day. The field of Human-Robot Interaction (HRI) is broad, encompassing many aspects of interaction, such as social robotics, human-robot collaboration, teaming, interfaces, autonomous systems, and many more. Throughout these aspects, a common challenge emerges: the need to recognize the current social states of the system and all the entities within it in order to determine appropriate actions and responses [ 41 ] . The concept of cognitive engagement facilitates smooth, natural communication between users and robots or agents, supporting meaningful, long-term interactions that extend beyond the initial novelty [ 35 ] . Engagement, therefore, is not a static state but a continuous process of mutual adjustment, requiring entities to interpret, react to, and influence each other’s behaviors. Understanding and modeling this process is essential for fostering interactions that are not only functional but also socially meaningful, enabling robots and agents to participate in human-like exchanges. This dynamic requires not only accurate modeling but also the acknowledgment of reciprocity [ 20 , 14 ] as an additional concept in interaction. Reciprocity ensures that effort and engagement are mutual and perceived as balanced, thereby fostering social goals. For autonomous systems, this implies the need for deliberate revelation of their state to enable meaningful exchanges with human or machine counterparts. In this paper, we propose a novel approach to engagement modeling by centering on a single sufficient indicator: effort . We argue that engagement fundamentally stems from bilateral focus , and that effort can be used as an indicator. We develop a generalizable framework capable of predicting engagement for diverse entities, including humans, robots, and objects. Our current framework, IM HERE , is a theoretical concept to enhance existing engagement models by providing structure, precision, and general applicability without overriding them. Many current models lack a formal foundation or are scenario-bound, leading to ambiguity. It bridges subjective and objective views and revelation to understand communication and mitigate miscommunication. The framework integrates social norms in HRI, supports multi-party and group dynamics. IM HERE enables the development of adaptive interaction strategies for goal-directed behavior, laying the foundation for real-world integration while accounting for noise and bias. Additionally, we provide an open-source implementation of our model, along with a simulation environment designed to test different scenarios. In the following sections, we explore existing engagement models and the various definitions of engagement used in different fields, distilling the foundational axioms and formulas needed for our framework. II Related Works Engagement is relevant to various scientific fields, mainly psychology [ 16 ] and computer science [ 13 ] . There are several definitions and models for engagement. In the context of our work, we focus on HRI. II-A Definitions of Engagement There have been multiple approaches to model and predict engagement in HRI, summarized comprehensively by Oertel et al. [ 30 ] and Sorrentino et al. [ 40 ] . Most of their reviewed literature uses the one of the following definitions for engagement: • Sidner et al. [ 39 ] describe engagement as a dynamic process involving phases of initiation, maintenance, and conclusion. • Poggi et al. [ 32 ] view engagement as a value attributed to interaction partners by participants, which can be unidirectional. • Other concepts: The concept of “with-me-ness” [ 27 ] as the extent to which the human is “with” the robot. [ 11 ] refer to different types of engagement, such as task- or social-engagement and social-task-engagement e.g. collaboration. The term of group-engagement is introduced by [ 36 ] . These definitions retain a certain level of ambiguity and vagueness, further examined by [ 40 , 30 ] . II-B Modeling of Engagement Engagement is mainly viewed from the perspective of detection and prediction [ 15 , 26 , 3 , 2 , 47 , 7 , 21 , 28 , 6 , 8 , 10 ] , ignoring the reflection and revelation of engagement, that is necessary to develop interaction strategies. These approaches utilize (multi-modal) indicators such as physiological signals [ 15 ] , body posture [ 6 , 26 , 3 , 2 , 47 , 7 ] , facial expressions [ 6 , 8 , 26 , 47 , 10 ] , gaze [ 1 , 17 , 6 , 3 , 2 , 10 , 23 , 22 , 26 , 29 , 34 , 47 ] , head pose [ 6 , 26 , 3 , 2 , 34 , 47 , 1 , 17 ] , and speech patterns [ 6 , 26 , 44 , 47 , 7 ] . These models rely on specific indicators and lack a generalizable framework for diverse contexts, interaction types, and multi-person scenarios. The use of such models may be sufficient in specific context, but for social robots, it is essential to not only detect the other parties state but to react and to reflect their own state through behavior and affective communication [ 20 , 14 ] . This can be subtle affirmations such as nodding [ 25 ] or proactive in approaching another person [ 17 ] or groups in F-formations [ 19 ] . Similarly, Obrien et al. [ 31 ] base their engagement model around the user-experience, with different attributes (aesthetics, novelty, attention, positive affect, etc.) that lead to and prolong engagement and that should therefore be modulated by the system. The goal of our research is to provide a fundamental, formal, generalizable concept for human-robot engagement, bridging the gap between definition and application scenario. All aforementioned definitions of Engagement can be represented by our framework IM HERE . III IM HERE : Effort based Engagement In the following, we present a brief overview of the proposed framework and the complexity of the relationship patterns it can model. Subsequent sections provide a rigorous formulation through definitions, axioms, and deductions. III-A Framework Overview The framework is designed to represent the relational states — Engaged ,

Read the complete text