Social-Physical Interactions with Virtual Characters: Evaluating the Impact of Physicality through Encountered-Type Haptics DOI: XXXXXXX.XXXXXXX Conference: arXiv; arXiv;

Eric Godden, Jacquie Groenewegen, Michael Wheeler, Matthew K.X.J. Pan · 2025

Read Social-Physical Interactions with Virtual Characters: Evaluating the Impact of Physicality through Encountered-Type Haptics DOI: XXXXXXX.XXXXXXX Conference: arXiv; arXiv; by Eric Godden, Jacquie Groenewegen, Michael Wheeler, Matthew K.X.J. Pan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05683.txt.

Introduction

Eric Godden and co-authors let people shake hands with virtual characters, using a robot arm hidden behind the virtual scene. Their display is of the encountered type: a robot moves a real prop into place just as the virtual hand arrives, so touch lands where sight says it should. Social touch like this carries real weight in human interaction.

Their platform, ETHOS, pairs a torque-controlled robot with swap-in props and a headset view. The team staged a handover, a fist bump, and a high five with a virtual character. Tests measured alignment and delay, and fifty-five people tried the system. Users found the contact feasible and valuable, the authors report.

Catalog record

CREATOREric Godden, Jacquie Groenewegen, Michael Wheeler, Matthew K.X.J. Pan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-05683

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Social-Physical Interactions with Virtual Characters: Evaluating the Impact of Physicality through Encountered-Type Haptics DOI: XXXXXXX.XXXXXXX Conference: arXiv; arXiv; Eric Godden, Jacquie Groenewegen, Michael Wheeler, Matthew K.X.J. Pan Abstract . This work investigates how robot-mediated physicality influences the perception of social–physical interactions with virtual characters. ETHOS (Encountered-Type Haptics for On-demand Social interaction) is an encountered-type haptic display that integrates a torque-controlled manipulator and interchangeable props with a VR headset to enable three gestures: object handovers, fist bumps, and high fives. We conducted a user study to examine how ETHOS adds physicality to virtual character interactions and how this affects presence, realism, enjoyment, and connection metrics. Each participant experienced one interaction under three conditions: no physicality (NP), static physicality (SP), and dynamic physicality (DP). SP extended the purely virtual baseline (NP) by introducing tangible props for direct contact, while DP further incorporated motion and impact forces to emulate natural touch. Results show presence increased stepwise from NP to SP to DP. Realism, enjoyment, and connection also improved with added physicality, though differences between SP and DP were not significant. Comfort remained consistent across conditions, indicating no added psychological friction. These findings demonstrate the experiential value of ETHOS and motivate the integration of encountered-type haptics into socially meaningful VR experiences. Figure 1 . ETHOS (Encountered-Type Haptics for On-demand Social interaction) enables social–physical human–robot interactions in VR that are both physically engaging and socially meaningful, demonstrated here through an object handover (left), fist bump (centre), and high five (right). 1. INTRODUCTION Virtual reality (VR) offers immersive environments that support novel forms of interaction and engagement, yet these experiences remain dominated by visual and auditory feedback, with limited rendering of physicality ( 40 ) . This absence of realistic touch constrains the kinds of interactions VR can convincingly support and reduces its ability to replicate natural experiences. While most existing haptic devices deliver feedback through a single modality ( 8 ) , a promising but underexplored approach is the use of social–physical interactions mediated through human–robot interaction (HRI). By integrating the physical dynamics of contact with the social context of human exchange, social–physical HRI provides a holistic framework for recreating authentic, multimodal interactions with virtual characters and environments. To explore this prospect, we developed ETHOS (Encountered-Type Haptics for On-demand Social interaction), a system that integrates a torque-controlled 7-DoF robotic manipulator and interchangeable props with a headset-mediated VR experience to render interpersonal gestures—object handovers, fist bumps, and high fives. This work aims to explore the impact of this system on immersion and interpersonal engagement with a virtual character, and to investigate the potential for recreating meaningful social-physical interactions in VR. To examine how such interactions influence user experience, we conducted a user study in which participants engaged with a virtual character under three conditions: no physicality (NP), static physicality (SP), and dynamic physicality (DP). These conditions isolate the role of tangible contact, ranging from purely virtual to progressively more lifelike motion and impact. We measured experiential outcomes, including presence, realism, enjoyability, comfort, and connection to the virtual character, to evaluate whether adding physicality enriches engagement. By grounding this evaluation in user perception rather than only technical performance, we demonstrate the potential of ETHOS to support more authentic and socially meaningful interactions in VR. 2. BACKGROUND Research on VR interaction has largely focused on visual and auditory channels, with touch remaining comparatively underexplored. Vibrotactile controllers (e.g., Meta Quest, HTC Vive) provide limited cues that rarely extend beyond surface vibrations ( 41 ) , affecting the place and plausibility illusions that users experience in virtual environments as theorized by Slater ( 36 ) . More sophisticated approaches, such as wearable haptic gloves, mid-air ultrasound feedback, and shape-changing or weight-shifting devices, broaden the design space but often experience a tradeoff between fidelity and versatility of feedback ( 27 ) . Encountered-type haptic displays (ETHDs) offer an alternative, aligning physical props with virtual representations to evoke naturalistic contact ( 17 ; 1 ) . While ETHDs have shown promise for environmental realism and object interaction, their extension to socially meaningful interpersonal encounters has only recently been considered. Social–physical interactions represent a critical avenue for recreating meaningful human experiences through HRI. Prior work shows the value of combining social engagement with physical embodiment across assistive, instructional, and affective domains, yet their use in immersive contexts remains limited. While VR can efficiently simulate diverse scenarios, it often lacks realistic physicality. Social–physical HRI offers a means of addressing this gap, with encountered-type haptic displays (ETHDs) providing a promising solution by enabling tangible contact in VR and supporting more natural, socially significant experiences. 2.1. Social-Physical Human-Robot Interaction Human–robot interaction (HRI) research provides insights into how physicality and sociality can be combined to create richer experiences. Traditionally, HRI has been studied through either the physical dimension—low-level dynamics of contact such as force exchange and control for tasks like handovers ( 5 ) or collaborative manipulation ( 2 ) —or the social dimension, which examines how behaviours such as gaze, gesture, or proxemics shape perception and trust ( 32 ) . Integrating these perspectives yields what we term social–physical interactions : exchanges where physical contact and social meaning are intertwined. This holistic approach has been explored in assistive, instructional, and affective contexts. In assistive and instructional domains, combining physical interaction with social engagement has been shown to enhance both performance and motivation. For example, Fitter et al. ( 10 ) used a Baxter robot to create exercise games for older adults, finding that activities blending physical contact and social cues were most engaging. Granados et al. ( 15 ) applied a similar strategy in robotic dance training, where adaptive behaviour improved skill learning. In affective domains, the physical act itself carries social meaning. Block et al. ( 4 ) proposed design principles for robotic hugging that combine physical qualities (e.g., softness, warmth) with social adaptation (e.g., adjusting to user size) to improve experience. Okamura et al. ( 28 ) demonstrated how high-five gestures, when implemented in robots, embody both physical and social dimensions, enhancing engagement and communicative value. 2.2. Encountered-Type Haptic Displays (ETHDs) ETHDs are “systems capable of positioning all or part of themselves at an encountered location, enabling the user to voluntarily elicit haptic feedback with the environment at the appropriate time and place” ( 24 ) . In practice, they colocate physical props with virtual representations to provide passive haptic feedback ( 17 ) . This strategy reduces system complexity compared to active force rendering while delivering contact that feels authentic and immersive. ETHDs have been implemented using human operators ( 6 ) , drones ( 1 ) , and robotic manipulators, the latter offering precise positioning and stable performance through contact. Their external grounding frees users from wearable hardware during free motion while ensuring reliable feedback at first contact. Despite these advantages, most ETHD systems remain limited to rendering static objects or surfaces ( 26 ; 39 ) . Some expand flexibility with interchangeable endpoints ( 3 ) or detachable task-relevant props ( 23 ) , but few extend toward social–physical interactions where realism and social meaning are both essential. 2.3. Toward Social–Physical Interactions in VR This gap motivates our work. We examine how varying levels of robot-mediated physicality, delivered through ETHOS (Encountered-Type

Read the complete text