Haptic Stiffness Perception Using Hand Exoskeletons in Tactile Robotic Telemanipulation

Gabriele Giudici, Claudio Coppola, Kaspar Althoefer, Ildar Farkhatdinov, Lorenzo Jamone · 2024

Read Haptic Stiffness Perception Using Hand Exoskeletons in Tactile Robotic Telemanipulation by Gabriele Giudici, Claudio Coppola, Kaspar Althoefer, Ildar Farkhatdinov, Lorenzo Jamone (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-02613.txt.

Introduction

Gabriele Giudici and co-authors test whether people can feel the stiffness of far-off objects through a robot hand, in a 2024 study. Remote handling matters in health care and in harsh places where people cannot go. Cameras show shape and place, but they say little about how soft an object is. The team used gloves fitted with motors, plus robot fingertips that can sense touch.

Volunteers squeezed soft objects by remote control, with no view of the objects at all. One feedback mode sent back only the contact force. A second mode also sent back how far the hand had closed. People could tell soft from firm objects by feel alone in both modes. Adding the closing signal seemed to help when two objects felt close in stiffness, the authors report.

Catalog record

CREATORGabriele Giudici, Claudio Coppola, Kaspar Althoefer, Ildar Farkhatdinov, Lorenzo Jamone
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-02613

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Haptic Stiffness Perception Using Hand Exoskeletons in Tactile Robotic Telemanipulation Gabriele Giudici, Claudio Coppola, Kaspar Althoefer, Ildar Farkhatdinov, Lorenzo Jamone Abstract Robotic telemanipulation—the human-guided manipulation of remote objects—plays a pivotal role in several applications, from healthcare to operations in harsh environments. While visual feedback from cameras can provide valuable information to the human operator, haptic feedback is essential for accessing specific object properties that are difficult to be perceived by vision, such as stiffness. For the first time, we present a participant study demonstrating that operators can perceive the stiffness of remote objects during real-world telemanipulation with a dexterous robotic hand, when haptic feedback is generated from tactile sensing fingertips. Participants were tasked with squeezing soft objects by teleoperating a robotic hand, using two methods of haptic feedback: one based solely on the measured contact force, while the second also includes the squeezing displacement between the leader and follower devices. Our results demonstrate that operators are indeed capable of discriminating objects of different stiffness, relying on haptic feedback alone and without any visual feedback. Additionally, our findings suggest that the displacement feedback component may enhance discrimination with objects of similar stiffness. I Introduction Robotic teleoperation is a fundamental technology for various real-world applications, ranging from healthcare to harsh environments [ 1 , 2 , 3 , 4 ] . A crucial task in teleoperation is telemanipulation, involving manipulation of objects by the teleoperated robot [ 5 ] . Perceiving the physical properties of remote objects is necessary for effective manipulation and information gathering, such as object recognition or assessing specific characteristics (e.g., determining if a manipulated tissue contains a tumor or if a strawberry is ripe). During bilateral telemanipulation, the human user uses a device (leader) to control a remote robot (follower) and receives feedback from sensors placed on the remote robot or in the environment. Vision is the dominant modality for sensing remote objects and environments, and visual feedback is easily provided via monitors or Virtual Reality headsets. However, tactile and force sensing are useful complementary modalities and sometimes better than vision for detecting specific physical properties like stiffness. Haptic feedback devices that can effectively render these modalities are still uncommon [ 6 ] . Notably, while there is a large literature about the autonomous robotic perception of object stiffness using tactile sensing [ 7 , 8 , 9 ] , which can facilitate tactile object recognition [ 10 , 11 , 12 ] and tactile assessment of specific object characteristics [ 13 ] , to the best of our knowledge, no studies have explored how human users wearing hand exoskeletons can perceive the stiffness of remote objects during robotic telemanipulation relying solely on remote tactile sensing (follower side) and kinesthetic haptic feedback (leader side). Fig. 1: The teleoperation setup connecting the Leader HGlove exoskeleton glove to the Allegro robotic hand. Forces measured from the robotic thumb, index, and ring fingers are rendered on the glove’s thumb, index, and middle fingers, respectively. To address this gap, in this work we test ten human participants in the task of differentiating remote objects based on their stiffness, by using an advanced bilateral telemanipulation setup with kinesthetic haptic feedback. The setup is composed of an exoskeletal glove (HGlove [ 14 ] ) on the leader side, which captures human fingers motion to control the remote robot and provides haptic feedback by applying kinesthetic forces on the human fingers, and a dexterous robotic hand (Allegro Hand) equipped with tactile sensitive fingertips on the follower side, as shown in Fig. 1 . Participants are tasked with squeezing five sample objects differing only in their stiffness (see Section IV-A ) using the telemanipulation setup, and determining which is most similar to a given reference (Task ABX) and which of them is softer (Task S), as detailed in Section IV-D . We compare two methods for haptic feedback rendering: the first method (see Section III-B1 ) is based solely on the contact forces measured by the tactile sensors, and it was preliminary introduced in [ 15 ] ; the second method (newly proposed here, see Section III-B2 ) considers also the squeezing displacement differences between the human and robot fingers, due to the kinematic mismatch between the leader device and the follower device. The main contributions of this work are: • Demonstration of Stiffness Perception during Telemanipulation: We demonstrate that, using a bilateral telemanipulation setup with haptic feedback on the leader and tactile sensing on the follower, ten naive users can discriminate five soft objects differing solely in stiffness by remotely squeezing them with a dexterous robotic hand and perceiving only haptic feedback (no visual cues), as shown in Fig. 3 . • Introduction of a novel Haptic Feedback method to perceive object stiffness: In Section III-B2 , we introduce a novel method that incorporates finger displacement feedback, in addition to force feedback, to address differences in the squeezing motion between the human operator and the robot caused by kinematic mismatches between the leader and follower devices—a common scenario in telemanipulation. • Insights from Statistical Analysis on User Preferences: Our analysis reveals that incorporating finger displacement feedback benefits naive users primarily in specific circumstances, namely, during more challenging tasks. While the advantage is not consistently significant across all conditions (see Tab. II ), displacement feedback does enhance discrimination performance for objects with similar stiffness (as discussed in V-E ). The paper is organized as follows: Section II reviews related work. In Section III , we describe the robotic setup used in this study, including the haptic stiffness feedback methods. Section IV outlines the experimental setup and procedure. The results are analyzed in Section V . In Section VI , we discuss the findings, and Section VII concludes the paper and suggests future research directions. II Related Works A wide range of studies in the literature focuses on automatic stiffness estimation or classfication using tactile sensors [ 7 , 16 , 8 , 17 , 9 ] , as well as stiffness rendering through various visual technologies for distinguishing soft objects [ 1 , 18 , 19 ] . However, due to technological and safety limitations, fewer studies have investigated stiffness rendering exclusively through haptic devices. In this study, we aim to exploit the potential of information obtainable from haptic sensors in a robotic setup, i.e. force and position, to identify a robust strategy to enable the operator to differentiate soft objects during real-world teleoperation experiments without any visual feedback. II-A Teleoperation Telemanipulation is a wide field and several comprehensive reviews should be considered, such as [ 1 , 5 , 20 , 21 ] . A key example of recent advancements in this area is the ANA Avatar XPRIZE, a major non-medical teleoperation competition, that challenged teams to develop systems excelling in intuitiveness, immersiveness, social interaction, robustness, and manipulation capacity across various tasks. Notable contributions included a full-body teleoperation platform with mass-spring-based haptic feedback [ 22 ] , the AvaTRINA Nursebot combining haptic feedback with augmented reality [ 23 ] , and the winning NimbRo Avatar system, which demonstrated robust telepresence and manipulation capabilities [ 24 ] . Among these, the work [ 25 ] introduced an exoskeletal glove for kinesthetic feedback, however, the system provided

Read the complete text