Tactile-based Reinforcement Learning for Adaptive Grasping under Observation Uncertainties

Xiao Hu, Yang Ye · 2025

Read Tactile-based Reinforcement Learning for Adaptive Grasping under Observation Uncertainties by Xiao Hu, Yang Ye (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16167.txt.

Introduction

Xiao Hu and Yang Ye teach robot hands to grip by feel when sight cannot be trusted. Construction work hides parts behind other parts, so cameras misjudge pose. Their 2025 paper builds a tactile simulator for training. A reinforcement learning method, Proximal Policy Optimization, then adjusts grip posture live from touch feedback. The hand keeps re-aiming as its fingers report pressure and slip.

Simulated trials cover jobs like pipe fitting and rebar work. The touch-led hand adapts its posture to each new error in the object's judged pose. Grip success and steadiness both rise against vision-only habits. The team pitches touch as the sense of last resort when eyes fail on site.

Catalog record

CREATORXiao Hu, Yang Ye
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-16167

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Tactile-based Reinforcement Learning for Adaptive Grasping under Observation Uncertainties Xiao Hu, Yang Ye Abstract Robotic manipulation in industrial scenarios such as construction commonly faces uncertain observations in which the state of the manipulating object may not be accurately captured due to occlusions and partial observables. For example, object status estimation during pipe assembly, rebar installation, and electrical installation can be impacted by observation errors. Traditional vision-based grasping methods often struggle to ensure robust stability and adaptability. To address this challenge, this paper proposes a tactile simulator that enables a tactile-based adaptive grasping method to enhance grasping robustness. This approach leverages tactile feedback combined with the Proximal Policy Optimization (PPO) reinforcement learning algorithm to dynamically adjust the grasping posture, allowing adaptation to varying grasping conditions under inaccurate object state estimations. Simulation results demonstrate that the proposed method effectively adapts grasping postures, thereby improving the success rate and stability of grasping tasks. I INTRODUCTION Robotic manipulation in construction has witnessed rapid advancements driven by improvements in perception, control, and learning-based methods [ 1 ] . For example, researchers have been exploring generalizable grasping policies in construction objects [ 2 ] , dexterous manipulation in pipeline assembly [ 3 ] , and grasping deformable construction materials [ 4 ] . Traditional grasping approaches typically rely on observing the current scene, computing an optimal grasp pose, and then executing the grasp accordingly. However, these methods inherently depend on a strong assumption—that the robotic gripper can interact with the object precisely in the planned grasp pose, which can be far off in reality, especially in dynamic and uncertain construction settings. Specifically, most grasp generation models assume that the gripper can reach the desired pose perfectly and that the object pose is correctly captured and remains static during the grasping process. Such assumptions are often unrealistic in reality for the dynamic grasping process, especially during the closing motion of the gripper, in which interactions between the gripper and the object can lead to unintended perturbations. These factors significantly impact grasp stability and success rates in real-world scenarios. To address these challenges, we propose a tactile-based adaptive grasping approach that enables the gripper to dynamically adjust its grasp in response to real-time tactile feedback. Specifically, we designed a tactile feedback simulator in MuJoCo [ 5 ] to facilitate efficient policy training. The simulator generates real-physics tactile sensor data based on force interaction and geometric features. Using Proximal Policy Optimization (PPO), we train a reinforcement learning policy that governs the adaptive behavior of the gripper. To bridge the gap between simulated and real-world tactile data, We introduce downsampled tactile observations, which refer to using uniformly spaced sampling as the input for the policy, ensuring robustness and generalization across different tactile sensing conditions. An experiment is performed to evaluate the design of the adaptive grasping policy based on tactile data. We simulate objects of different poses and postures, and add random noise to the pose observation input to replicate the uncertain observation in real manipulation tasks. By incorporating tactile feedback in this manner, our approach improves grasp stability and robustness, effectively mitigating the limitations of traditional grasp planning methods. II Related Work II-A Grasp Planning Algorithms Previous robotic grasping methods are mainly based on vision-based perception and analytical grasp planning [ 6 , 7 ] . Early approaches focus on computing force closure and form closure grasps using geometric models of objects, assuming that accurate object shape and pose information is available [ 8 , 9 ] . These methods typically use deterministic grasp planners that generate a fixed grasp pose, assuming the gripper can reach the computed pose without interference. However, real-world grasping tasks often involve uncertainties such as incomplete object perception, occlusions, and dynamic interactions, which reduce the effectiveness of purely model-based approaches [ 10 , 11 ] . To address these limitations, data-driven grasping techniques have gained popularity. Deep learning-based grasp planning methods leverage large-scale datasets to learn grasp success predictions [ 12 , 13 ] . Grasping models such as GraspNet [ 14 ] and GQ-CNN [ 15 ] have demonstrated promising performance in generating robust grasps from RGB or depth images. However, these methods still assume that the gripper can execute the planned grasp pose precisely and that the object remains static during the grasp execution, which is often unrealistic in practical scenarios. II-B Reinforcement Learning for Grasping Reinforcement learning has been widely used in robotic manipulation tasks, including grasping, regrasping, and hand manipulation. Model-free RL algorithms such as Deep Q-Networks (DQN) [ 16 ] , and Proximal Policy Optimization (PPO) have been applied to learn grasping strategies from trial-and-error interactions. Recent works have explored RL-based closed loop grasping, where policies continuously refine grasp poses during execution . However, most existing methods rely only on visual feedback, which may not be reliable in scenarios with occlusions or noisy depth data. Our work differs from previous RL-based grasping methods by focusing on tactile-driven policy learning. Instead of relying on full-state object observations, we use downsampled tactile signals as input, making the policy more robust to real-world sensor noise. Furthermore, our PPO-trained policy generates dynamic grasp adjustment parameters, allowing the gripper to refine its grasp adaptively throughout execution. This approach enables successful grasping even when initial grasp predictions are suboptimal, bridging the gap between static grasp planning and real-world grasp execution. III Method This section primarily introduces the tactile feedback simulation framework and the use of tactile feedback for adaptive grasping policy training. The proposed framework enables high-fidelity physics-based tactile interaction modeling, facilitating realistic contact perception within a simulated environment. Furthermore, we explore how tactile information can be effectively integrated into policy learning, allowing for dynamic and adaptive grasping strategies based on real-time sensory feedback. Fig. 1: Framework As shown in Figure 1, we built a tactile simulation framework in MuJoCo, which includes a tactile simulation system and a robotic hand system. The tactile simulation encodes physical interactions such as friction, collision, and inertia. The simulated tactile sensor arrays are placed on the surface of the robotic hand based on real-life robotic hand designs. In this study, we adopt the Proximal Policy Optimization (PPO) algorithm for reinforcement learning (RL) training. The observation space covers robotic preceptive data, initial (uncertain) observation of the object pose, and optional tactile feedback. III-A Tactile Simulation Framework To enable high-fidelity tactile interaction simulation, we develop a physics-based tactile sensing framework using MuJoCo. This framework integrates a rigid-body structure with MuJoCo’s sensor module, enabling the simulation of contact-based tactile perception. Specifically, when a designated site within the model makes contact with another object, MuJoCo computes the interaction forces at the contact point. A touch sensor is then employed to measure and output these forces as a scalar value, representing the magnitude of the tactile interaction. Fig. 2: Tactile simulation framework The tactile sensor model is designed to ensure realistic contact interactions by incorporating a joint mechanism, a geometric structure, and dynamically stable inertial properties. The key components of the design are as follows: III-B Joint Configuration for Tactile Deformation To simulate skin-like deformation upon contact, the tactile sensor body is equipped with a sliding joint (‘slide‘), allowing controlled displacement along the Z-axis. The primary joint parameters are defined as follows: • Damping

Read the complete text