Learning Stable In-Grasp Manipulation in a Non-Dropping Action Space
Ha Thang Long Doan, Hikaru Arita, Kazuto Nakashima, Kenji Tahara · 2026
Read Learning Stable In-Grasp Manipulation in a Non-Dropping Action Space by Ha Thang Long Doan, Hikaru Arita, Kazuto Nakashima, Kenji Tahara (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28196.txt.
Introduction
Ha Thang Long Doan, Hikaru Arita, Kazuto Nakashima, and Kenji Tahara work on robotic hands that can shift an object within the grasp, turning or sliding it without putting it down. Controllers built by hand rely on strong simplifying guesses, while pure trial-and-error learning wastes effort on unstable motions.
Doan and colleagues split the skill into simpler parts, each learned with guardrails drawn from classical physics and control theory, and they restrict the learner to actions that cannot drop the object. Learning then became fast and steady across different objects. The resulting skills coped with sensor and motor noise, with delays in the control loop, and with varying friction between fingers and object.
Catalog record
| CREATOR | Ha Thang Long Doan, Hikaru Arita, Kazuto Nakashima, Kenji Tahara |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28196
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Stable In-Grasp Manipulation in a Non-Dropping Action Space Ha Thang Long Doan, Hikaru Arita, Kazuto Nakashima, Kenji Tahara Abstract Traditionally, dexterous manipulation controllers are designed using analytic models constrained by strong assumptions about the hand and the objects being manipulated. Reinforcement learning (RL) has become another common approach in which skills are explored openly in an end-to-end manner but is inefficient because of unnoticeable instability and conflicts in learning objectives. This paper attempts to efficiently explore stable and accurate manipulation skills by decomposing dexterous skills into multiple simpler/analyzable components. Each skill component is subsequently learned with constraints and guidance from classical physics and control theory. Our work shows that for stable grasp, in-grasp reposition/reorientation with different objects, sensor/motor noise, latency, and frictional conditions, skill learning becomes efficient and stable with prior knowledge from theory. I Introduction In the field of robotic dexterous manipulation, the goal of in-hand manipulation tasks is to develop a control method that stably and accurately regulates the hand–object system to the desired states. Traditionally, classical mechanics and control theory have been applied to solve this problem. This approach requires accurate modeling of the robotic fingers and palm, the object to manipulate, and how they interact with each other at contact points [ 6 , 10 ] . These analytical models contain strong assumptions regarding physical parameters, such as fixed friction, stiffness, and damping properties. In addition, modeling hand–object contact is challenging, making accurate regulation of each part of the robotic hand to control the object states difficult. Therefore, the manipulation accuracy varies when these methods are applied to robotic hands and objects with varying physical properties. Recent studies have increasingly turned to end-to-end reinforcement learning (RL) to avoid relying on complex analytic models and instead explore hand motions that accurately regulate hand–object states [ 10 , 23 ] . However, learning from scratch requires a long training time to optimize multiple objectives and suffers from a “long-tail” instability problem [ 30 ] : the agent occasionally discovers “unstable” actions, such as unnecessarily releasing some fingers or tossing the object. Our perspective is that, rather than complicating the analytic models, RL is a more effective method for exploring hand motions for accurate manipulation. However, when the entire dexterous skill is explored with end-to-end learning, the long-tail problem is difficult to overcome. In particular, unstable actions accurately manipulate hand–object systems but cause unnoticeable instabilities that result in eventual object dropping [ 30 ] . When such a phenomenon occurs, the learning process becomes inefficient because of the difficult-to-identify cause of failure and the conflicting RL objectives. While existing research attempts to fix instability through RL algorithm selection, reward shaping, or curriculum design [ 30 , 34 ] , we argue that stability should not be left to RL optimization alone. Therefore, we shift the perspective by decoupling desired dexterous skills into simpler, analyzable components. Each component is then learned with the guidance of classical physics and control theory. This is known as guiding RL with scientific knowledge for sample efficiency [ 13 ] -the knowledge guides the exploration of the action space for higher performance and better convergence. In this paper, the in-grasp manipulation components, where the contact between the fingertips and the object is maintained, are targeted. We study how to guide RL using the theory behind stability in fingers–thumb opposability-based dynamic grasping (FTODG) [ 4 ] . Our contributions are as follows: 1. As stability is fundamental to safety, we draw on safe RL [ 7 ] to develop an FTODG-based “stable action space”. 2. We propose theoretically stable in-grasp learning (TSIGL), leveraging control barrier functions (CBFs) to constrain exploration within the stable action space. 3. We demonstrate that TSIGL framework can prevent object dropping and unstable finger motions, making it more sample efficient than baseline RL methods are. In-grasp reposition/reorientation skills are learned under varying environmental conditions, and they are more accurate than skills controlled only with FTODG are. II Related Work II-A End-to-end Learning of Dexterous Manipulation Using end-to-end RL to learn dexterous manipulation skills has become popular. In recent work, OpenAI et al. [ 23 ] use visual data and Funabashi et al. [ 15 ] use tactile data to learn dexterous manipulation. External sensorless in-hand manipulation skills have also been learned [ 30 , 26 , 25 ] , allowing object manipulation using only internal joint sensor feedback at deployment. More complex tasks, such as solving Rubik’s Cube, have also been presented [ 22 ] . In these frameworks, the RL agents decide the desired joint states to perform the task and then let the joint-level controllers compute the robot’s final control signals. By using joint-level controllers based on control theory (such as PD position control or impedance control), strict joint safety limits are applied. Hand–object stability is also an important aspect of safety in manipulation. However, it is still softly promoted, resulting in the long-tail instability problem. Tao et al. [ 34 ] introduce a learning framework with stability being softly encouraged on the basis of heuristic criteria such as “more contact points” and “keep the object in the palm area”. However, because of attempts to learn multiple dexterous skills at once, determining more specific, theoretically derived criteria is difficult. Sievers et al. [ 30 ] apply a simulation environment with a gravity curriculum and reward shaping to promote force closure, a fundamental property for ensuring object stability in the hand [ 19 ] . However, the agent sometimes sacrifices stability to change the object states, resulting in the hand dropping the object. By applying the theory behind stability and targeting in-grasp manipulation skills specifically, our guided RL method achieves better sample efficiency than learning from scratch. II-B Robotic Control Theories for Dexterous Manipulation The control theories behind how humans manipulate objects have been studied, such as power grasp to wrap an object using the whole hand [ 5 ] , in-hand relocation [ 35 ] , in-hand reorientation [ 18 ] , or sliding regrasp and relocation [ 9 ] . Control theories of how to manipulate objects in the dark or external sensorless stable grasp [ 31 ] , relocation and reorientation [ 32 ] , and regrasp [ 33 ] have also been studied. In general, this field studies predefined sets of rules to compute actions that theoretically can regulate hand–object contact to the desired states. For this reason, suitable theories can be applied so that the actions are as stable as mathematically proven. However, the robot, object, and contact models in the proofs are constrained by many assumptions [ 6 , 10 , 24 ] , such as one specific type of contact, fixed joint friction, stiffness, and damping properties, resulting in inaccurate manipulation. Our standpoint is that control theories are crucial in stable manipulation, but their model assumptions are the bottleneck, and RL can be utilized to address such challenges. II-C RL Guided by Scientific Knowledge Combining learning and scientific knowledge has become a growing field [ 13 ] , with some noticeable methods for robotic manipulation, including physics-informed RL [ 13 ] and residual RL [ 16 , 27 ] . Scientific knowledge can be incorporated softly in the cost function and the environment