FineGrasp: Towards Robust Grasping for Delicate Objects
Yun Du, Mengao Zhao, Tianwei Lin, Yiwei Jin, Chaodong Huang, Zhizhong Su · 2025
Read FineGrasp: Towards Robust Grasping for Delicate Objects by Yun Du, Mengao Zhao, Tianwei Lin, Yiwei Jin, Chaodong Huang, Zhizhong Su (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05978.txt.
Introduction
Yun Du and co-authors present FineGrasp, a robot grasping method tuned for small and delicate objects, in a paper from 2025. Modern manipulation stacks can find and name almost any object part, yet the grasp itself often fails on the tiny or fragile ones, sinking the whole task. The fixes come in three parts.
First, network changes sharpen sensitivity to delicate regions. Second, a new label normalization tackles the imbalance between easy and hard grasp spots in training data. Third, a fresh simulated dataset, mixed with real data in training, lifts performance further. Tests showed clear gains, above all on small objects, and the system held up in language-guided semantic grasping trials.
Catalog record
| CREATOR | Yun Du, Mengao Zhao, Tianwei Lin, Yiwei Jin, Chaodong Huang, Zhizhong Su |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-05978
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FineGrasp: Towards Robust Grasping for Delicate Objects Yun Du, Mengao Zhao, Tianwei Lin, Yiwei Jin, Chaodong Huang, Zhizhong Su Abstract Recent advancements in robotic grasping have led to its integration as a core module in many manipulation systems. For instance, language-driven semantic segmentation enables the grasping of any designated object or object part. However, existing methods often struggle to generate feasible grasp poses for small objects or delicate components, potentially causing the entire pipeline to fail. To address this issue, we propose a novel grasping method, FineGrasp, which introduces improvements in three key aspects. First, we introduce multiple network modifications to enhance the model’s ability to handle delicate regions. Second, we address the issue of label imbalance and propose a refined graspness label normalization strategy. Third, we introduce a new simulated grasp dataset and show that mixed sim-to-real training further improves grasp performance. Experimental results show significant improvements, especially in grasping small objects, and confirm the effectiveness of our system in semantic grasping. Code will be available at robo_orchard_lab/finegrasp . I INTRODUCTION As one of the most frequently used end-effector designs for robotic arms, the two-finger parallel grippers have driven the development of dedicated 6-DoF grasp detection task. Recent data-driven methods [ 1 , 2 , 3 ] have demonstrated remarkable performance, making them a fundamental component of many robotic manipulation systems. As shown in Fig. 1 , a prevalent framework integrates the grasp detection module with a semantic reasoning module (e.g., GPT-4o, SAM), which generates masks to filter grasp poses for objects specified by language commands. This semantic grasping capability enables a variety of tasks, including task-oriented grasping [ 4 ] and part grasping [ 5 ] . Existing grasping methods [ 1 , 3 ] have demonstrated robust performance for various objects with regular shapes and size, achieving an average grasp success rate exceeding 90%. However, as illustrated in Fig. 2(a), our implementation of the semantic grasping system reveals that the grasp model occasionally fails to generate feasible grasp poses for small objects or small parts of medium and large objects, leading to the failure of overall system. In [ 6 ] , the scale of grasp pose is defined as the minimum width between the gripper’s fingers. Accordingly, delicate grasping issues can be attributed to small-scale grasp poses. Why do existing methods struggle with small-scale grasp pose estimation? We believe the key issue is that during training, networks tend to focus on larger, easier-to-grasp objects in complex scenes, leading to the neglect of finer objects. Prior work [ 6 ] discussed this scale imbalance problem, and addressed them by incorporating multi-scale features, scale-aware weighted loss, and explicit balanced sampling via an object segmentation network during inference. However, despite their initial effectiveness, these improvements are now insufficient and come with added computational overhead. Fig. 1: Overview of a common semantic grasping framework. First, a pre-trained Vision-Language Model (VLM) is utilized to locate the desired (part of) object. Next, a point-cloud based grasping module generates the corresponding grasp poses. The primary challenge here lies in the difficulty of generating grasp poses for small objects and dedicate components. Fig. 2: Illustrating the challenges of delicate object grasping based on EconomicGrasp: (a) Two typical failure scenarios: the left image shows the model failing to generate a usable grasp pose for small objects in a cluttered scene, while the right image shows poor pose quality, leading to potential failure. (b) Issues in graspness ground truth generation: the middle image shows ground truth after cross-object normalization, where scissors are ignored. The right image shows our strategy, normalizing within each object first to ensure consistent scoring across objects. In this work, we propose a novel method FineGrasp , to address these challenges with three key improvements. First , existing methods select sparse points (e.g., 1024) from the dense point cloud based on graspability scores for grasp poses estimation. However, as shown in Fig. 2(b), global normalization of graspability labels often suppresses those of small objects, making them harder to learn. To overcome this, we introduce a new strategy that normalizes labels within each object first. This ensures that small objects receive effective supervision during training, and eliminates the need for a segmentation network during inference. Second , we enhance existing methods [ 3 , 6 ] by introducing a multi-range attention module that extracts and fuses multi-scale features around candidate sample points via attention, allowing the model to learn scale-specific weights. We also integrate object surface normals as an auxiliary input to the grasping model, leveraging their strong correlation with optimal grasping directions to improve the network’s accuracy in orientation estimation. Third , depth sensor noise may lead to small objects being overlooked during training. To address this, we create supplementary simulation scenes using assets from GraspNet [ 1 ] , which are combined with real data for mixed training. This strategy effectively improves overall performance. In summary, our contributions are as follows: • We propose FineGrasp, a novel method that improves grasp pose accuracy for fine objects, demonstrating significant performance gains in experiment. • We address the fine object grasping problem by introducing a new graspability ground truth generation strategy and several model improvements. • We create an extended simulation dataset for GraspNet, using mixed training to enhance performance. • We introduce a VLM-based semantic grasping framework to validate the effectiveness of our method. II RELATED WORK II-A 6-DoF Grasp Pose Detection The 6-DoF grasp pose detection task revolves around two fundamental questions: ”Where to grasp?” and ”How to grasp?” Accordingly, most existing methods adopt a two-stage prediction pipeline — first, point sampling is used to identify graspable regions, followed by grasp pose prediction in the second stage. GSNet [ 7 ] introduced a graspness prediction task during the point sampling phase, enabling the model to more effectively identify graspable regions in cluttered scenes. To tackle scale imbalance, Scale Balanced Grasp [ 6 ] proposed an object-balanced sampling strategy using an auxiliary segmentation network, which significantly improves performance on small-scale grasps. Additionally, EconomicGrasp [ 3 ] identified dense supervision as a bottleneck in existing grasp models and proposed an economic supervision paradigm, achieving superior grasp performance with reduced computational cost. II-B Grasp Datasets GraspNet-1Billion [ 1 ] is the most extensively utilized dataset for two-finger gripper grasps. It comprises 190 cluttered scenes constructed in real-world environments. A robotic arm equipped with an RGB-D sensor was employed to capture images from various perspectives, while the 6-DoF grasp poses were acquired through analytical computation of force closure. Nevertheless, data collection in real-world settings is inherently time-consuming and challenging, which hinders efforts to achieve large-scale expansion. As a result, certain methodologies advocate for the synthesis of grasp data within a simulation environment. For example, Sim-Grasp [ 8 ] introduced an approach-based sampling scheme coupled with dynamic evaluation in Isaac Sim simulator [ 9 ] to generate grasping labels, and encompasses a substantial number of open-source assets. Furthermore, several methodologies extend this into the domain of dexterous hand grasping, such as DexGraspNet 2.0 [ 10 ] . II-C Grasp Model in robotic manipulation As a fundamental component of real-world robotic manipulation, various approaches have been developed to integrate grasp models into systems, aiming to improve efficiency and