BiGraspFormer: End-to-End Bimanual Grasp Transformer

Kangmin Kim, Seunghyeok Back, Geonhyup Lee, Sangbeom Lee, Sangjun Noh, Kyoobin Lee · 2025

Read BiGraspFormer: End-to-End Bimanual Grasp Transformer by Kangmin Kim, Seunghyeok Back, Geonhyup Lee, Sangbeom Lee, Sangjun Noh, Kyoobin Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-19142.txt.

Introduction

Robots often need two hands to lift large or awkward objects, yet most grasp planners think one arm at a time. Kangmin Kim and five co-authors present BiGraspFormer, a single transformer system that plans both hands' grasps together from a 3D point cloud of the object. Older two-stage pipelines plan grasps first and judge pairs later, which invites collisions and lopsided forces.

Their strategy starts from many single-hand candidates made by a transformer decoder. Special attention layers then reuse what those candidates learned to predict paired poses and quality scores jointly. Working from singles first shrinks the huge twelve-degree search space and keeps the two hands coordinated. In simulations and real-world trials the system beat existing methods while answering in a fraction of a second. Code and extra material are posted online.

Catalog record

CREATORKangmin Kim, Seunghyeok Back, Geonhyup Lee, Sangbeom Lee, Sangjun Noh, Kyoobin Lee
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-19142

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BiGraspFormer: End-to-End Bimanual Grasp Transformer Kangmin Kim, Seunghyeok Back, Geonhyup Lee, Sangbeom Lee, Sangjun Noh, Kyoobin Lee Abstract Bimanual grasping is essential for robots to handle large and complex objects. However, existing methods either focus solely on single-arm grasping or employ separate grasp generation and bimanual evaluation stages, leading to coordination problems including collision risks and unbalanced force distribution. To address these limitations, we propose BiGraspFormer, a unified end-to-end transformer framework that directly generates coordinated bimanual grasps from object point clouds. Our key idea is the Single-Guided Bimanual (SGB) strategy, which first generates diverse single grasp candidates using a transformer decoder, then leverages their learned features through specialized attention mechanisms to jointly predict bimanual poses and quality scores. This conditioning strategy reduces the complexity of the 12-DoF search space while ensuring coordinated bimanual manipulation. Comprehensive simulation experiments and real-world validation demonstrate that BiGraspFormer consistently outperforms existing methods while maintaining efficient inference speed ( < < 0.05s), confirming the effectiveness of our framework. Code and supplementary materials are available at https://sites.google.com/bigraspformer I INTRODUCTION Bimanual grasping enables robots to manipulate large, heavy, or unwieldy objects beyond single-arm capabilities, making it essential for tasks such as lifting furniture, carrying long boards, or moving large boxes [ 1 , 2 ] . However, most robotic grasping research has focused on single-arm systems, primarily on learning to detect 6-DoF grasp poses from point clouds [ 3 , 4 , 5 , 6 , 7 , 8 ] . While effective for single-arm tasks, these approaches cannot be directly extended to bimanual scenarios. First, bimanual grasping expands the action space to 12-DoF, doubling the computational complexity. Second, it introduces new challenges, including collision avoidance, balanced force/torque distribution, and dual-arm coordination for post-grasp manipulation. Fig. 1: BiGraspFormer for coordinated bimanual grasping. (Top) Comparison between single and bimanual grasping for large objects. (Bottom) BiGraspFormer successfully grasps and lifts diverse objects in real-world environments, demonstrating stable grasps across various geometries. We visualize the point cloud with the top-10 grasp predictions; the highest-scoring pair is highlighted in thick blue. For bimanual grasping, only a few methods have been proposed so far. The DA2 dataset [ 9 ] introduced the first benchmark by extending single-arm datasets [ 10 , 11 , 3 ] with dual-arm-specific metrics such as force closure, dexterity, and torque balance [ 9 , 12 ] . However, most existing approaches adopt modular architectures that separate grasp generation and evaluation. For example, Dual-PointNetGPD [ 9 ] evaluates the quality of grasp pairs from given candidates, requiring external single-arm grasp generators. Similarly, CGDF [ 13 ] directly generates bimanual grasps but lacks integrated quality prediction, instead relying on additional scoring modules or heuristic pairing strategies [ 14 , 15 ] . As a result, current methods yield limited diversity, poor coordination, and high computation due to modular pipelines. In this paper, we propose BiGraspFormer , the first unified end-to-end framework that directly generates coordinated bimanual grasps from object point clouds (Fig. 1 ). The key insight is that single-grasp features can effectively guide bimanual grasp generation, rather than treating dual-arm coordination as two independent problems. BiGraspFormer introduces a novel Single-Guided Bimanual (SGB) strategy: it first generates diverse single-arm grasp candidates, then leverages their learned features through specialized attention mechanisms to jointly predict bimanual poses and quality scores. This unified approach eliminates separate modules and explicitly models coordination between grasps, enabling stable and efficient dual-arm manipulation. Comprehensive experiments in both simulation and real-world environments demonstrate that BiGraspFormer achieves superior success, diversity, and speed compared to existing methods. Our contributions are summarized as follows: • We propose BiGraspFormer , the first unified end-to-end transformer for diverse, stable bimanual grasp generation. • We introduce the Single-Guided Bimanual (SGB) strategy, which leverages single-arm grasp features to guide bimanual generation, reducing computational complexity and enhancing dual-arm coordination. • We achieve state-of-the-art bimanual grasping performance while maintaining fast inference suitable for real-world deployment. II Related Works II-A Learning-based Single-arm Grasping Most existing methods have focused on single-arm grasping, evolving from discriminative approaches [ 4 , 6 ] that score grasp candidates to generative methods [ 16 , 7 , 5 , 8 , 17 ] that directly synthesize grasps from visual inputs. While these single-arm approaches achieve strong performance on diverse objects, they face fundamental limitations for bimanual scenarios. The action space expands from 6-DoF to 12-DoF, and coordinated dual-arm manipulation introduces critical requirements including collision avoidance, force balance, and post-grasp manipulability for task execution. Simply combining two independent single-arm solutions cannot address these coordination challenges. Our SGB strategy bridges this gap by leveraging single grasp features as guidance for coordinated bimanual generation, rather than simply pairing independent single-arm solutions. II-B Model-based Bimanual Grasping Model-based bimanual grasping methods [ 18 , 19 , 20 , 21 ] have traditionally required explicit object knowledge such as 3D CAD models or predefined shape categories. These methods employ techniques including genetic algorithms for rod-shaped objects [ 18 ] , medial axis transforms for shape analysis [ 19 ] , grasp matrix computations for stability evaluation [ 20 , 21 ] . While these approaches successfully generated stable grasps for known objects, they cannot handle unknown objects in unstructured environments due to their dependence on explicit geometric models. This fundamental limitation has motivated the development of learning-based approaches that can generalize to diverse unseen objects. II-C Learning-based Bimanual Grasping Learning-based approaches have addressed model-based limitations through specialized datasets and neural methods. The DA2 dataset [ 9 ] introduced dual-arm-specific metrics including force closure, dexterity, and torque balance, along with Dual-PointNetGPD for grasp quality evaluation. However, this approach only evaluates pre-generated candidates, requiring separate grasp generators for practical use. Generative methods have since emerged to address this limitation. Dual-Afford [ 22 ] generates task-specific grasps for trained affordances but lacks generalization and diversity. CGDF [ 13 ] employs diffusion models to generate single grasps but requires additional pairing modules to form bimanual candidates, causing computational overhead and grasp pairs with potential arm collisions and unbalanced force distribution due to independent single-arm generation. BiGraspFormer addresses these limitations through unified end-to-end generation and evaluation, eliminating the need for separate modules while ensuring coordinated bimanual planning. Fig. 2: Overview of our BiGraspFormer framework. An object encoder processes point cloud P to extract geometric features. Single Grasp Proposer generates force-closure single grasps, Bimanual Pair Matcher matches them using bimanual quality metrics (force stability, torque balance, dexterity) to create ground truth, and Bimanual Grasp Generator employs SGB attention for final bimanual grasp generation. III Method III-A Motivation Our goal is to predict bimanual grasps \mathcal{B}=\{\mathbf{g}^{1},\mathbf{g}^{2},q\} from an object point cloud P , where \mathbf{g}^{1} and \mathbf{g}^{2} represent the 6-DoF grasp poses of the two arms and q denotes grasp quality. This task is challenging as it involves a 12-DoF action space, doubling the complexity of single-arm grasping. Each grasp needs to achieve force-closure stability while both arms coordinate to avoid collisions, maintain torque balance, and ensure overall stability. To tackle this challenge, we introduce the Single-Guided Bimanual (SGB) grasp generation scheme, which decomposes the prediction of \mathcal{B} into three structured stages. First, generate diverse single grasp candidates under basic stability constraints. Second, select feasible grasp pairs by discarding collisions and ensuring balanced force distribution. Finally,

Read the complete text