BiAssemble: Learning Collaborative Affordance for Bimanual Geometric Assembly
Yan Shen, Ruihai Wu, Yubin Ke, Xinyuan Song, Zeyi Li, Xiaoqi Li, Hongwei Fan, Haoran Lu, Hao Dong · 2025
Read BiAssemble: Learning Collaborative Affordance for Bimanual Geometric Assembly by Yan Shen, Ruihai Wu, Yubin Ke, Xinyuan Song, Zeyi Li, Xiaoqi Li, Hongwei Fan, Haoran Lu, Hao Dong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06221.txt.
Introduction
Yan Shen and co-authors teach robots to reassemble broken objects with two arms in a 2025 paper. Putting parts back into a whole is a core robot skill. The hardest form joins shattered pieces, such as a broken bowl, where the robot has to read shape cues for grasping and fitting, then use both arms together over long action chains.
Their method learns point level affordance, what each point on a part allows, with two arm collaboration built in. To handle judging problems from varied break shapes, they add a real world benchmark with global reproducibility. Tests show their approach beats prior affordance and imitation methods on the assembly task.
Catalog record
| CREATOR | Yan Shen, Ruihai Wu, Yubin Ke, Xinyuan Song, Zeyi Li, Xiaoqi Li, Hongwei Fan, Haoran Lu, Hao Dong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-06221
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BiAssemble: Learning Collaborative Affordance for Bimanual Geometric Assembly Yan Shen, Ruihai Wu, Yubin Ke, Xinyuan Song, Zeyi Li, Xiaoqi Li, Hongwei Fan, Haoran Lu, Hao Dong Abstract Shape assembly, the process of combining parts into a complete whole, is a crucial robotic skill with broad real-world applications. Among various assembly tasks, geometric assembly—where broken parts are reassembled into their original form ( e.g. , reconstructing a shattered bowl)—is particularly challenging. This requires the robot to recognize geometric cues for grasping, assembly, and subsequent bimanual collaborative manipulation on varied fragments. In this paper, we exploit the geometric generalization of point-level affordance, learning affordance aware of bimanual collaboration in geometric assembly with long-horizon action sequences. To address the evaluation ambiguity caused by geometry diversity of broken parts, we introduce a real-world benchmark featuring geometric variety and global reproducibility. Extensive experiments demonstrate the superiority of our approach over both previous affordance-based and imitation-based methods. Project page: https://sites.google.com/view/biassembly/ . † † affiliationnotice: Equal contribution 1 Introduction Shape assembly, the task of assembling individual parts into a complete whole, is a critical skill for robots with wide-ranging real-world applications. This task can be broadly categorized into two main branches: furniture assembly ( Zhan et al. 2020 ; Heo et al. 2023 ; Lee et al. 2021 ) and geometric assembly ( Wu et al. 2023c ; Sellán et al. 2022 ; Lu et al. 2024c ) . Furniture assembly focuses on combining functional components, such as chair legs and arms, into a fully constructed piece, emphasizing both the functional role of each part and the overall structural design. In contrast, geometric assembly involves reconstructing broken objects, like piecing together parts of a shattered mug, to restore their original form. While furniture assembly has been relatively well-studied—ranging from computer vision tasks that predict part poses in the assembled object ( Zhan et al. 2020 ) to robotic systems that assemble parts in both simulation ( Ankile et al. 2024 ; Yu et al. 2021 ; Wang et al. 2022a ) and real-world environments ( Heo et al. 2023 ; Suárez-Ruiz et al. 2018 ; Xian et al. 2017 ) —geometric assembly remains under-explored despite its significant potential for real-world applications ( Sellán et al. 2022 ; Lu et al. 2024b ) , such as repairing broken household items, reconstructing archaeological artifacts ( Papaioannou & Karabassi 2003 ) , assembling irregularly shaped objects in industrial tasks, aligning bone fragments in surgery ( Liu et al. 2014 ) , and reconstructing fossils in paleontology ( Clarke et al. 2005 ) . Previous works on geometric assembly primarily focused on generating physically plausible broken parts through precise physics simulations in the graphics domain ( Sellán et al. 2022 ; Sellán et al. 2023 ) , and estimating the target assembled part poses based on observations in the computer vision domain ( Wu et al. 2023c ; Lu et al. 2024c ; Qi et al. 2025 ) . These studies only consider the geometries and ideal assembled poses of broken parts, dismissing the process of step-by-step assembling parts to the complete shape. However, different from opening a door or closing a drawer, only with the ideal part poses, it is difficult for a robot to directly and successfully manipulate broken parts to the complete shape. Figure 1: (A) Direct learning long-horizon action trajectories of geometric assembly may face many challenges: grasping ungraspable points, grasping points not suitable for assembly ( e.g. , seams of fragments), robot colliding with parts and the other robot. (B) We formulate this task into 3 steps: pick-up, alignment and assembly. For assembly, we predict the direction that will not result in part collisions. For alignment, we transformed any assembled poses to poses easy for the robot to manipulate from the initial poses without collisions. For pick-up, we learn point-level affordance aware of graspness and the following 2 steps. (C) Real-World Evaluations with affordance predictions on two mugs and the corresponding manipulation. The challenges of the above robotic geometric shape assembly task mainly come from the exceptionally large observation and action spaces. For the observation space, the broken parts have arbitrary geometries, and the graspness on the object surface should consider not only the local geometry itself, but also whether grasping on such point can afford the subsequent bimanual assembly actions. For the action space, as illustrated in Figure 1 , it requires long-horizon action trajectories. Given the contact-rich nature of the task, where collisions among the two parts and two robots will easily exist, the actions should be fine-grained and aware of bimanual collaboration. Consequently, the policy must account for geometry, contact-rich assembly processes, and bimanual coordination. We propose our BiAssemble framework for this challenging task. For geometric awareness, we utilize point-level affordance, which is trained to focus on local geometry. This approach has demonstrated strong geometric generalization in diverse tasks ( Wu et al. 2022 ; Wu et al. 2023b ) , including short-term bimanual manipulation ( Zhao et al. 2022 ) , such as pushing a box or lifting a basket. To enhance the affordance model with an understanding of subsequent long-horizon bimanual assembly actions, we draw inspiration from how humans intuitively assemble fragments: after picking up two fragments, we align them at the seam, deliberately leaving a gap (since directly placing them in the target pose often causes geometric collisions), with part poses denoted as alignment poses. We then gradually move the fragments toward each other to fit them together precisely. The alignment poses of the two fragments can be obtained by disassembling assembled parts in opposite directions. With this information, it becomes straightforward to extend the geometry-aware affordance to further be aware of whether the controller can move fragments into the alignment poses without collisions. We develop a simulation environment where robots can be controlled to assemble broken parts. This simulation environment bridges the gap between vision-based pose prediction for broken parts and the real-world robotic geometric assembly. Moreover, since broken parts exhibit varied geometries ( e.g. , the same bowl falling from different heights breaking into different groups of fragments), it is challenging to fairly assess policy performance in real-world settings. To address this, we further introduce a real-world benchmark featuring globally available objects with reproducible broken parts, along with their corresponding 3D meshes, which can be integrated into simulation environment. This benchmark enables consistent and fair evaluation of robotic geometric assembly policies. Extensive experiments on diverse categories demonstrate the superiority of our method both quantitatively and qualitatively. 2 Related Work 2.1 3D Shape Assembly Shape assembly is a well-established problem in visual manipulation, with many studies focusing on constructing a complete shape from given parts, typically involving the pose prediction of each part for accurate placement ( Zhan et al. 2020 ; Wang et al. 2022a ) . Further work ( Heo et al. 2023 ; Tian et al. 2022 ; Jones et al. 2021 ; Willis et al. 2022 ; Tie et al. 2025 ) studied assembly with robotic execution, requiring robots to carry out each step, with benchmarks spanning various applications from home furniture assembly ( Lee et al. 2021 ) to factory-based nut-and-bolt interactions ( Narang et al. 2022 ) . We categorize these tasks into