SI-Diff: A Framework for Learning Search and High-Precision Insertion with a Force-Domain Diffusion Policy
Yibo Liu, Stanko Oparnica, Simon Shewchun-Jakaitis · 2026
Read SI-Diff: A Framework for Learning Search and High-Precision Insertion with a Force-Domain Diffusion Policy by Yibo Liu, Stanko Oparnica, Simon Shewchun-Jakaitis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12247.txt.
Introduction
Yibo Liu and seven colleagues build SI-Diff, one framework for search and insertion using a diffusion policy. Assembly tasks like peg-in-hole suffer pose uncertainty, and systems handle search and insertion separately since they need different patterns. SI-Diff adds mode conditioning so one policy captures both behaviors, plus a teacher policy that generates paths. Trained on teacher demos, the model maps touch and velocity readings to actions. Tests show it widens misalignment tolerance from 2 mm to 5 mm over the TacDiffusion baseline, with transfer to unseen shapes.
Catalog record
| CREATOR | Yibo Liu, Stanko Oparnica, Simon Shewchun-Jakaitis |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45769 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.12247
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SI-Diff: A Framework for Learning Search and High-Precision Insertion with a Force-Domain Diffusion Policy Thanks: Manuscript received: October 10, 2025; Revised: February 5, 2026; Accepted April 25, 2026. This paper was recommended for publication by Editor Ashis Banerjee upon evaluation of the Associate Editor and Reviewers’ comments. (Corresponding author: Yibo Liu.) Thanks: The authors are with Epson Canada, Markham, Ontario L3R 6G3, Canada. (email: [email protected]) Thanks: Simon Shewchun-Jakaiti is with Queen’s University, Kingston, Ontario K7L 3N6, Canada. He made contributions during his internship at Epson Canada. Thanks: Project page: https://yorklyb.github.io/SI-Diff/ Thanks: Digital Object Identifier: see top of this page. Yibo Liu, Stanko Oparnica, Simon Shewchun-Jakaitis Abstract Contact-rich assembly is fundamental in robotics but poses significant challenges due to uncertainties in relative poses, such as misalignments and small clearances in peg-in-hole tasks. Existing approaches typically address search and high-precision insertion separately, because these tasks involve distinct action patterns. However, supporting both tasks within a single model, without switching models or weights, is desirable for intelligent assembly systems. In this work, we propose SI-Diff, a framework that learns both search and high-precision insertion through a force-domain diffusion policy. To this end, we introduce a new mode-conditioning mechanism that enables the policy to capture distinct action behaviors under a single framework. Moreover, we develop a new search teacher policy that can generate diverse trajectories. By training on successful and efficient demonstrations provided by the teacher policy, the model learns the mapping from tactile and end-effector velocity observations to effective action behaviors. We conduct thorough experiments to show that SI-Diff extends the tolerance to x–y misalignments from 2 mm to 5 mm compared to the state-of-the-art baseline, TacDiffusion [ 25 ] , while also demonstrating strong zero-shot transferability to unseen shapes. I INTRODUCTION Contact-rich assembly [ 25 , 26 , 16 , 4 ] is crucial in robotics, especially for manufacturing and service robot systems designed to replace human labor. In real-world scenarios, imprecise placement of objects or parts leads to uncertainties in relative poses, which pose significant challenges for automated assembly [ 17 ] . Although visual servoing [ 23 ] can achieve coarse alignment, its accuracy in cost-constrained industrial environments is typically limited to the millimeter level, which is insufficient for sub-millimeter-clearance peg-in-hole tasks. Thus, force-based methods are required to reliably complete the insertion. Addressing these challenges requires different strategies tailored to specific types of pose uncertainty. Taking the peg-in-hole task as an example, when x–y misalignment is the main concern, search strategies [ 19 , 24 ] are employed to align the peg and hole. The objective of search is to detect the hole boundary and reduce positional error through lateral exploration. When the peg and hole are generally aligned but the clearance is small, smart insertion strategies [ 26 , 25 , 4 ] are required to accomplish high-precision (sub-millimeter-level) tasks. The goal of insertion is to guide the peg to its desired displacement/pose within the hole while resolving unfavorable contact conditions, such as jamming, during the process. However, most previous research either focuses solely on the search [ 19 , 24 ] or the high-precision insertion problem [ 25 ] , or adopts separate methodologies to address them individually [ 26 ] . Developing a framework to address both tasks is challenging, given that search and high-precision insertion entail distinct action patterns. In contrast, an experienced human worker, effectively functioning as a single framework, can perform two tasks without delay in switching knowledge domains. The capability to learn and execute diverse strategies within a single framework is advantageous for real-world industrial applications, as it reduces engineering complexity and facilitates integration compared to separately designed modules. Recently, TacDiffusion [ 25 ] was proposed to tackle relative pose uncertainties in high-precision peg-in-hole tasks based on a force-domain diffusion policy. It adopts a feedforward-force-based impedance control framework, where the feedforward force corresponds to a smart wiggle motion learned from a rule-based teacher policy [ 26 ] , enabling the peg to escape from a stuck state. This wiggle motion involves 6-DoF end-effector (EE) actions, suggesting potential for addressing both search and high-precision insertion simultaneously. However, TacDiffusion assumes the peg and hole are already generally aligned and cannot cope with misalignments beyond 2 mm, indicating limited tolerance to pose variations in practice. Fig. 1: Framework Overview. SI-Diff takes tactile and spatial observations, together with a mode prompt, as input and generates feedforward forces to drive an impedance controller in executing distinct action patterns for search and insertion. This is achieved by simultaneously learning from two teacher policies through the proposed mode conditioning mechanism. Although SI-Diff is trained on a single shape, it demonstrates zero-shot generalization to unseen shapes. In this work, we propose SI-Diff, a novel framework that learns search and high-precision insertion with a force-domain diffusion policy. As shown in Fig. 1 , our method learns and performs two distinct action behaviors under a single framework. Compared to TacDiffusion [ 25 ] , which only learns to escape from stuck states, we develop a new rule-based teacher policy that handles non-trivial misalignments and enables efficient training data collection by generating diverse trajectories. We develop a new mode conditioning mechanism to guide the policy in learning action patterns for search and insertion simultaneously and sufficiently. We conduct thorough experiments to demonstrate that, compared to the state-of-the-art baseline model TacDiffusion [ 25 ] , our method extends the error tolerance ability from 2 mm to 5 mm. Moreover, SI-Diff only learns from a single shape but shows robust zero-shot transferability to unseen peg shapes. The contributions of this work are: • We develop a novel framework for learning search and high-precision insertion with a force-domain diffusion policy. • We design a new mode conditioning mechanism, which enables the model to learn two tasks simultaneously while performing distinct action patterns based on the mode prompt. • We develop an effective search teacher policy that can generate diverse trajectories, enabling efficient training data collection. II Related Work II-A High-Precision Peg-in-hole Task Although peg-in-hole has been extensively studied, most prior works regard insertion after peg–hole alignment as a simple task [ 32 , 24 ] that can be accomplished by merely applying a force in the insertion direction, which in practice is realized through velocity or position controllers. For example, in [ 32 ] , the insertion primitive is to simply apply a consistent velocity command along the z-direction. The other example is [ 24 ] , where the insertion is completed through a position-based controller. Unfortunately, as introduced in [ 25 , 26 , 4 ] , when the clearance between the peg and hole is small, relying solely on velocity or position controllers is insufficient, as the tolerance and the robot’s precision are at the same level ( e.g. sub-millimeter level). Even advanced localization systems based on vision [ 8 , 30 , 9 , 31 ] and LiDAR [ 11 , 13 ] struggle to reliably achieve this level of accuracy, making contact-based feedback essential. To address the task of high-precision insertion, [ 4 , 16 ] propose learning force-domain control strategies instead of velocity- or position-based control methods. However, these studies [ 4 , 16 ] focus on specific small-clearance setups with known