KnotDLO: Toward Interpretable Knot Tying
Holly Dinkel, Raghavendra Navaratna, Jingyi Xiang, Brian Coltin, Trey Smith, Timothy Bretl · 2025
Read KnotDLO: Toward Interpretable Knot Tying by Holly Dinkel, Raghavendra Navaratna, Jingyi Xiang, Brian Coltin, Trey Smith, Timothy Bretl (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-22176.txt.
Introduction
Holly Dinkel and co-authors present a robot method for tying knots in a rope with one hand in 2025. The rope is a soft linear object whose shape shifts as it moves. Their method, called KnotDLO, needs no human demos and no training. It plans grasp points and target points from the rope's current shape.
The shape is tracked as a chain of short line pieces. Grasp spots come from that chain and stay smooth as the shape changes. Mid points are computed from the shape now and the shape wanted next. Sight and control are kept apart in the design. In sixteen trials, the robot tied a simple knot half the time from new start shapes.
Catalog record
| CREATOR | Holly Dinkel, Raghavendra Navaratna, Jingyi Xiang, Brian Coltin, Trey Smith, Timothy Bretl |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 12 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-22176
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
KnotDLO: Toward Interpretable Knot Tying Holly Dinkel, Raghavendra Navaratna, Jingyi Xiang, Brian Coltin, Trey Smith, Timothy Bretl Abstract This work presents KnotDLO, a method for one-handed Deformable Linear Object (DLO) knot tying that is robust to occlusion, repeatable for varying rope initial configurations, interpretable for generating motion policies, and requires no human demonstrations or training. Grasp and target waypoints for future DLO states are planned from the current DLO shape. Grasp poses are computed from indexing the tracked piecewise linear curve representing the DLO state based on the current curve shape and are piecewise continuous. KnotDLO computes intermediate waypoints from the geometry of the current DLO state and the desired next state. The system decouples visual reasoning from control. In 16 trials of knot tying, KnotDLO achieves a 50% success rate in tying an overhand knot from previously unseen configurations. I Introduction Manipulating Deformable Linear Objects (DLOs) into knots is useful for many robotic tasks, including climbing [ 1 , 2 ] , surgery [ 3 , 4 , 5 , 6 ] , household robotics [ 7 ] , and industrial robotics [ 8 , 9 , 10 ] . Manipulating DLOs can be categorized based on the type of DLO shape information used as input. Tasks such as insertion [ 11 ] , disentangling [ 12 , 7 ] , and clearing DLOs from the path to other objects [ 13 ] may only require information such as the location of the tips, the locations of crossings, or the locations of inner and external knot segments rather than a full shape estimate. Tasks such as winding, braiding, and knotting may benefit from a complete shape estimate [ 14 ] . One challenge is representing the DLO topology, especially when the DLO is occluded by itself or the environment as it is manipulated. Recent work in real-time visual DLO tracking enables occlusion-robust topology representation for autonomous knot tying. KnotDLO achieves repeatable knot tying using topological waypoints validated in overhand knot tying experiments with a success rate of 50%, compared to the success rate of the learning-based state-of-the-art method of 66% [ 15 ] . The topological waypoints enable transformation between knot states using movement primitives independent of task parameterizations such as initial DLO configuration or DLO length. KnotDLO computes geometric grasp and target poses from the geometry of the DLO and are a subset of a continuous space of grasp and target poses defined by the DLO topology. Fig. 1: One robot arm with a parallel gripper grasps the DLO and moves it between topological waypoints. The DLO topology is tracked from imagery collected by a camera mounted on the last link of a second robot arm. Fig. 2: Given an initial symmetric, curve-shaped DLO configuration, the planning system computes grasp and target indices from the topology to compose a sequence knot tying movement primitives. (Top) Sequentially performing Reidemeister Move I (RI), Reidemeister Move II (RII), and the Cross Move (X) results in an overhand knot. (Bottom) The tracking system tracks the shape of the DLO as it moves. Fig. 3: Four movement primitives can transform a DLO between any knot states. (Left) Reidemeister Move I twists the DLO to add or remove one crossing. (Center left) Reidemeister Move II slides one strand over one loop to add or remove two crossings. (Center right) Reidemeister Move III slides one strand over a crossing to transform the knot state around the crossing. (Right) The Cross Move pokes the tip of a DLO through a loop to add or remove two crossings. II Related Work The availability of an accurate DLO topology for robotic knot tying has conventionally been limited by perception systems which struggle to follow the shape of the DLO as it is occluded within the environment or as it is occluded by itself during the formation of intersections. One method overcomes this by learning a fast and differentiable neural network model of the DLO dynamics to augment segmentation-based shape estimation with physics [ 16 , 17 ] . Another method learns DLO configuration-independent dense depth object descriptors from synthetic ropes rendered in Blender and uses these descriptors to learn manipulation action sequences with visual imitation of demonstrations [ 15 ] . This method encodes geometric structure on the descriptors and learns them in simulation without any robot motion learning. This accelerates training time substantially from work which requires collecting robot motion demonstration data for imitation [ 18 , 19 ] and enables transferring the learned visual representation across domains. Other work performs DLO shape manipulation with visual feedback for shape control without self-occlusion [ 17 , 20 , 21 ] . Recent advances in DLO perception enable DLO shape tracking under environment occlusion [ 22 , 23 , 24 ] . These methods also accurately track shape under self-occlusion, offering new opportunities for full DLO state representation for knot tying. The Reidemeister moves are a set of movement primitives which add or remove links in a knot projection, creating a new projection. Reidemeister Move I (RI) adds or removes one crossing through twisting or untwisting. Reidemeister Move II (RII) adds or removes two crossings by sliding one straight segment over one curved segment. Reidemeister Move III (RIII) transforms the topology of a crossing by sliding one segment over or under a crossing [ 25 ] . The Cross Move (X) was introduced for tying objects which are not closed loops in the unknotted state. It passes the tip of the rope through a loop in the knot to create a crossing. Composing the RI, RII, and X moves in sequence results in an overhand knot. III One-Handed Overhand Knot Manipulation This work presents an overhand knot tying system using real-time visual DLO shape tracking to compute manipulation waypoints [ 24 ] . The topology of a DLO is represented as a piecewise linear curve, S , constructed from a set of M control points, C^{M\times 3}\in\mathbb{R}^{3} . The curve S is parameterized at time t by curvilinear length, s^{t} , and total length, L , with S:s\in[0,1]\rightarrow S(s^{t};L)\in\mathbb{R}^{3}. (1) The head and tail positions of the DLO are S(0) and S(1) . Two curvilinear lengths, s_{i}^{t} and s_{j}^{t} , are determined to be on the same segment of S(s^{t};L) if \left|\text{idx}_{i}-\text{idx}_{j}\right|\leq 1 , where \text{idx}_{i}=\left\lfloor s_{i}\times(M-1)\right\rceil. (2) The geodesic distance defines the length of the shortest path along a manifold. The geodesic distance, \rho(s_{i}^{t},s_{j}^{t}) , is \rho(s_{i}^{t},s_{j}^{t})= \begin{cases}\left|s_{j}^{t}-s_{i}^{t}\right|\cdot\left\|S(s_{j}^{t})-S(s_{i}^{t})\right\|\text{ if }\left|\text{idx}_{j}-\text{idx}_{i}\right|\leq 1\\ \left|1-s_{j}^{t}\right|\cdot\left\|S(s_{i}^{t})-C_{\text{end,i}}^{t}\right\|+\left|s_{j}^{t}\right|\cdot\left\|S(s_{j}^{t})-C_{\text{end,j}}^{t}\right\|\\ +\sum_{m=\text{end,i}+1}^{\text{end,j}}\left\|C_{m}-C_{m-1}\right\|\text{ otherwise}\end{cases}, (3) where \|\cdot\| is the l_{2} norm and \vskip-0.92505ptC_{\text{end,i}}^{t}=\argmin_{m\in M}\|S(s_{i}^{t})-C_{m}\|.\vskip-0.92505pt (4) The DLO topology is used to plan grasp and target poses for a robot arm with a gripper to tie an overhand knot. As shown in Fig. 4 , the orientation of these poses are computed using the semi-planar manipulation constraint (i.e., z=\left[0,0,1\right] ), where the y- axis of the transform is the unit-length tangent vector to the curve at the desired point, dS(s^{t};L)/ds , and the x- axis is the axis normal to the y-z plane. Waypoints transforming each grasp pose to the target pose are designed to reduce effects from sliding on the manipulation plane. Seven curvilinear lengths— s=0.5 , s=\lambda , s=1-\lambda , s_{\text{cb}} (the crossing bottom), s_{\text{ct}} (the crossing