Robust Rigid Body Assembly via Contact-Implicit Optimal Control with Exact Second-Order Derivatives
Christian Dietz, Sebastian Albrecht, Gianluca Frison, Moritz Diehl, Armin Nurkanović · 2026
Read Robust Rigid Body Assembly via Contact-Implicit Optimal Control with Exact Second-Order Derivatives by Christian Dietz, Sebastian Albrecht, Gianluca Frison, Moritz Diehl, Armin Nurkanović (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22849.txt.
Introduction
Christian Dietz and four co-authors plan how robots can put parts together with care. Assembly planning has long leaned on learning methods and random sampling, both hungry for simulation time. Their approach uses optimal control that accounts for contact between parts.
The method uses exact second-order derivative data, which sharply cuts the number of simulation steps needed. It also stays robust, so plans hold up when the real world differs a little. Sample-efficient planning could make factory robots faster to program for new products. Contact-implicit planning treats contact forces as part of the optimization itself, rather than as an afterthought added later.
Catalog record
| CREATOR | Christian Dietz, Sebastian Albrecht, Gianluca Frison, Moritz Diehl, Armin Nurkanović |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22849
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Robust Rigid Body Assembly via Contact-Implicit Optimal Control with Exact Second-Order Derivatives Christian Dietz, Sebastian Albrecht, Gianluca Frison, Moritz Diehl, Armin Nurkanović Abstract Efficient planning of assembly motions is a long standing challenge in the field of robotics that has been primarily tackled with reinforcement learning and sampling-based methods by using extensive physics simulations. This paper proposes a sample-efficient robust optimal control approach for the determination of assembly motions, which requires significantly less physics simulation steps during planning through the efficient use of derivative information. To this end, a differentiable physics simulation is constructed that provides second-order analytic derivatives to the numerical solver and allows one to traverse seamlessly from informative derivatives to accurate contact simulation. The solution of the physics simulation problem is made differentiable by using smoothing inspired by interior-point methods applied to both the collision detection as well as the contact resolution problem. We propose a modified variant of an optimization-based formulation of collision detection formulated as a linear program and present an efficient implementation for the nominal evaluation and corresponding first- and second-order derivatives. Moreover, a multi-scenario-based trajectory optimization problem that ensures robustness with respect to sim-to-real mismatches is derived. The capability of the considered formulation is illustrated by results where over 99% successful executions are achieved in real-world experiments. Thereby, we carefully investigate the effect of smooth approximations of the contact dynamics and robust modeling on the success rates. Furthermore, the method’s capability is tested on different peg-in-hole problems in simulation to show the benefit of using exact Hessians over commonly used Hessian approximations. I Introduction Differentiable physics simulation increasingly receives attention in the robotics community motivated by the potential that providing derivative information to planning and control algorithms can substantially increase their computational efficiency [ 23 , 50 , 30 ] . It is already successfully leveraged within reinforcement learning (RL) and model predictive control (MPC) methods applied to tasks such as quadruped walking or dexterous manipulation [ 40 , 19 ] . Assembly problems have predominantly been addressed by derivative-free reinforcement learning algorithms using extensive simulation [ 46 , 22 ] even though derivative-based methods showed improved sample-efficiency on other problem classes [ 50 , 30 ] . We deduce that there is currently a gap of derivative-based algorithms that successfully utilize differentiable physics simulation methods to solve assembly tasks. Fig. 1 : Illustration of a considered assembly problem and this paper’s methodology. The optimization of assembly trajectories is facilitated by initially relaxing object shapes and force-distance complementarities followed by sequentially tightening the relaxations. Video highlighting the methodology: https://youtu.be/g4E83bjs7lg The large majority of the work on physics simulation for robotics agrees on formulating contact-rich dynamical systems in continuous time as complementarity Lagrangian systems with state jumps [ 7 ] , and deriving discrete-time dynamics by applying a time-stepping discretization to obtain a nonlinear complementarity problem (NCP) [ 34 ] . To construct the contact NCP, first multiple collision detection problems that compute the distance between pairs of convex objects have to be solved and corresponding contact normal vectors have to be determined which encode the direction in which contact forces act. These collision detection problems for convex objects can be formulated as convex quadratic programs such that their optimality conditions take the form of linear complementarity problems (LCP). Thus, computing a single simulation step comes down to solving multiple collision LCP and then using these solutions to construct and solve a single contact NCP. The challenge for using derivative-based methods to solve contact-rich tasks lies primarily in the fact that the solution of the contact NCP is inherently nonsmooth with respect to its problem data. This means that the position and velocity of objects at the next time step can be nondifferentiable with respect to the position and velocity of objects as well as the control input at the current time step. This is due to two hierarchically structured causes. The first cause are positions, where an infinitesimal alteration results in a change of an active complementarity condition in a collision LCP. This means contact points switching between faces, edges or vertices on a convex object. The second cause are current positions and velocities where infinitesimal alterations result in changes of active complementarity conditions in the contact NCP. Here two distinctions can be made. Either such a switch corresponds to activation or deactivation of contact forces between a pair of convex objects, or one pair of such objects switches its friction mode from static to sliding or vice versa. Consequentially, constructing differentiable physics simulations necessarily requires additional custom design choices, as for the original NCP formulation derivatives do not exist everywhere. There are three common choices that can be found in the physics simulation literature. First, determining exact derivatives under the assumption that active complementarity conditions do not change [ 26 , 48 ] . For situations where infinitesimal changes in positions or velocities result in switches in the active complementarity conditions, one obtains subgradients. Second, using finite differences or randomized smoothing [ 32 , 27 ] to obtain approximate derivatives that do not correspond to exact derivatives of the nominal LCP or NCP evaluation. These two approaches both likely hinder success of optimization routines, as either the produced derivatives are not globally informative for the behavior of the underlying dynamics, or there is a mismatch between the nominal evaluation that is nonsmooth and the derivatives that correspond to a smooth approximation of the nonsmooth evaluation. A more optimization-suited approach is therefore the third, which is constructing smooth approximations to the complementarity problems and then determining corresponding exact derivatives [ 16 , 43 ] . Remarkably, most existing work on differentiable physics simulation only focuses on the nondifferentiabilities caused by the contact NCP while disregarding the contribution of the collision LCP. This likely contributes to the lack of work that tackles assembly problems with complex geometries using differentiable physics simulation. In this paper, we focus on frictionless contacts which leads to the reduction of the contact NCP to a contact LCP, under the precondition that a semi-implicit Euler integration was used to derive the time-stepping discretization. A LCP formulation of contact dynamics can also be obtained when friction is considered by linearization of the friction cone as done in several physics engines [ 48 ] . We formulate the collision detection problem as a linear program (LP) using so-called growth distances [ 36 ] , where we propose a modified formulation that is motivated by the goal to obtain well-scaled derivatives that can be utilized in optimal control formulations. We construct smooth approximations to this distance problem by leveraging interior-point methods. Recurrent application of the implicit function theorem enables analytic formulations for first- and second-order derivatives. For the contact resolution problem, the well-established quadratic program formulation of Moreau [ 34 ] is used, which allows one to obtain a smooth approximation again by utilizing smoothing as implied by interior-point methods. We take the approach of directly transcribing the optimality conditions of the contact resolution problem into the optimal control problem. In this case, the interior-point smoothing can also be interpreted as Scholtes’ smoothing applied to the complementarity conditions of the contact LCP and also enables one to use Scholtes’ relaxation method [ 38