Towards Solutions of Manipulation Tasks via Optimal Control of Projected Dynamical Systems

Anton Pozharskiy, Armin Nurkanović, Moritz Diehl · 2025

Read Towards Solutions of Manipulation Tasks via Optimal Control of Projected Dynamical Systems by Anton Pozharskiy, Armin Nurkanović, Moritz Diehl (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11946.txt.

Introduction

Anton Pozharskiy, Armin Nurkanović, and Moritz Diehl plan robot manipulation with projected dynamical systems in a 2025 paper. Pushing and sliding objects involves contact, which switches dynamics on and off and defeats smooth planners. Their framework writes the motion with signed distance functions, turning contact into a complementarity system.

Optimal control then computes trajectories directly, with finite elements that detect switch moments. A friction model from quasi-static practice is included. Tests cover several pushers, friction, and objects built as unions of ellipsoids. The approach promises plans for messy real pushing tasks at reasonable computing cost, a step toward robots that tidy up.

Catalog record

CREATORAnton Pozharskiy, Armin Nurkanović, Moritz Diehl
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-11946

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Solutions of Manipulation Tasks via Optimal Control of Projected Dynamical Systems Anton Pozharskiy, Armin Nurkanović, Moritz Diehl Abstract We introduce a modeling framework for manipulation planning based on the formulation of the dynamics as a projected dynamical system. This method uses implicit signed distance functions and their gradients to formulate an equivalent gradient complementarity system. The optimal control problem is then solved via a direct method, discretized using finite-elements with switch detection [ 16 ] . An extension to this approach is provided in the form of a friction formulation commonly used in quasi-static models. We show that this approach is able to generate trajectories for problems including multiple pushers, friction, and non-convex objects modeled as unions of convex ellipsoids with reasonable computational effort. I Introduction Optimal control of systems with contacts is a difficult problem in the field of robotic manipulation. This is due to the fact that these kinds of systems are fundamentally under-actuated and encompass nonsmooth phenomena such as contact forces and friction. The under-actuation arises from the fact that the unactuated slider cannot be arbitrarily moved in a given state of the system. The nonsmooth, hybrid dynamics occur due to the switches from contact constrained motion to contact-free motion as well as the sign of friction forces. Much work has been done in this field using approaches that mix of discrete and continuous elements. This includes work using graphs of convex sets [ 8 ] , rapidly exploring random trees [ 24 ] , and differential dynamic programming [ 23 ] . Projected Dynamical Systems (PDS) and a related class of systems called First Order Sweeping Processes (FOSwP) have had relatively little study in the context of optimal control. Some theoretical work has been done on the optimal control of FOSwP with non-overlapping disc conditions [ 3 , 4 ] and some numerical approximations for more generic problems [ 5 ] . Specifically for PDS there is little optimal control literature however they have used for control synthesis [ 11 , 12 ] and were originally proposed in the study of economics [ 7 , 13 ] . We propose a framework which tackles manipulation problems using a PDS to model its dynamics. We then apply direct optimal control to an equivalent Dynamical Complementarity System (DCS) by first accurately discretizing the Optimal Control Problem (OCP) then solving the discrete-time OCP. The resulting finite dimensional optimization problem is a mathematical program with complementarity constraints which is solved via a relaxation homotopy method [ 15 ] . II Projected dynamical systems In this section we briefly review the mathematical formulation we will use to model the manipulation tasks in later sections. First we define the tangent cone to {\mathcal{C}} at x , denoted by \mathcal{T}_{{\mathcal{C}}}\left(x\right) , as the set of all vectors d\in{\mathbb{R}}^{n} for which there exists sequences \{x_{i}\}\subset{\mathcal{C}} and \{t_{i}\},t_{i}\geq 0 , with x_{i}\to x and t_{i}\to 0 , such that {d=\lim_{i\to\infty}\frac{x_{i}-x}{t_{i}}} . We also define the projection operator: {\mathrm{P}_{K}\left(x\right)=\argmin_{s\in K}\frac{1}{2}{\left\|s-x\right\|}^{2}_{2}} . Using these preliminaries we define a PDS which is a form of constrained dynamical system where the state is limited to evolving within a set. The dynamics of such a system are written as: {\dot{x}}(t)=\mathrm{P}_{\mathcal{T}_{{\mathcal{C}}}\left(x(t)\right)}\left(f(x(t))\right), (1) with x(0)\in{\mathcal{C}} and f:{\mathbb{R}}^{n_{x}}\rightarrow{\mathbb{R}}^{n_{x}} which is at least twice continuously differentiable. For computational tractability we treat sets written as {\mathcal{C}}=\{\,x\in{\mathbb{R}}^{n}\mid c(x)\geq 0\,\} with {c:{\mathbb{R}}^{n_{x}}\rightarrow{\mathbb{R}}^{n_{c}}} . In order to numerically solve the PDS we formulate it as an equivalent DCS [ 2 ] : \displaystyle{\dot{x}}(t) \displaystyle=f(x(t))+\nabla c(x(t))\lambda(t), \displaystyle 0 \displaystyle\leq c_{i}(x(t))\perp\lambda_{i}(t)\geq 0,\quad i=1,\ldots,n_{c}. In the manipulation setting the functions c(x(t)) can be interpreted as signed distance functions between objects and the multipliers \lambda as contact forces which act to prevent object overlap. III Modeling manipulation tasks In this section we describe the method for modeling planar manipulation tasks using spherical approximations. This is followed with a promising direction for modeling manipulation tasks with ellipsoidal approximations. Finally we discuss an extension of the simple PDS equivalent model with the well studied quasi-static friction model [ 8 , 10 ] . III-A Spherical manipulation tasks We model the sliding contact dynamics between two discs in the plane via a non-overlapping constraint. In this case we treat two circles with centers p_{1},p_{2}\in{\mathbb{R}}^{2} and radiuses r_{1} and r_{2} , respectively. The non-overlapping of these two discs is written as the inequality {\left\|p_{1}-p_{2}\right\|}^{2}-(r_{1}+r_{2})^{2}\geq 0 . The left hand side expression can be interpreted as a signed distance function between the two discs which must be kept non-negative as in the finite definition of the set {\mathcal{C}} . We model any number of these pairwise contacts via these signed distance functions c_{ij}(x)={\left\|p_{i}-p_{j}\right\|}^{2}-(r_{i}+r_{j})^{2} . In the case of frictionless sliding contacts the existence and uniqueness of the solutions to such a system can be guaranteed if the gradients of the constraint function c(x) satisfy the linear-independence constraint qualification, i.e. the columns of \nabla_{x}c(x) are linearly independent at all points x . III-B Ellipsoidal manipulation tasks Moving from the simplicity of the spherical manipulation tasks in the prequel to using ellipsoids to model objects requires new machinery to define the signed distance distance which we can embed within our formulation. There exist disc-ellipsoid and ellipsoid-ellipsoid distance functions that can be calculated as the solutions to polynomials of various orders though often one needs to resolve which solution is the correct distance [ 21 ] . As such, we choose a formulation in the form of a convex program which has a unique solution and a unique contact point. First, we define an ellipse augmented with its center p\in{\mathbb{R}}^{2} and rotation \theta\in{\mathbb{R}} using the set E(p,\theta)=\{\,x\in{\mathbb{R}}^{2}\mid{(x-p)}^{\top}P(\theta)(x-p)\leq 1\,\}, where P(\theta)={R(\theta)}^{\top}\hat{P}R(\theta) , R(\theta) is the 2d rotation matrix and \hat{P}\in{\mathbb{R}}^{2\times 2} is a positive definite symmetric matrix. Using this definition we devise a signed distance function between two ellipses which is the solution to the convex optimization problem [ 19 ] : \displaystyle c(x)=~ \displaystyle\underset{\displaystyle\begin{subarray}{c}\alpha\in{\mathbb{R}},\\ p_{d}\in{\mathbb{R}}^{2}\end{subarray}}{\mathrm{min}}\quad\alpha-1 \displaystyle\mathmakebox[\widthof{$\underset{\displaystyle\phantom{\begin{subarray}{c}\alpha\in{\mathbb{R}},\\ p_{d}\in{\mathbb{R}}^{2}\end{subarray}}}{\mathrm{min}}$}][c]{\mathmakebox[\widthof{$\mathrm{min}$}][l]{\mathrm{\kern 1.00006pts.t.}}} \displaystyle\alpha\leq{(p_{d}-p_{i})}^{\top}P(\theta_{i})(p_{d}-p_{i}),\ \displaystyle i=1,2, where x=(p_{1},\theta_{1},p_{2},\theta_{2})\in{\mathbb{R}}^{6} . In this optimization problem, \alpha represents a factor by which each ellipse is rescaled. The distance is found by minimizing \alpha such that there is still a common point, the contact point p_{d} , between the two rescaled ellipses, enforced by the constraints now collected as g(\alpha,p_{d};x) . We subtract one in the objective so that if \alpha\leq 1 , c(x)\leq 0 and there is an overlap between the original objects. Due to the convexity of this problem we embed it using its KKT conditions: \displaystyle 1-\mu_{1}-\mu_{2} \displaystyle=0, \displaystyle 2\mu_{1}{P(\theta_{1})}^{\top}(p_{d}-p_{1})+2\mu_{2}{P(\theta_{2})}^{\top}(p_{d}-p_{2}) \displaystyle=0, \displaystyle 0\leq\mu_{i}\perp e{(p_{d}-p_{i})}^{\top}P(\theta_{i})(p_{d}-p_{i})-\alpha \displaystyle\geq 0,\ i=1,2, introducing the Lagrange multipliers \mu\in{\mathbb{R}}^{2} . In order to use this formulation of the signed distance function (SDF), we extract from it its gradient d_{n}(x)=\nabla_{x}c(x)=\nabla_{x}(g(\alpha,p_{d};x))\mu as in [ 6 ] . The contact point is unique and therefore for any configuration of two ellipsoids d_{n}(x) is unique. This is sufficient to show that the tangent cone must be closed and convex at all points [ 17 ] . As such, we can show that unique solutions exist (under mild assumptions on f(x,u) ) for the projected dynamical system in Equation 1 [ 13 ] . We can further model non-convex shapes using the union of multiple ellipses with a common point used as the center of each ellipse.

Read the complete text