Whole-body MPC and sensitivity analysis of a real time foot step sequencer for a biped robot Bolt

Constant Roux, Côme Perrot, Olivier Stasse · 2024

Read Whole-body MPC and sensitivity analysis of a real time foot step sequencer for a biped robot Bolt by Constant Roux, Côme Perrot, Olivier Stasse (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01713.txt.

Introduction

Constant Roux, Come Perrot, and Olivier Stasse present a controller for the biped robot Bolt, in a 2024 paper. Their approach pairs a whole-body model predictive controller with a footstep sequencer that plans where each foot lands in real time. The pairing aims at robust walking on two legs. Tests run in simulation rather than on the physical robot.

In those tests, the robot tracks commanded speeds well. It also recovers from pushes and from slips underfoot. On top of the control work, the team give a theoretical sensitivity analysis of the footstep sequencing problem. That analysis explains how sensitive the plan is to its inputs. It deepens the grasp of why the controller behaves as it does.

Catalog record

CREATORConstant Roux, Côme Perrot, Olivier Stasse
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-01713

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Whole-body MPC and sensitivity analysis of a real time foot step sequencer for a biped robot Bolt Constant Roux, Côme Perrot, Olivier Stasse Abstract This paper presents a novel controller for the bipedal robot Bolt. Our approach leverages a whole-body model predictive controller in conjunction with a footstep sequencer to achieve robust locomotion. Simulation results demonstrate effective velocity tracking as well as push and slippage recovery abilities. In addition to that, we provide a theoretical sensitivity analysis of the footstep sequencing problem to enhance the understanding of the results. I Introduction I-A Context Bipedal robotics, with its origins tracing back to the end of the last century, has witnessed a significant surge in recent years. This trend, driven by technological advancements in areas such as actuation, and computing, has opened up a flurry of new potential applications [ 1 , 2 ] . However, these new solutions require efficient controllers that can fully exploit the hardware’s specificities to maximize utility. Historically, trajectory optimization (TO) has been widely used for the control of bipedal robots. Early models, such as the Linear Inverted Pendulum (LIP) or centroidal Model Predictive Control (centroidal MPC), evolved into more sophisticated approaches like whole-body MPC (WB MPC) [ 3 , 4 , 5 , 6 ] . However, as the complexity of control problems increases, the limitations of MPC become apparent. These limitations include limited reactivity to unforeseen disturbances and insufficient computational capacity. Even though warm starting the solver near the optimal solution can drastically reduce computation time [ 7 ] , these challenges persist. Reinforcement Learning (RL) techniques have emerged as a promising alternative [ 8 , 9 , 10 ] . RL nonetheless presents notable limitations. Bipedal robots are inherently very unstable, complicating the learning process. Additionally, RL requires vast amounts of data and computational time, and often lacks performance guarantees in real-world conditions. RL algorithms can also be sensitive to variations in the training environment, limiting their robustness and generalizability. In response to these challenges, hybrid methods, combining the strengths of trajectory optimization and reinforcement learning, are gaining popularity. Approaches such as Deep Tracking Control (DTC) [ 11 ] or Actor-Critic Model Predictive Control [ 12 ] aim to merge the best of both worlds to achieve optimal performance in terms of stability and adaptability. The enthusiasm around hybrid methods highlights the relevance of traditional MPC methods, especially when dealing with highly unstable humanoids. However, in most applications, they require an additional trajectory planner, which may not account for the dynamics of the MPC, to provide a reference trajectory for the robot. Fig. 1 : Bipedal robot bolt walking in PyBullet using whole-body MPC on cluttered terrain. Despite increasingly precise modeling and step sequencers based on simplified yet effective models, such as the Divergent Component of Motion (DCM) [ 13 , 14 ] , these planners are still necessary to provide robust heuristics for bipedal walking. An example of such architecture is presented in [ 15 ] . It employs a step planner followed by a foot trajectory controller and a whole-body instantaneous controller. Similarly, [ 16 ] conducted research using a low-frequency step planner (10 Hz) and a whole-body controller. A method based on iterative Linear Quadratic Gaussian (iLQG) [ 17 ] provides the capabilities to find foot sequences autonomously, but struggles to efficiently work on real hardware [ 18 ] . However, DDP with a rigid contact formulation such as the one formulated in [ 19 ] and tested on TALOS in [ 6 ] shows that if a sequence of contacts is given, WB MPC is doable on a real size humanoid robot. I-B Contributions In this paper, we propose to build upon the work of Khadiv et al. [ 15 ] by replacing the combination of the whole-body instantaneous controller and the footstep trajectory controller with a unified whole-body trajectory controller. Our approach aims to operate both the step sequencer and the whole-body model predictive controller (WB MPC) at the same frequency of 100 Hz, contrary to Yeganegi et al. [ 16 ] . This approach leads to the emergence of footstep trajectories, as demonstrated in previous works [ 20 , 4 ] , thereby simplifying robot programming and explicitly accounting for the angular momentum induced by foot motions. Furthermore, we propose a parameter sensitivity analysis of the step sequencer based on the method proposed by Fiacco [ 21 ] . The primary aim of this analysis is to provide analytical validation of intuitions regarding the interpretation of results. Secondly, it will serve as a preliminary basis for future research. The contributions of this work are as follows: • Integration of a step sequencer with a fixed-horizon WB MPC framework. • Simulation of the Bolt robot in PyBullet under various perturbation scenarios to evaluate the control strategy. • Comprehensive sensitivity analysis of the step sequencer’s response to disturbances in the DCM. II Footsteps Sequencer II-A Review of previous work Khadiv et al. [ 15 ] proposed to compute the position and timing of the next step so that the robot’s center of mass adheres to a desired velocity command while stabilizing the DCM. The DCM is the unstable component of the linear inverted pendulum model, whose dynamic equations are recalled as follows: \displaystyle\dot{\mathbf{c}} \displaystyle=w_{0}(\mathbf{\zeta}-\mathbf{c}) (1a) \displaystyle\dot{\mathbf{\zeta}} \displaystyle=w_{0}(\mathbf{\zeta}-\mathbf{p}_{0}) (1b) where \mathbf{c}\in\mathbb{R}^{2} is the position of the robot’s center of mass, \omega_{0}\in\mathbb{R} is the natural frequency of the pendulum ( \omega_{0}=\sqrt{\frac{g}{z_{c}}} , with g being the gravitational constant and z_{c} the fixed height of the center of mass), \mathbf{\zeta}\in\mathbb{R}^{2} is the robot’s DCM, and \mathbf{p}_{0}\in\mathbb{R}^{2} is the position of the support foot. To achieve this, Khadiv et al. [ 15 ] propose solving the following linearly constrained multi-objective QP problem: \displaystyle\min_{\mathbf{x}} \displaystyle f(\mathbf{x}) (2) \displaystyle\text{ s.t. } \displaystyle\begin{cases}g_{i}(\mathbf{x})\geq 0,&\quad i=1,\ldots,6\\ \hat{h_{j}}(\mathbf{x})=0,&\quad j=1,\ldots,2\end{cases} where \mathbf{x}=\begin{pmatrix}\mathbf{p}_{T}^{\top}&\Gamma(T)&\mathbf{b}_{T}^{\top}\end{pmatrix}^{\top} with \mathbf{p}_{T}=\begin{pmatrix}p_{T,x}&p_{T,y}\end{pmatrix}^{\top}\ \in\mathbb{R}^{2} representing the position of the next step, \Gamma(T)=e^{w_{0}T}\in\mathbb{R} the timing of the next step’s contact, and \mathbf{b}_{T}\in\mathbb{R}^{2} the DCM offset at the next step’s contact instant ( \mathbf{b}_{T}=\begin{pmatrix}b_{T,x}&b_{T,y}\end{pmatrix}^{\top}=\mathbf{\zeta}_{T}-\mathbf{p}_{T} , where \mathbf{\zeta}_{T} is the DCM at the next step’s contact instant). The multi-objective function is given as follows: \displaystyle f(\mathbf{x})= \displaystyle\ \alpha_{1}\left\|\mathbf{p}_{T}-\mathbf{p}_{0}-\begin{pmatrix}l_{\text{nom}}\\ w_{\text{nom}}\end{pmatrix}\right\|^{2} \displaystyle+\alpha_{2}\left|\Gamma(T)-\Gamma(T_{\text{nom}})\right|^{2} \displaystyle+\alpha_{3}\left\|\mathbf{b}_{T}-\begin{pmatrix}b_{x,\text{nom}}\\ b_{y,\text{nom}}\end{pmatrix}\right\|^{2} (3a) with \alpha_{1} , \alpha_{2} , \alpha_{3} as the weights of the different objectives, l_{\text{nom}} and w_{\text{nom}} as the desired step length and width respectively, \Gamma(T_{\text{nom}}) the desired contact time, and b_{x,\text{nom}} , b_{y,\text{nom}} the desired DCM offsets whose analytical expression is available in Appendix A of [ 15 ] . The inequality constraints are given as follows: g_{1}(\mathbf{x})=p_{T,x}-p_{0,x}-l_{\text{min}} (4a) g_{2}(\mathbf{x})=l_{\text{max}}-p_{T,x}+p_{0,x} (4b) which are constraints limiting the step length between l_{\min} and l_{\max} , g_{3}(\mathbf{x})=p_{T,y}-p_{0,y}-w_{\text{min}} (4c) g_{4}(\mathbf{x})=w_{\text{max}}-p_{T,y}+p_{0,y} (4d) which are constraints limiting the step width between w_{\min} and w_{\max} , g_{5}(\mathbf{x})=\Gamma(T)-\Gamma({T_{\text{min}}}) (4e) g_{6}(\mathbf{x})=\Gamma({T_{\text{max}}})-\Gamma(T) (4f) which are constraints limiting the step contact time between \Gamma(T_{\min}) and \Gamma(T_{\max}) . The following equations are equality constraints ensuring that the DCM follows the dynamics imposed by Eq. ( 1b ): \displaystyle\hat{h_{1}}(\mathbf{x}) \displaystyle=p_{T,x}+b_{T,x}-p_{0,x}-(\hat{\zeta}_{x}-p_{0,x})e^{-w_{0}t}\Gamma(T) (5a) \displaystyle\hat{h_{2}}(\mathbf{x}) \displaystyle=p_{T,y}+b_{T,y}-p_{0,y}-(\hat{\zeta}_{y}-p_{0,y})e^{-w_{0}t}\Gamma(T) (5b) with t the time elapsed since the last foot contact and \hat{\mathbf{\zeta}} the measured DCM. Note that, as explained in [ 24 ] , the DCM offset is not hard constrained because this could make the problem infeasible under certain conditions. In addition, w will sometimes be referred

Read the complete text