Planning Human-Robot Co-manipulation with Human Motor Control Objectives and Multi-component Reaching Strategies

Kevin Haninger, Luka Peternel · 2024

Read Planning Human-Robot Co-manipulation with Human Motor Control Objectives and Multi-component Reaching Strategies by Kevin Haninger, Luka Peternel (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-13474.txt.

Introduction

Kevin Haninger and Luka Peternel plan robot motions for tasks where a human and a robot move an object together. Their paper is from two thousand twenty-four. A good partner robot should adapt to what the human intends and how they move. Models of human muscle are too low-level, and learned models can fail on new people or tasks.

Their planner uses models from human motor control research. Those models say a reaching motion trades off speed against accuracy, and effort against reward. The team turns that trade-off into an optimization the robot can solve. It can then estimate the human's goal and shape its own motion to match. Tests on shared reaching and synced motion tasks produced human-like paths across varied conditions.

Catalog record

CREATORKevin Haninger, Luka Peternel
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-13474

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Planning Human-Robot Co-manipulation with Human Motor Control Objectives and Multi-component Reaching Strategies Kevin Haninger, Luka Peternel Abstract For successful goal-directed human-robot interaction, the robot should adapt to the intentions and actions of the collaborating human. This can be supported by musculoskeletal or data-driven human models, where the former are limited to lower-level functioning such as ergonomics, and the latter have limited generalizability or data efficiency. What is missing, is the inclusion of human motor control models that can provide generalizable human behavior estimates and integrate into robot planning methods. We use well-studied models from human motor control based on the speed-accuracy and cost-benefit trade-offs to plan collaborative robot motions. In these models, the human trajectory minimizes an objective function, a formulation we adapt to numerical trajectory optimization. This can then be extended with constraints and new variables to realize collaborative motion planning and goal estimation. We deploy this model, as well as a multi-component movement strategy, in physical collaboration with uncertain goal-reaching and synchronized motion tasks, showing the ability of the approach to produce human-like trajectories over a range of conditions. MPC - HRI 1 Introduction Human-robot collaboration is one of the key aspects of the seamless integration of robots into our daily lives. The principle of human-robot collaboration combines the human exceptional cognitive capabilities with robot strength and precision [ 1 , 2 ] . Nevertheless, to do this effectively, it is important that the robot understands in real-time the states and intentions of the human partner, and acts in a legible way. The way to do so is the inclusion of human modeling into physical human-robot interaction control [ 3 ] . In recent years, many studies have incorporated human musculoskeletal models into robot control systems to account for ergonomic factors, such as minimizing joint torques and muscle fatigue, with the goal of increasing work efficiency and preventing musculoskeletal injuries [ 4 ] . While physical ergonomics is one of the important aspects of Human-robot collaboration, it is also crucial to be able to predict human behavior. The common communication channels for intention detection are based on vision [ 5 ] , haptic interaction [ 6 , 7 , 8 ] , and biosignals, such as muscle activity [ 9 , 10 ] or brain activity [ 11 ] . The measurements from various channels then have to be interpreted by a model that can predict human behavior, so that the robot can generate appropriate collaborative actions. For haptic communication, the intention prediction model can be based on a simple impedance model that transforms the measured forces into predicted motion [ 6 , 12 ] . While this simplicity comes with good robustness, it is limited to encoding more primitive actions and behavior. On the other hand, more complex collaborative behavior can be encoded by machine learning methods, such as Bounded-Memory Adaptation Models [ 13 ] , Inverse Reinforcement Learning [ 14 ] , Gaussian Processes (GP) [ 8 ] , Dynamic Movement Primitives [ 15 ] , and ensemble Bayesian Interaction Primitives [ 16 ] . Nevertheless, these approaches rely on human interaction data which might not always be available, practical, or generalizable. Figure 1 : Proposed human motor control models (blue), combined with task parameters (purple) into a trajectory optimization problem to produce the robot trajectory. This base model can be extended with observed motion or transitions between ballistic and corrective motion to build collaborative scenarios. An alternative to machine learning is to use computational models based on our understanding of human motor control. Human motor control studies developed various computational models of how the human central nervous system generates goal-directed movements, which are based on optimizing specific aspects. One important aspect the model can optimize for is the speed-accuracy trade-off [ 17 , 18 ] , which is described by the well-known Fitts’ law [ 19 ] . Since human neural signals are subject to noise, which is amplified by muscle activity [ 20 ] , faster movements that require more muscle activations tend to be less precise. Another important aspect of human motor control that the model can optimize is the cost-benefit trade-off [ 21 , 22 , 23 ] . The human central nervous system (CNS) wants to minimize the metabolic cost, which would require slower movements with less muscle activity. However, at the same time, spending more time on a movement is perceived as less beneficial [ 24 ] . A computational model can also combine the two trade-offs [ 25 ] . Furthermore, in more complex situations, the CNS can split movements into sub-movements to optimize them locally for different purposes [ 26 , 27 ] . When reaching for a more distant goal, the CNS tends to make the initial (ballistic) sub-movement faster and less precise to get into the vicinity of the goal as fast as possible, while the final (corrective) sub-movement is slower and more precise to ensure the goal is reached [ 26 , 27 ] . The proposed model considers that each sub-movement uses the speed-accuracy and cost-benefit trade-offs with different parameters depending on the purpose. Computational models of the CNS can directly integrate the understanding of human motor control into a collaborative robot control system for behavior prediction and optimization of the robot’s actions. This can provide a principled way to generate trajectories that are compatible with or exploit natural human motion and reduce the need for machine learning data. While autonomous robots do not need to operate according to human movement principles, in human-robot interaction, it is crucial for the robot to understand human motion and act according to human natural movement and limitations. A few existing studies in robotics incorporated some computational models into the robot control system using optimal control [ 28 , 29 ] , goal inference [ 30 , 31 ] or minimum-jerk principles [ 32 ] . However, these are not based on the standard or the latest accepted models from human motor control such as speed-accuracy and cost-benefit trade-offs, which are more accurate in neuroscience studies [ 17 , 18 , 21 , 22 , 23 , 24 , 25 ] . To the best of our knowledge, unified speed-accuracy and cost-benefit trade-offs, as well as a higher-level movement-splitting strategy, have not yet been incorporated into robot control systems for collaborative human-robot movements. The most comparable approach in the human-robot collaboration literature are methods based on minimum jerk trajectories (e.g., [ 32 ] ). However, minimum jerk models do not enable some key features, such as 1) accounting for stochastic dynamics, which is important for goal inference, 2) accounting for the cost-benefit tradeoff that is key in predicting accurate trajectory distributions and velocity profiles, and 3) reproducing asymmetry in the velocity profile. To address this gap, we propose a novel robot control method that incorporates human motor control models of speed-accuracy and cost-benefit trade-offs as cost terms in optimization-based trajectory planning and higher-level movement-splitting strategy. By formulating a numerical optimal control problem that describes human reaching behaviors, this problem can be readily extended to formulate natural robot collaborative behaviors. We apply this trajectory planning to two collaborative manipulation tasks, where the goal location has higher uncertainty in certain

Read the complete text