Task-Parameter Nexus: Task-Specific Parameter Learning for Model-Based Control

Sheng Cheng, Ran Tao, Yuliang Gu, Shenlong Wang, Xiaofeng Wang, Naira Hovakimyan · 2024

Read Task-Parameter Nexus: Task-Specific Parameter Learning for Model-Based Control by Sheng Cheng, Ran Tao, Yuliang Gu, Shenlong Wang, Xiaofeng Wang, Naira Hovakimyan (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-12448.txt.

Introduction

Sheng Cheng and five co-authors teach a network to pick controller settings for each new tracking task in this 2024 paper. Model-based controllers fly well when tuned, but fresh tasks lack tuned parameters. Their Task-Parameter Nexus predicts near-optimal settings at run time.

Training data came from a bank of trajectories spanning speeds and curvatures. For each path, the best parameters were tuned offline and stored as ground truth. The network learned to map task to settings by supervised learning. On a quadrotor, in simulation, it predicted near-optimal parameters across a spectrum of tasks. It also generalized to tasks it had never seen. The authors frame the approach as auto-tuning that travels with the controller.

Catalog record

CREATORSheng Cheng, Ran Tao, Yuliang Gu, Shenlong Wang, Xiaofeng Wang, Naira Hovakimyan
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-12448

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Task-Parameter Nexus: Task-Specific Parameter Learning for Model-Based Control Sheng Cheng, Ran Tao, Yuliang Gu, Shenlong Wang, Xiaofeng Wang, Naira Hovakimyan Abstract This paper presents the Task-Parameter Nexus (TPN), a learning-based approach for online determination of the (near-)optimal control parameters of model-based controllers (MBCs) for tracking tasks. In TPN, a deep neural network is introduced to predict the control parameters for any given tracking task at runtime, especially when optimal parameters for new tasks are not immediately available. To train this network, we constructed a trajectory bank with various speeds and curvatures that represent different motion characteristics. Then, for each trajectory in the bank, we auto-tune the optimal control parameters offline and use them as the corresponding ground truth. With this dataset, the TPN is trained by supervised learning. We evaluated the TPN on the quadrotor platform. In simulation experiments, it is shown that the TPN can predict near-optimal control parameters for a spectrum of tracking tasks, demonstrating its robust generalization capabilities to unseen tasks. \coltauthor keywords optimal parameter prediction, batch autotuning, quadrotor control 1 Introduction A typical robot control problem often starts with a specific task (like manipulators operating in warehouses for moving objects around, or aerial robots transporting packages), for which a suitable control solution will then be designed to accomplish this task. When the task changes, one may have to re-tune the control parameters; otherwise, the original parameters might not be able to offer a satisfactory performance and even jeopardize task completion. For instance, consider a PD-type controller for a quadrotor’s translational control. One set of control parameters cannot cater to different tasks uniformly well: if the task requires the quadrotor to hover, then the D-gain in the PD controller needs to be dominant to allow sufficient damping so that the quadrotor can smoothly return to the hover position when it is perturbed. On the contrary, if the task needs the quadrotor to track an aggressive trajectory (with high speeds or sharp turns), the D-gain needs to be reduced and the P-gain might be raised at the same time for sufficient agility and responsiveness to the fast-changing reference. A traditional way to address this issue is to use gain-scheduling ( Rugh and Shamma 2000 ) , which, however, cannot handle tasks that are not predefined. These observations lead to a challenging question: given a task that could be new and not predefined, how can we online determine the associated optimal or near-optimal control parameters in a given model-based control structure? This paper introduces such a tool that enables the system to learn the control parameters when operating different tasks. For the purposes of illustration, we consider a quadrotor platform where a task is defined as tracking a specific trajectory. Different tasks imply tracking different trajectories with distinct motion characteristics. Since each trajectory is potentially associated with a set of optimal control parameters, there exists a nontrivial mapping from tasks to control parameters. We approximate this mapping using a deep neural network (DNN), called Task-Parameter Nexus (TPN). Given a task characterized by a reference trajectory, the TPN predicts the (near-) optimal control parameters of a model-based controller (MBC) for tracking purposes, as shown in Fig. 1 . To train the TPN, we first create a trajectory bank that includes trajectories with various motion characteristics categorized by speed and curvature. Note that varying speeds and curvatures present distinct challenges for tracking translational and rotational motions, respectively. Figure 1 : An illustration of the Task-Parameter Nexus when applied to a model-based controller. By changing the speed and curvature, the trajectory bank covers rich enough tracking tasks that the quadrotor may encounter. Consequently, for each trajectory from the bank, we obtain the optimal control parameters, also referred to as “expert parameters,” by performing auto-tuning ( Cheng et al. 2024 ) offline. We use them as the ground-truth labels. With the pairs of trajectories in the bank and corresponding expert parameters, we train the TPN in a supervised manner. Leveraging the generalization capability of neural networks, the TPN can possibly infer appropriate parameters for unseen testing tasks, making the TPN suitable for adapting the system to new tasks for which expert parameters are not immediately available. In simulation experiments, the TPN demonstrates robust generalization capabilities across a spectrum of testing tasks, predicting near-optimal control parameters. The contributions of this paper are summarized as follows: (i) We present the TPN, an inference tool to determine appropriate control parameters for a system to perform new/unseen tasks when suitable parameters are not immediately available during operation. (ii) We construct a trajectory bank, from which we sample tasks and use auto-tuning to obtain optimal control parameters as the labels to train the TPN. The trajectory bank contains trajectories systematically spanning a wide range of speeds and curvatures, which can be used for training policies or benchmarking different control laws/policies. (iii) We introduce a batch version of DiffTune ( Cheng et al. 2024 ) as the controller auto-tuning scheme to obtain the expert parameters, which extends the original single-task scenario to a multi-task scenario. The batch-DiffTune avoids overfitting the parameters to one specific task and improves the robustness of the auto-tuned parameters. 2 Related Literature Limited Generalization Capability of Low-Level Control in Robotics Large language models ( Touvron et al. 2023 ; Mercat et al. 2024 ) and vision language models ( Wang et al. 2024 ; Liu et al. 2024 ; Lu et al. 2024 ) have achieved remarkable success in understanding and generating human language, recognizing objects, and interpreting scenes. This progress is largely due to the availability of large-scale datasets and the ability to learn patterns from vast amounts of visual and textual information, enabling these models to generalize well across different contexts and scenarios ( Brohan et al. 2023 ) . However, limited generalization capability in low-level control has been reported ( Brohan et al. 2023 ) due to relatively scarce data available for a model to capture unseen motions. Furthermore, even if a large foundation model generalizes effectively at the motion level, the low-level control, which often follows the model-based design and requires task-specific tuning ( Hwangbo et al. 2019 ; Bohez et al. 2022 ) , may not generalize equally well. In this work, we address the problem of limited generalization capability of the low-level control by inferring control parameters for achieving near-optimal performance over unseen control tasks. For model-based controllers, one can obtain optimal control performance by auto-tuning the controller subject to known tasks. Many auto-tuning schemes have been proposed in recent years that leverage learning-enabled approaches, e.g., Gaussian Processes ( Berkenkamp et al. 2016 ; Brunke et al. 2022 ; Müller et al. 2021 ) and sampling ( Loquercio et al. 2022 ; Song and Scaramuzza 2022 ) . Autodifferentiation has also been used for auto-tuning ( Cheng et al. 2024 ; Cheng et al. 2023 ; Tao et al. 2024 ; Kumar and Ramadge 2021 ) when the system dynamics and controller are differentiable. However, the above-introduced auto-tuning schemes usually apply to a single-task setting, leading to likely overfitting for a particular task, thus limiting the generalization capability to other tasks. In this work, we extend the single-task tuning scheme ( Cheng et al. 2024 ) to a batch

Read the complete text