Leveling the Playing Field: Carefully Comparing Classical and Learned Controllers for Quadrotor Trajectory Tracking

Pratik Kunapuli, Jake Welde, Dinesh Jayaraman, Vijay Kumar · 2025

Read Leveling the Playing Field: Carefully Comparing Classical and Learned Controllers for Quadrotor Trajectory Tracking by Pratik Kunapuli, Jake Welde, Dinesh Jayaraman, Vijay Kumar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-17832.txt.

Introduction

Headlines that learning-based controllers crush classical ones in drone flight may rest on rigged comparisons. Pratik Kunapuli, Jake Welde, Dinesh Jayaraman, and Vijay Kumar re-run the contest carefully for a quadrotor with a fixed arm tracking agile paths. They list three quiet biases that favor learning: uneven access to the goal, to tuning data, and to knowledge of the future path.

After building the best version of each controller under one fair protocol, the gap shrank dramatically. The classical geometric controller held smaller steady errors on gentle tasks. The learned controller reacted better when the flying got wild. Which one wins depends on how agile the job is. The authors release their code and plead for symmetric benchmarks in future comparisons.

Catalog record

CREATORPratik Kunapuli, Jake Welde, Dinesh Jayaraman, Vijay Kumar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-17832

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Leveling the Playing Field: Carefully Comparing Classical and Learned Controllers for Quadrotor Trajectory Tracking Pratik Kunapuli, Jake Welde, Dinesh Jayaraman, Vijay Kumar Abstract Learning-based control approaches like reinforcement learning (RL) have recently produced a slew of impressive results for tasks like quadrotor trajectory tracking and drone racing. Naturally, it is common to demonstrate the advantages of these new controllers against established methods like analytical controllers. We observe, however, that reliably comparing the performance of such very different classes of controllers is more complicated than might appear at first sight. As a case study, we take up the problem of agile tracking of an end-effector for a quadrotor with a fixed arm. We develop a set of best practices for synthesizing the best-in-class RL and geometric controllers (GC) for benchmarking. In the process, we resolve widespread RL-favoring biases in prior studies that provide asymmetric access to: (1) the task definition, in the form of an objective function, (2) representative datasets, for parameter optimization, and (3) “feedforward” information, describing the desired future trajectory. The resulting findings are the following: our improvements to the experimental protocol for comparing learned and classical controllers are critical, and each of the above asymmetries can yield misleading conclusions. Prior works have claimed that RL outperforms GC, but we find the gaps between the two controller classes are much smaller than previously published when accounting for symmetric comparisons. Geometric control achieves lower steady-state error than RL, while RL has better transient performance, resulting in GC performing better in relatively slow or less agile tasks, but RL performing better when greater agility is required. Finally, we open-source implementations of geometric and RL controllers for these aerial vehicles, implementing best practices for future development. Code, videos, and more can be found on the project website: https://pratikkunapuli.github.io/rl-vs-gc/ I Introduction The capabilities of aerial robots have seen explosive growth in recent years, with many exciting results in fast quadrotor flight [ 2 ] , tracking infeasible trajectories [ 12 ] , and drone racing, even surpassing human pilots [ 14 ] . Many of these advances have involved data-driven techniques, and this has spawned careful studies of the design choices in learning-based controller synthesis, such as policy architectures, training procedures, and modeling choices. It is now largely accepted wisdom that data-driven controller synthesis approaches outperform more classical model-based methods for aerial robot control tasks. Fig. 1 : Trajectory Tracking for a Quadrotor. Rollouts of trajectory tracking from an initial perturbation of a reinforcement learning controller (blue) and a geometric controller (orange) on a quadrotor. Robots are visualized at t=1 and t=5 to highlight transient and steady-state performance relative to the reference trajectory (grey). RL Controller has better transient performance ( t=1 ), but worse steady-state error ( t=5 ) compared to GC. However, relatively few studies have systematically compared these two very different classes of controllers. This may be partly be attributed to the small overlap in research communities engaged in the development and application of model-based versus learned controllers. In any case, existing empirical studies largely focus on careful comparisons within each broad model class: such as Sun et al. 2024 who compare model-based controllers, or Kaufmann et al. 2022 , Dionigi et al. 2024 who benchmark learning-based controllers. As we will discuss in detail in Sec II and IV , the few prior studies that do compare learned and model-based controllers suffer from some shortcomings. While they aim to reproduce in good faith the respective common practices of the model-based and learned control communities, this inadvertently confounds the comparison, because these standard practices are very different. It is standard in data-driven controller synthesis research to optimize parameters with a carefully designed objective function on a dataset of experiences that exactly match the target task. On the other hand, the tuning of a model-based controller is often a much more heuristic manual procedure to achieve a “good enough” configuration. Inheriting such practices when comparing learned and model-based controllers can produce misleading conclusions: the model-based controller may be sub-optimally tuned and perform worse only on that account. In other words, correct comparisons across learned and model-based controllers is more complicated than might appear at first sight. Geometric Control (GC) Reinforcement Learning (RL) Focus Paper Tuned for Obj.? Traj Data? Feed Forward? Tuned for Obj.? Traj Data? Feed Forward? RL Benchmark of Learned Policies [ 13 ] - - - ✓ ✓ ✓ SimpleFlight [ 5 ] - - - ✓ ✓ ✓ Leveraging Symmetry [ 29 ] - - - ✓ ✓ ✓ Sim-2-Multi-Real [ 20 ] ✗ ✗ ✗ ✓ ✗ ✗ Power of Input [ 7 ] ✗ ✗ ✗ ✓ ✗ ✗ DATT [ 12 ] ✗ ✗ \sim ✓ ✓ ✓ Learning to Fly in Seconds [ 8 ] ✗ ✗ ✗ ✓ ✗ ✗ GC Geometric SE(3) Control [ 15 ] ✗ ✓ ✓ - - - INDI [ 26 ] ✗ ✓ ✓ - - - NMPC vs. DFBC [ 25 ] ✗ ✓ ✓ - - - PID AutoTune [ 27 ] ✓ ✓ ✗ - - - NonLinear PID [ 21 ] ✓ ✓ \sim - - - Ours ✓ ✓ ✓ ✓ ✓ ✓ TABLE I : Trajectory Tracking Controller Comparisons in Recent Literature. Partial survey of representative works proposing trajectory tracking methods for quadrotors based on GC and/or RL. We measure these works on whether (to the best of our knowledge) the methods a) optimized a task objective, b) were optimized for trajectory tracking, and c) incorporate future reference information. ✓ represents a controller had this component, \sim represents a suboptimal implementation (details in Sec IV ), and ✗ represents a method that did not have this component. Asymmetries occur when comparing across model classes whose implementation was granted unequal access to task, data, or feedforward information. In this paper, our first contribution is to identify and fix three key “asymmetries” that can produce misleading gains for learning versus model-based methods on standard aerial vehicle tasks like trajectory tracking: objective functions, task-relevant data, and “feedforward” inputs specifying upcoming trajectory waypoints. Our second contribution is to apply these proposed improvements in experimental protocol to throughly benchmark reinforcement learned controllers (RL) and geometric controllers (GC) for agile trajectory tracking in quadrotors. Having leveled the playing field, our findings substantially erode the gains of RL versus GC controllers: the two controller classes perform about on par in most of our evaluations, with small gains for GC in steady-state errors, and similar gains for RL in transient performance (Fig 1 ). These findings add nuance to today’s prevailing wisdom about the relative merits of these controllers. We show further how our improved recipe for empirical comparison can be applied towards validating various hypotheses on new aerial robot classes and tasks. Finally, we provide re-usable implementations of best practices for both RL and geometric controller synthesis for aerial vehicle trajectory tracking tasks including task implementations in a highly parallel RL-ready simulator, to be released publicly together with this paper for future practitioners and researchers. II Related Works In this section, we elaborate on the deficiencies highlighted in Sec I in the state of current scientific evidence regarding the efficacy of learned and model-based controllers for quadrotor control.

Read the complete text