Threading the Needle: Test and Evaluation of Early Stage UAS Capabilities to Autonomously Navigate GPS-Denied Environments in the DARPA Fast Lightweight Autonomy (FLA) Program
Adam Norton, Holly A. Yanco · 2025
Read Threading the Needle: Test and Evaluation of Early Stage UAS Capabilities to Autonomously Navigate GPS-Denied Environments in the DARPA Fast Lightweight Autonomy (FLA) Program by Adam Norton, Holly A. Yanco (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08122.txt.
Introduction
Adam Norton and Holly Yanco review how a defense research program tested small flying robots that steer themselves without GPS, in a paper from 2025. The program ran from 2015 to 2018 and set three teams the same hardware. Each team built its own sensing and control software.
The authors explain the test methods used to score and compare the teams fairly. Trials ran indoors and outdoors and grew harder over time. The paper walks through each Phase 1 trial and sums up the results. Weak spots and strengths in speed, safety, and path choice came into view. The review gives future testers a clear model for judging such craft in hard, unknown places.
Catalog record
| CREATOR | Adam Norton, Holly A. Yanco |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 15 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-08122
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Threading the Needle: Test and Evaluation of Early Stage UAS Capabilities to Autonomously Navigate GPS-Denied Environments in the DARPA Fast Lightweight Autonomy (FLA) Program Adam Norton, Holly A. Yanco Abstract The DARPA Fast Lightweight Autonomy (FLA) program (2015–2018) served as a significant milestone in the development of UAS, particularly for autonomous navigation through unknown GPS-denied environments. Three performing teams developed UAS using a common hardware platform, focusing their contributions on autonomy algorithms and sensing. Several experiments were conducted that spanned indoor and outdoor environments, increasing in complexity over time. This paper reviews the testing methodology developed in order to benchmark and compare the performance of each team, each of the FLA Phase 1 experiments that were conducted, and a summary of the Phase 1 results. I Introduction The past 25 years of research and development in aerial robotics has seen tremendous growth in the adoption of systems as well as the advancement of capabilities including increased speed, more reliable autonomy, and powerful onboard computing. There are several significant milestones in this history that saw the domain shifting from primarily GPS-driven systems to those capable of operating in GPS-denied environments. One such milestone was the DARPA Fast Lightweight Autonomy (FLA) program [ 1 ] , running from 2015–2018, seeking to develop minimalistic algorithms for high-speed autonomous navigation of UAS in cluttered environments without prior knowledge, remote control, or GPS. Unlike other DARPA funded robotics programs like the Robotics Challenge (DRC) and Subterranean (SubT) Challenge, FLA did not conduct public events or competitions, so visibility of the program was somewhat limited in comparison. However, the experimentation conducted during the program is a significant benchmark, demonstrating the early stage capabilities of UAS in this burgeoning field and setting the stage for future developments. This paper presents an overview of the test and evaluation conducted for the DARPA FLA program, reviewing the testing methodology used and a summary of the results. II DARPA Fast Lightweight Autonomy (FLA) From the start, FLA had several objectives towards achieving autonomous UAS navigation of complex, urban, cluttered environments, including flying up to 20 m/s up to 1 km of range for a 10-minute mission, without high-quality prior knowledge, without communications back to the operator, and without GPS, all performed onboard the UAS with 20 W of computing power. The program utilized a wide range of algorithmic and sensing approaches by having performing teams focus on the development of autonomy rather than hardware design. A common commercial UAS platform (COTS airframe, motors, and propellers, with an open-source autopilot, thrust-to-weight ratio of 2.8, and able to fit through doors and windows) was provided and teams outfitted their own sensors, processors, and software. A series of experiments were planned and executed such that teams’ solutions could be evaluated and compared in progressively more difficult environments, adding complexity including denser obstacles, longer distances, and varied lighting. Fig. 1: The three performing teams of the DARPA FLA program. Three performer teams participated in FLA (see Fig. 1 ). University of Pennsylvania utilized integrated sensing, planning, and control for fast flight with novel sensors and processing [ 2 ] . Draper and MIT leveraged symbolic perception techniques for provably-correct motion primitives, including their “Samwise” pose and state estimation [ 3 , 4 ] . Scientific Systems Company, Inc. (SSCI) leveraged a bio-inspired technique with tightly-coupled perception and control, using expansion rate techniques to determine collision risk from obstacles [ 5 ] . A common strategy for all teams, though, was the use of monocular cameras in order to reduce weight and the required computing, as well as sensors for altitude detection (single point lidar) and inertial sensors for pose measurement. Some teams also used stereo cameras and spinning lidars for certain experiments; more information on each team’s solution can be found in their cited papers. The DARPA FLA program ran in two phases. During Phase 1 (2015–2017), all teams were tasked with performing the same challenges across a series of experiments allowing for direct side-by-side comparison of performance to be evaluated. For Phase 2 (2017–2018), each team was instructed to focus on their respective strengths, pushing each team to achieve autonomous navigation capabilities across different mission profiles. Given that the test and evaluation activities for Phase 2 were not designed for side-by-side comparison, this paper only covers the experimentation conducted during Phase 1 of the program. III Testing Methodology With the focus of FLA on the development of autonomy for navigation rather than search, the UAS had to be given some form of mission plan to execute. In more typical navigation scenarios, a mission specification requires at least the location of a goal to be reached, often conveyed as a coordinate either globally as GPS or locally as x,y,z in a given map. However, given the UAS were operating without GPS, there were limited methods to specify a goal and for the UAS to validate whether or not it had reached that goal. If a soldier were in a similar scenario, they could rely on the use of paper maps (which may or may not be accurate) using a compass to navigate, looking for a target feature in the environment as their goal point (e.g., building or vehicle). Following this analogy, several test and evaluation elements were developed and implemented. Fig. 2: Testing artifacts at the start position and goal. Start position and goal artifacts. Fiducials consisting of AprilTags were placed at the start position that could be used by the UAS to align to magnetic north. This was accomplished using horizontal fiducials on the takeoff platform for the UAS to identify using a downward-facing camera and a vertical fiducial placed 6 m away that was aligned to magnetic north to be identified using a forward-facing camera. A red target object – either a Polaris vehicle or a barrel with hazmat labels – was placed at the goal and start position which the UAS would seek to recognize to further guide its navigation to the intended location (Fig. 2 ). Mission files . Provided to each team to use for UAS navigation, mission files (Fig. 3 ) consisted of an XML file with relative distance and bearing from magnetic north between the start position and goal, dimensions and images of the target objects, the AprilTags used in the start position fiducials, satellite imagery of the area (e.g., Google Maps) oriented to magnetic north with a line drawn from the start position to the goal, and elevation limitations to ensure interaction between obstacles and the UAS (e.g., 4.3 m elevation limit ensures the UAS will not fly above a building or tree). Using these elements, each UAS could align with the fiducials at the start position, rotate in place the relative bearing to the goal, navigate and avoid obstacles along that trajectory, detect the target object at the goal, turn around, and return to start. Mission files also ensured fairness across teams by giving them all the same level of information. Fig. 3: Example contents of a mission file: (clockwise from left) overhead map with trajectory, AprilTags, and target object images. Successful navigation . Criteria was established for the UAS having successfully reached the goal and/or returned to start. A cylindrical volume with approximately 12