Hybrid Reinforcement Learning and Search for Flight Trajectory Planning
Alberto Luise, Michele Lombardi, Florent Teichteil Koenigsbuch · 2025
Read Hybrid Reinforcement Learning and Search for Flight Trajectory Planning by Alberto Luise, Michele Lombardi, Florent Teichteil Koenigsbuch (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-04100.txt.
Introduction
Alberto Luise and one co-author, Michele Lombardi, speed up airline route planning by pairing learning software with a classic solver in a 2025 research paper. Replanning a flight path quickly matters in emergencies, when weather or trouble closes the planned route. Their learning agent studies location and weather data ahead of time and drafts near-best paths. At run time, the solver only searches near that draft instead of the whole sky.
Trials used performance models from Airbus aircraft. Fuel burn stayed within about one percent of the fully searched answer in most cases. Planning time dropped by as much as half. The trade-off is clear: near-perfect routes, delivered far sooner when minutes count.
Catalog record
| CREATOR | Alberto Luise, Michele Lombardi, Florent Teichteil Koenigsbuch |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-04100
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Hybrid Reinforcement Learning and Search for Flight Trajectory Planning Alberto Luise, Michele Lombardi, Florent Teichteil Koenigsbuch Abstract This paper explores the combination of Reinforcement Learning (RL) and search-based path planners to speed up the optimization of flight paths for airliners, where in case of emergency a fast route re-calculation can be crucial. The fundamental idea is to train an RL Agent to pre-compute near-optimal paths based on location and atmospheric data and use those at runtime to constrain the underlying path planning solver and find a solution within a certain distance from the initial guess. The approach effectively reduces the size of the solver’s search space, significantly speeding up route optimization. Although global optimality is not guaranteed, empirical results conducted with Airbus aircraft’s performance models show that fuel consumption remains nearly identical to that of an unconstrained solver, with deviations typically within 1%. At the same time, computation speed can be improved by up to 50% as compared to using a conventional solver alone. This paper discusses the theoretical framework, the different implementation strategies, the adopted testing procedures, the obtained results and finally further possible developments and future perspectives. University of Bologna, [email protected] University of Bologna, [email protected] Airbus-Toulouse, [email protected] ccs Computing methodologies Artificial intelligence keywords Reinforcement Learning AI Hybrid methods † † runningtitle: Integrating RL with Search & Optimization strategies † † runningauthor: A. Luise et al. † † copyright: Alberto Luise, Michele Lombardi, Alistair Nottle, and Florent Teichteil Koenigsbuch 1 Introduction The optimal trajectory for an airliner to go from point A to point B is often not a straight line, not only due to the Earth’s curvature but also due to weather conditions, wind, temperature and other atmospheric factors. Furthermore, fully simulating an aircraft is not an easy task, as they are very complex machines: computing the transition states and costs from one waypoint to another in a search graph requires to call an external performance model simulator which is very CPU time consuming. Therefore, standard flight planning algorithms rely on a number of approximations ranging from simplified performance model to decoupled lateral/longitudinal search. In order to allow for practical use of more accurate and non-decoupled flight planning models as the ones developed by Airbus in the scikit-decide library [ 3 ] , more advanced techniques like hybridization of machine learning and model-based planning are necessary. While computation speed might not be a problem when computing an airport-to-airport route in advance, it could become crucial depending on the application. In fact, in case of Flight Diversion , an automated planner could be used on-line to re-compute multiple trajectory options to the nearest airports in case a passenger has a critical health condition and has to be taken to a hospital as soon as possible. In these circumstances a slow planner, accurate as it may be, is not adequate. The solution proposed in this paper is to build over an existing route construction approach, based on combinatorial search and light constraint propagation via Forward Checking. Specifically, inspired by the UNIFY framework [ 9 ] , a coarse route construction stage based on Reinforcement Learning (RL) is introduced, and used to constrain the existing combinatorial approach to search in the vicinity of the RL routes. The resulting hybrid method can reduce the computation time by up to 50%, thanks to the low inference cost of RL, with a negligible or moderate loss in terms of solution quality. Additionally, while the focus of this paper is on on a deterministic version of the problem, the method could be naturally extended to account for uncertainty. 2 Problem Definition This paper considers the problem of planning a route for an aircraft from an origin to a destination, accounting for earth geometry, weather, and fuel consumption through a deterministic model. Such a trajectory is generally specified via a sequence of waypoints, starting with the origin and ending with the destination. Navigation between subsequent waypoints is assumed to follow a great circle trajectory, with no adjustment made for adverse weather or obstacles. In this paper, reducing fuel consumption is the main objective, since it accounts for flight time, but also for potentially difficult encountered weather conditions. Formally, the state of an aircraft can be modeled as a pair (x,s) , where x\in\mathbb{R}^{3} represents the aircraft location in a three-dimensional space and the vector s captures all remaining state components, such as mass, acceleration, fuel level, etc. Weather conditions include the wind speed, wind direction, and temperature and are modeled through a tensor field \xi(x) , associating relevant information to each location. The cost of flying between two locations x^{\prime} and x^{\prime\prime} along a great circle trajectory is specified via a function f_{\xi}(x^{\prime},x^{\prime\prime}) , which is evaluated by means of a simulator. An aircraft route consists of a sequence \tau=\{x_{k}\}_{k=1}^{n} , where x_{1} represents the origin and x_{n} the destination. The cost of traversing the route is given by: f_{\xi}(\tau)=\sum_{k=1}^{n-1}f_{\xi}(x_{k},x_{k+1}). (1) This work assumes the availability of an approximation algorithm capable of computing near-optimal routes; in this specific case such an algorithm consists in a planner that works by: 1) defining a discretization of the three-dimensional space between the origin and the destination; 2) building a directed-graph representation over the discretization, using forward-checking to account for feasibility of flight maneuvers; 3) computing the cost of moving from connected nodes in the graph via a linear approximation of the cost f_{\xi}(x^{\prime},x^{\prime\prime}) , for reduced computational cost; 4) searching for an optimal path via A*, guided by a custom heuristic. The algorithm is implemented in the scikit-decide library, an AI framework for Reinforcement Learning, Automated Planning and Scheduling [ 3 ] . It has been co-developed at Airbus AI Research together with the ANITI research center and TUPLES project and provides multiple solvers capable of interacting with pre-existing or custom built environments. The space discretization consists of a three-dimensional box, whose number of nodes along each axis can be configured. A finer discretization results in a better approximation of the cost, a better representation of the continuous nature of aircraft travel, and therefore in remarkably better route costs. Unfortunately, a linear increase of the number of nodes on every axis leads to a cubic increase in the total number of nodes. Together with the complex nature of the problem cost, this results in run-times that are not suitable for online scenarios, where flight diversions need to be quickly computed. The main goal of this contribution is that of reducing the time needed to compute a route . Additionally, this work aims at paving the way for a solution approach capable of accounting for uncertainty in the weather condition fields, which is currently treated as deterministic. 3 Hybrid model The structure of a solution for the considered problem (i.e. a sequence of locations) suggests that significant run-time reductions could be reached via a hierarchical approach [ 5 , 6 ] : for example, one could think of planning a route with a coarse discretization, then connecting the resulting waypoints with routes built using a finer discretizaton. Unfortunately, using a coarse discretization makes the linear cost approximation used by the planner very inaccurate. Additionally, forcing the route to traverse the waypoints built with a coarse discretization can be overly restrictive,