TLE-Based A2C Agent for Terrestrial Coverage Orbital Path Planning
Anantha Narayanan, Battu Bhanu Teja, Pruthwik Mishra · 2025
Read TLE-Based A2C Agent for Terrestrial Coverage Orbital Path Planning by Anantha Narayanan, Battu Bhanu Teja, Pruthwik Mishra (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-10872.txt.
Introduction
Anantha Narayanan, Battu Bhanu Teja, and Pruthwik Mishra present a 2025 paper on steering Earth observation satellites with reinforcement learning. Low Earth orbit grows crowded, so planners must hit their imaging targets while dodging collision risk. The team trained an agent to tune orbital parameters for exact ground coverage.
The setup treats orbit design as a step-by-step decision process in a custom simulator. Classical orbital elements describe each trial orbit, built from public two-line element data. The agent adjusts five of the six elements to center the satellite's pass over chosen surface points. Against a rival learning method, theirs earned far higher rewards in far fewer steps. It met coverage goals across varied target coordinates. Learning-based planning could ease the load on mission teams.
Catalog record
| CREATOR | Anantha Narayanan, Battu Bhanu Teja, Pruthwik Mishra |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-10872
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TLE-Based A2C Agent for Terrestrial Coverage Orbital Path Planning Anantha Narayanan, Battu Bhanu Teja, Pruthwik Mishra Abstract The increasing congestion of Low Earth Orbit (LEO) poses persistent challenges to the efficient deployment and safe operation of Earth observation satellites. Mission planners must now account not only for mission-specific requirements but also for the increasing collision risk with active satellites and space debris. This work presents a reinforcement learning framework using the Advantage Actor-Critic (A2C) algorithm to optimize satellite orbital parameters for precise terrestrial coverage within predefined surface radii. By formulating the problem as a Markov Decision Process (MDP) within a custom OpenAI Gymnasium environment, our method simulates orbital dynamics using classical Keplerian elements. The agent progressively learns to adjust five of the orbital parameters—semi-major axis, eccentricity, inclination, right ascension of ascending node, and the argument of perigee—to achieve targeted terrestrial coverage. Comparative evaluation against Proximal Policy Optimization (PPO) demonstrates A2C’s superior performance, achieving 5.8× higher cumulative rewards (10.0 vs 9.263025) while converging in 31.5× fewer timesteps (2,000 vs 63,000). The A2C agent consistently meets mission objectives across diverse target coordinates while maintaining computational efficiency suitable for real-time mission planning applications. Key contributions include: (1) a TLE-based orbital simulation environment incorporating physics constraints, (2) validation of actor-critic methods’ superiority over trust region approaches in continuous orbital control, and (3) demonstration of rapid convergence enabling adaptive satellite deployment. This approach establishes reinforcement learning as a computationally efficient alternative for scalable and intelligent LEO mission planning. we will release the data and code soon. Introduction In recent years, space interest has grown multifold, with hundreds of spacecrafts launched to meet surveillance, earth observatory, connectivity, and other needs. While this has opened new frontiers, it has created a peculiar problem, in the form of orbital congestion. Mission-planning now has to take into consideration existing orbits, collision courses and space-debris, thus requiring sophisticated systems that adapt to dynamic requirements and diverse targets. Traditional approaches to orbit design rely on computationally expensive optimization techniques ( Song et al. 2018 ) , analytical approximations ( Savitri et al. 2017 ) , or heuristic planning methods ( Mok et al. 2019 ) that struggle with evolving environments and real-time constraints. Thus, a new approach that optimizes orbital parameters is essential for addressing these challenges. Reinforcement learning (RL), in particular, has emerged as a paradigm for solving complex sequential problems, at the forefront of the limitations of traditional methods. The application of deep reinforcement learning to orbital mechanics ( Kyuroson et al. 2024 ) presents unique opportunities for developing adaptive and intelligent satellite control systems. This work addresses the challenges of orbit planning for target-based earth observation satellites in the Low Earth Orbit(LEO), by formulating it as a Markov Decision Process (MDP) problem, and employs Advantage Actor Critic algorithm, to predict optimal parameters. This approach illustrates the usefulness of modern reinforcement learning algorithms in complex orbital dynamics problems and satellite mission planning, emphasizing: • a novel MDP formulation for satellite orbit optimization • a custom simulation environment for orbital mechanics using Keplerian elements, and • demonstrating A2C’s effectiveness in learning stable orbital policies. Problem Formulation Orbital Elements Figure 1: Illustration of the orbital elements used in this study. ( Tafanidis et al. 2025 ) Every orbit in space is uniquely defined by its set of classical Keplerian orbital elements. These parameters describe the size, shape, and orientation of the orbit, as well as the satellite’s position along the orbit at a given time. • Semi-major axis (a): Defines the size of the elliptical orbit. It represents half the longest diameter of the orbit and determines the orbital period. For LEO, a typically ranges from approximately 6,700 to 7,500 km, corresponding to altitudes of 300–1,200 km above Earth’s surface. • Eccentricity (e): Measure of the deviation of a curve from being a perfect circle, typically ranging from 0 to 1. LEO missions often use near-circular orbits ( e\approx 0 – 0.05 ) to ensure stable coverage and minimize altitude variations. • Inclination (i): It is the angle between the orbital plane and Earth’s equatorial plane, typically ranging from 0 to \pi radians. Inclination dictates the latitudinal coverage, with polar orbits ( i\approx 90^{\circ} ) enabling global coverage and equatorial orbits ( i\approx 0^{\circ} ) limiting coverage to low latitudes. • Right Ascension of Ascending Node ( \Omega ): The angle measured in the equatorial plane from the vernal equinox ( \Upsilon , the First Point of Aries) to the ascending node, where the satellite crosses the equator from south to north. \Omega orients the orbital plane in inertial space and is critical for aligning the orbit with ground targets. • Argument of Perigee ( \omega ): The angle between the ascending node and the orbit’s point of closest approach to Earth (perigee), measured within the orbital plane. • True Anomaly ( \upsilon ): The angle between the ascending node and the orbit’s point of closest approach to Earth (perigee), measured within the orbital plane. For the purpose of orbit optimization, in this work, we focus on the following five elements, which are sufficient to determine the orbital path relative to a central body, such as Earth: semi-major axis, eccentricity, inclination, right ascension of the ascending node, and argument of perigee. The true anomaly ( \upsilon ) is excluded from optimization, as it represents the satellite’s instantaneous position rather than a fixed orbital characteristic. For LEO missions, these parameters are bounded by both operational constraints (e.g., altitude range) and physical feasibility (e.g., avoiding collisions, satisfying revisit requirements). In the context of this work, the orbital elements are treated as action parameters that can be optimized to maximize the satellite’s ability to pass within a predefined threshold to a ground target. Instead of relying on fixed values or manual tuning, we employ a learning-based approach to adjust these elements dynamically during training. This allows the satellite to discover orbital configurations that satisfy coverage objectives while adhering to physical feasibility. Environment To facilitate this learning-based orbit optimization, we designed a custom simulation environment modeled on OpenAI Gymnasium ( Towers et al. 2024 ) . Figure 2: Illustration of the TLE-Based OpenAI Gymnasium environment. This environment allows for dynamic evaluation and testing using its action and observation spaces, incorporating orbital mechanics. The OpenAI Gymnasium API dictates the functions as standard for compatibility and cross-platform usage with Stable Baselines3. Initialization and TLE data To ensure realism, scalability, and mission-specific relevance, we initialize orbital elements using parameters constrained by publicly available Two-Line Element (TLE) data of active Earth-orbiting satellites. TLEs are a standardized format used to encode the orbital parameters of satellites, maintained and regularly updated by organizations such as Celestrak and NORAD. This data reflects the actual state of operational satellites and is therefore well-suited for defining plausible orbital configurations in our simulation environment. While TLE updates only reflect the instantaneous position of the satellite in its orbital path, Our simulation framework focuses on the orbital configuration as a whole rather than the real-time relative position of a satellite within its orbit.This reduces the need for continuous TLE retrieval and validation at every simulation step.Instead, we extract the orbital parameters once, reconstruct the complete orbit, and use this static representation for mission constraint enforcement. This