Learning-Based Sparsification of Dynamic Graphs in Robotic Exploration Algorithms
1 st Adithya V. Sastry, 2 nd Bibek Poudel, 3 rd Weizi Li · 2026
Read Learning-Based Sparsification of Dynamic Graphs in Robotic Exploration Algorithms by 1 st Adithya V. Sastry, 2 nd Bibek Poudel, 3 rd Weizi Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16509.txt.
Introduction
Sastry, Poudel and Li prune the fast-growing graphs that robotic exploration builds for frontier search and path planning. Their hybrid transformer framework, trained with proximal policy optimization, trims graphs during exploration to limit growth and excess information. Tested in simulations where a robot agent used rapidly-exploring random trees for frontier exploration, the learned policy cut graph size by up to 96 percent. It beat a randomly pruned baseline and improved both exploration and compute efficiency on complex long-horizon tasks, suggesting reinforcement learning can viably prune dynamic exploration graphs.
Catalog record
| CREATOR | 1 st Adithya V. Sastry, 2 nd Bibek Poudel, 3 rd Weizi Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26945 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.16509
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning-Based Sparsification of Dynamic Graphs in Robotic Exploration Algorithms 1 st Adithya V. Sastry, 2 nd Bibek Poudel, 3 rd Weizi Li Abstract Many robotic exploration algorithms rely on graph structures for frontier-based exploration and dynamic path planning. However, these graphs grow rapidly, accumulating redundant information and impacting performance. We present a transformer-based framework trained with Proximal Policy Optimization (PPO) to prune these graphs during exploration, limiting their growth and reducing the accumulation of excess information. The framework was evaluated on simulations of a robotic agent using Rapidly Exploring Random Trees (RRT) to carry out frontier-based exploration, where the learned policy reduces graph size by up to 96%. We find preliminary evidence that our framework learns to associate pruning decisions with exploration outcomes despite sparse, delayed reward signals. We also observe that while intelligent pruning achieves a lower rate of exploration compared to baselines, it yields the lowest standard deviation, producing the most consistent exploration across varied environments. To the best of our knowledge, these results are the first suggesting the viability of RL in sparsification of dynamic graphs used in robotic exploration algorithms. I Introduction Autonomous systems have achieved remarkable progress in navigating complex, unstructured environments, enabling robots to carry out tasks that were previously limited to human operators [ 27 ] . Search and rescue, space exploration, and surveillance all stand to benefit from autonomous robotic exploration, as these tasks often require operation in environments too hazardous or inaccessible for humans [ 2 ] . However, many exploration algorithms rely on graph or tree structures for path planning and waypoint creation [ 7 , 17 ] , and these structures grow continuously as the agent explores, accumulating redundant information that can degrade performance. By pruning these graphs, we can allow a robot to focus on pushing frontiers with greater potential for information gain, reducing the overhead of maintaining large, dense structures. Yet, the relationships between the exploration graph and the environment shift as the robot gains new information about its surroundings [ 7 , 17 , 24 ] . Pruning decisions must therefore be made sequentially under partial observability, with rewards that are delayed and difficult to attribute to individual actions. These characteristics make reinforcement learning (RL) a promising tool for learning an effective pruning strategy, as it is designed to handle sequential decision-making with sparse, delayed feedback and without supervised labels. Fig. 1: Left: An example environment the robot explores. Middle: Exploration progress without pruning. Right: Exploration progress with pruning over a comparable time period. Magenta blocks are obstacles, gray area represents explored free space, black area represents unexplored free space, blue represents the exploration graph, and yellow represents the robot’s field of view. Pruning reduces the exploration graph size by up to 96 %, demonstrating the potential for intelligent sparsification in graph-based exploration. We introduce a transformer-based framework that utilizes RL to prune dynamic graphs used in frontier-based robotic exploration, reducing the size of exploration graphs by 96% (Fig. 1 ). Preliminary results show that while intelligent pruning currently reduces the final explored area compared to baselines (42.84% for intelligent pruning, versus 71.33% and 70.99% for randomly pruned and unpruned baselines, respectively) given a fixed exploration time, it also yields the most consistent exploration across varied environments ( \pm 7.76%) compared to baselines ( \pm 10.47% and \pm 17.99% for randomly pruned and unpruned baselines, respectively). To the best of our knowledge, these results are the first to suggest the viability of RL for intelligent sparsification of dynamic graphs in graph-based robotic exploration algorithms. As such, this research finds learned policies to be a novel tool for enabling robots to carry out such tasks with reduced or sparse information. Source code can be found in the GitHub repository 1 1 1 https://github.com/avs-origami/graphsparse . II Related Work Fig. 2: Overview of the framework for pruning robotic exploration graphs. An image of the current map (top left) is split into patches, tokenized, and enriched with positional embeddings before passing through a Gated Transformer-XL encoder and multi-layer perceptron (MLP) layers for feature extraction. The extracted features feed into separate actor and critic heads, where the actor predicts the means, standard deviations, and mixing weights that define a Gaussian Mixture Model (GMM) over the environment. To determine which nodes to prune, the coordinates of nodes in the exploration graph are projected onto this GMM, and the highest-probability nodes are removed. Frontier-based exploration [ 29 ] is a widely used paradigm in which graph or tree structures are used to identify frontiers (the boundary between explored and unexplored regions) and guide pathfinding towards these regions, continuously maximizing information gain [ 24 , 19 , 7 ] . Deep reinforcement learning (DRL) also sees extensive use in robotic exploration [ 10 ] , with methods ranging from using direct policy learning to identify exploration targets and carry out exploration [ 12 , 20 ] , to using graph neural networks to make navigation decisions based on specialized graph representations of the environment [ 4 , 5 , 11 , 30 ] . Canonical algorithms may be better suited to rapid replanning or dynamic environments, while DRL approaches can outperform them in more structured settings [ 1 ] . However, purely learned approaches must relearn basic exploration behaviors from scratch and can struggle when encountering diverse environments. Rather than using a learned policy directly for exploration, we combine a canonical exploration algorithm with DRL for the subtask of pruning the exploration graph. This preserves the algorithmic robustness of frontier-based methods while using RL to learn the complex, evolving relationship between the graph and the environment, thereby enabling exploration with reduced information. The pruning task requires the model to learn how sequences of decisions affect future exploration over long horizons. To capture these long-term dependencies, we rely on the Gated Transformer-XL (GTrXL) [ 16 ] . Transformers [ 25 ] are effective for feature representation across a range of tasks [ 8 , 18 , 9 ] , and recent works extend their capacity for long-term memory [ 6 , 15 ] . GTrXL adds gating mechanisms that stabilize training under the non-stationary data distributions typical in RL, making it well-suited for our task where the state and action spaces shift as exploration progresses. In short, while existing studies address robotic exploration through either purely algorithmic strategies [ 24 , 17 , 19 , 29 , 7 ] or fully learned approaches [ 10 , 12 , 20 , 4 , 5 , 11 ] , we introduce a hybrid approach that leverages RL to perform intelligent sparsification on the exploration graph. This preserves the robustness, adaptability, and interpretability of algorithmic methods while leveraging learned policies to reduce redundant information. III Methodology We define the task as pruning nodes from the exploration graph of a frontier-based robotic exploration algorithm, with the objective of producing a sparse graph that is at least as effective at enabling exploration as the original. To simplify the problem, we assume a fixed, known environment size, which enables fixed-size inputs and outputs to the model. Our solution framework is outlined in Fig. 2 . III-A Markov Decision Process We formulate the graph pruning strategy as a partially observable Markov decision