ActivePusher: Active Learning and Planning with Residual Physics for Nonprehensile Manipulation

Zhuoyun Zhong Seyedali Golestaneh Constantinos Chamzas · 2025

Read ActivePusher: Active Learning and Planning with Residual Physics for Nonprehensile Manipulation by Zhuoyun Zhong Seyedali Golestaneh Constantinos Chamzas (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04646.txt.

Introduction

Zhuoyun Zhong, Seyedali Golestaneh, and Constantinos Chamzas present ActivePusher, a robot system that learns to push objects by choosing its own practice data, in a research paper from 2025. Pushing and rolling are hard to model with exact physics, so robots learn from trial data. Random practice wastes effort, and learned models stay unsure in rarely tried settings.

ActivePusher blends a learned model with basic physics and picks the most useful practice pushes. It also feeds its doubt into the motion planner, steering the robot toward actions it trusts. Tests in simulation and on a real robot beat rival methods on data thrift and planning success.

Catalog record

CREATORZhuoyun Zhong Seyedali Golestaneh Constantinos Chamzas
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-04646

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ActivePusher: Active Learning and Planning with Residual Physics for Nonprehensile Manipulation Zhuoyun Zhong Seyedali Golestaneh Constantinos Chamzas Abstract Planning with learned dynamics models offers a promising approach toward real-world, long-horizon manipulation, particularly in nonprehensile settings such as pushing or rolling, where accurate analytical models are difficult to obtain. Although learning-based methods hold promise, collecting training data can be costly and inefficient, as it often relies on randomly sampled interactions that are not necessarily the most informative. To address this challenge, we propose ActivePusher , a novel framework that combines residual-physics modeling with kernel-based uncertainty-driven active learning to focus data acquisition on the most informative skill parameters. Additionally, ActivePusher seamlessly integrates with model-based kinodynamic planners, leveraging uncertainty estimates to bias control sampling toward more reliable actions. We evaluate our approach in both simulation and real-world environments and demonstrate that it improves data efficiency and planning success rates compared to baseline methods. Figure 1: The two key challenges addressed by ActivePusher . When learning, the robot must choose the most informative (active learning) skill parameters to efficiently improve its skills. When planning, the robot should select skill parameters with low model uncertainty (active planning) to ensure reliable task completion. Keywords: Active Learning, Nonprehensile Manipulation, Kinodynamic Planning 1 Introduction Model-based planning methods offer a powerful framework for generalizing robotic behavior across tasks and enabling long-horizon decision making [ 1 ] . However, their effectiveness critically depends on the accuracy of the underlying forward dynamics model. Inaccuracies in this model can cause cascading errors during execution, particularly in contact-rich settings such as nonprehensile manipulation (e.g., pushing, sliding, or rolling), where even minor deviations in predicted trajectories may lead to significant task failure. Accurately modeling the dynamics for these tasks is challenging. Analytical physics-based models often rely on simplified assumptions about friction, contact geometry, and mass distribution, making them brittle in practice [ 2 ] . As an alternative, data-driven approaches can learn dynamics directly from interaction data, either from scratch or by refining simplified analytical models through residual learning. However, these methods face two key limitations in real-world robotic settings: • Sample inefficiency: Learning accurate models often requires large amounts of interaction data, which is costly and time-consuming to collect on physical systems. • Inaccuracy in underexplored regions: Even well-trained models may perform poorly in sparsely explored regions of the skill space, leading to unreliable predictions and failures during execution. In this paper, we propose ActivePusher , a framework that tightly integrates active learning, residual learning, and kinodynamic planning, to address both challenges visually illustrated in Fig. 1 . The core insight of our approach is to explicitly quantify epistemic uncertainty in a learned residual dynamics model using the Neural Tangent Kernel ( NTK ) [ 3 ] . This uncertainty estimate allows the system to actively target informative skills for learning and reliable skills for planning. During learning, rather than sampling pushing actions to practice at random, ActivePusher continuously query the NTK to identify which actions promise the greatest reduction in uncertainty and execute these actions. By actively targeting the most informative actions, the model potentially achieves rapid improvement with far fewer interactions compared to random method. During planning, the uncertainty estimates are incorporated into an asymptotically optimal kinodynamic planner, biasing control selection toward high-confidence actions to maximize task success. By focusing on where the model is uncertain to improve, and where the model is certain to execute, our approach tightly integrates learning and planning, enabling robust nonprehensile manipulation with few real-world interactions per task. Crucially, ActivePusher operates without large offline datasets, high-fidelity simulation, or human demonstrations. Our main contributions are as follows: • Active learning for skill model refinement . We introduce a principled framework for data-efficient skill learning in nonprehensile manipulation by selecting skill parameters that maximumly reduce epistemic uncertainty, enabling targeted data acquisition in the most informative regions of the action space. • Uncertainty-aware kinodynamic planning . We propose a novel planning strategy that integrates model uncertainty into an asymptotically optimal kinodynamic planner, guiding action sampling toward reliable actions and improving overall task success rate. • Empirical validation in simulation and the real world . We demonstrate the effectiveness of our approach with multiple objects and a manipulation task, showing improved data efficiency and planning success over baselines. 2 Related Work ActivePusher draws ideas from several areas, such as residual learning, active learning and kinodynamic planning. In this section, we briefly review each of these areas in the context of nonprehensile manipulation, with a focus on pushing. Residual Model Learning aims to combine the strengths of analytical and data-driven approaches by training a neural network to predict corrections on top of an approximate physics-based model. This strategy increases predictive accuracy while leveraging the structure and inductive biases provided by analytical models. In robotic manipulation, purely analytical models and physics simulations can offer useful priors but are often coarse approximations of real-world dynamics, sensitive to assumptions about physical parameters [ 4 ] . Conversely, fully data-driven methods [ 5 ] can model complex behaviors without priors but typically require large amounts of real-world data. By learning only the residual error between a physics model and reality, residual learning approaches significantly reduce the data burden while improving real-world performance. Our work builds on residual learning approaches [ 6 , 7 ] . In addition, ActivePusher advances beyond prior work by actively selecting the most informative data points for model refinement, further improving sample efficiency. Active Learning is a well-established topic in machine learning that aims to improve sample efficiency by actively selecting which data points to label [ 8 , 9 , 10 , 11 ] . This paradigm naturally aligns with self-supervised robotic learning settings, where the robot can autonomously choose which experiences to collect. Given the high cost of real-world data acquisition, several robotic learning approaches have leveraged active learning to reduce the number of required interactions [ 12 ] . In the context of skill learning, recent methods [ 13 , 14 ] have applied active learning strategies to accelerate the acquisition of binary success/failure skills, such as pouring [ 15 ] or scooping. However, existing approaches primarily focus on optimizing task success rates rather than predicting the detailed outcomes of actions. In contrast, our work applies active learning to improve predictive skill models, enabling more accurate outcome predictions and their integration into kinodynamic planners. Kinodynamic Non-Prehensile Planning Prior works have investigated kinodynamic planning for non-prehensile tasks using fixed physics-based models, primarily emphasizing computational efficiency [ 16 , 17 ] . The authors of [ 18 ] adapt online to uncertainty, while visual-dynamics methods [ 19 , 20 , 21 ] learned visual forward dynamics, but require extensive data collection. More closely related to our approach are methods such as [ 22 , 4 , 23 ] , which learn dynamics models using GP and integrate them within a model predictive control (MPC) framework. Although these methods combine learned models with model-based planners, they rely on random data collection and do not reason about learned model uncertainty. 3 Problem Statement Kinodynamic Planning: Let x\in\mathcal{X} denote the state and state-space, and u\in\mathcal{U} denote the control and control-space of a robotic system [ 24 ] . The true (unknown) system dynamics

Read the complete text