Task Parameter Extrapolation via Learning Inverse Tasks from Forward Demonstrations

Serdar Bahar, Fatih Dogangun, Matteo Saveriano, Yukie Nagai, Emre Ugur · 2026

Read Task Parameter Extrapolation via Learning Inverse Tasks from Forward Demonstrations by Serdar Bahar, Fatih Dogangun, Matteo Saveriano, Yukie Nagai, Emre Ugur (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05576.txt.

Introduction

Bahar and team address spreading robot skill policies to novel conditions, where copy learning stays stuck in the training region. Transfer learning offers path making robust to setting and task changes but remains data-hungry and weak at zero-shot spread. Their joint learning approach builds a common form of forward and inverse tasks, using extra forward demos from new setups to execute inverse tasks without direct guidance. Tests in mock and real-world environments with hard handling skills show the framework beating diffusion-based and multi-mode VAE rivals.

Catalog record

CREATORSerdar Bahar, Fatih Dogangun, Matteo Saveriano, Yukie Nagai, Emre Ugur
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42900
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.05576

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Task Parameter Extrapolation via Learning Inverse Tasks from Forward Demonstrations Serdar Bahar, Fatih Dogangun, Matteo Saveriano, Yukie Nagai, Emre Ugur Abstract Generalizing skill policies to novel conditions remains a key challenge in robot learning. Imitation learning methods, while data-efficient, are largely confined to the training region and consistently fail on input data outside it, leading to unpredictable policy failures. Alternatively, transfer learning approaches offer methods for trajectory generation robust to both changes in environment or tasks, but they remain data-hungry and lack accuracy in zero-shot generalization. We address these challenges by framing the problem in the context of task inversion learning and proposing a novel joint learning approach to achieve accurate and efficient knowledge transfer. Our method constructs a common representation of the forward and inverse tasks, and leverages auxiliary forward demonstrations from novel configurations to successfully execute the corresponding inverse tasks, without any direct supervision. We show the extrapolation capabilities of our framework via ablation studies and experiments in simulated and real-world environments that require complex manipulation skills with a diverse set of objects and tools, where we outperform diffusion-based alternatives. I Introduction A fundamental challenge in robotics is developing methods for efficient, generalizable skill acquisition. An autonomous robot is expected to adapt to variations in its environment as well as changes in task or skill specifications. This requires skill policies that can generalize beyond the specific conditions seen during training, a capability that still remains a significant obstacle for many current learning paradigms. Data-driven approaches in robotics have demonstrated impressive generalization capabilities, but often at the cost of extensive data collection and interaction with the environment [ 25 , 12 , 10 ] . Transfer learning frameworks aim to mitigate this by leveraging knowledge across tasks. A common technique, domain randomization, focuses on creating policies that are robust to variations in the environment, such as changes in lighting, friction, or object textures [ 25 , 17 , 3 ] . However, these approaches are mostly designed to handle environmental changes within a single task definition. While other methods, such as cross-domain transfer, exist, they often require additional training in the target domain and struggle with data efficiency and robust zero-shot performance [ 20 , 14 ] . Imitation learning (IL) offers a more data-efficient alternative by leveraging expert demonstrations for the task of interest. Foundational approaches in this domain include Dynamic Movement Primitives (DMPs) [ 9 , 22 ] , which use systems of differential equations and Probabilistic Movement Primitives (ProMPs) [ 16 ] , which model a distribution over trajectories. Deep learning has given rise to powerful and flexible methods such as Conditional Neural Movement Primitives (CNMPs) [ 24 ] and Stable Movement Primitives (StableMP) [ 18 ] , which leverage neural networks to learn complex, non-linear skills directly from demonstration data. More recently, advancements in deep generative modeling have enabled robotic policies to represent rich distributions using diffusion-based and flow-based models [ 5 , 6 , 27 , 13 ] . Although these methods are considered highly effective, their operational strength lies in interpolation , allowing them to accurately generate behaviors similar to the expert demonstrations provided, but they consistently fail at extrapolation [ 21 ] . This inability to generalize beyond the training data results in unpredictable trajectories for novel inputs, often compromising the success of downstream tasks that rely on the trained policy. While some recent work has shown promise in learning explicit mathematical relationships to enable extrapolation [ 19 ] , the problem remains largely unsolved for mainstream IL frameworks. We explore the paradigm of joint learning as a mechanism for zero-shot extrapolation, specifically within the structured domain of task inversion . Many robotic skills naturally exist as forward-inverse pairs (e.g., pushing an object to a goal and pulling it back; assembling a mechanical component and disassembling it for repair). We observe that if a common representation of forward and inverse tasks is obtained, an inverse task for a novel environment configuration can be generalized only from a provided forward task for a similar environment configuration (e.g., learning to disassemble a component by observing its assembly). Following this main idea, we propose a novel joint learning framework that effectively transfers knowledge from a forward task to its inverse counterpart by learning a common representation for both. Specifically, excluding out-of-distribution action generation from our scope, we focus on inferring inverse executions that are similar to an observed set of sensorimotor demonstrations. For instance, a robot, which acquired pushing and pulling skills for a set of objects, can utilize our framework to infer how to pull a novel object after observing how the object is pushed. Our framework can effectively scale to a wide range of objects and tools that share complex, underlying manipulation strategies. To achieve this, our method extends the framework of Conditional Neural Processes (CNP) [ 7 ] and Deep Modality Blending Networks (DMBN) [ 23 ] . CNP [ 7 ] is a meta-learning network that model complex data distributions through a Gaussian process-based perspective and has proven instrumental for skill learning in the robotic domain [ 24 , 1 , 23 , 2 ] . In particular, DMBN [ 23 ] is a multi-modal architecture that jointly learns different modalities of robot actions with CNP by forming a shared latent space of multi-modal observations. Our contributions include: 1. A joint learning framework that enables zero-shot extrapolation to novel task parameters for an inverse task by leveraging auxiliary demonstrations from its corresponding forward task . 2. A complete training methodology, including a demonstration matching algorithm based on initial and final environment states and an interleaved training schedule, that allows a flexible data demonstration process and efficient learning from datasets including auxiliary demonstrations. 3. Separating task parameter conditioning from sensorimotor encoding, which is crucial for generalizing to unseen parameters. We extensively evaluate our proposed method through varying settings. First, we conducted a synthetic trajectory experiment showing the necessity of pairing forward and inverse demonstrations. Then, we performed a simulation experiment with a rich set of objects, demonstrating the superior extrapolation capabilities of our method compared to diffusion-based alternatives (inspired by Chi et al. [ 5 ] ). Lastly, we showed the feasibility of our method on real-world skills, where extrapolation is required when operating with tools. II Method We are given a demonstration set that includes forward executions of skills and their inverse counterparts, along with their task parameters, where forward and inverse demonstrations are not necessarily matched, and not all counterparts are observed. Inverse executions represent executions that induce the opposite state transition in the environment. Our aim is to infer and generate inverse executions for novel task parameters by leveraging auxiliary forward demonstrations available for those parameters. The executions may or may not be direct reversals of the forward sensorimotor trajectories, depending on the complexity of the task. In this section, we first briefly introduce Conditional Neural Processes and Deep Modality Blending Networks, the frameworks on which our system is built. We then provide the problem formulation and a general overview of our framework, and finally present the details of our skill training and generalization methods. II-A Background II-A 1 Conditional Neural Processes (CNP) Given a set of input data,

Read the complete text