Semi-Supervised Neural Processes for Articulated Object Interactions

Emily Liu, Michael Noseworthy, Nicholas Roy · 2024

Read Semi-Supervised Neural Processes for Articulated Object Interactions by Emily Liu, Michael Noseworthy, Nicholas Roy (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-00145.txt.

Introduction

Emily Liu, Michael Noseworthy, and Nicholas Roy taught a robot model to learn from few action examples in a 2024 paper. Labeled action data are costly, since a robot must handle each object to make them. Photos of objects without action, by contrast, are plentiful.

Their model predicts the reward of an action for objects it has barely tried. Alongside the labeled data, it learns from a large pool of passive photos by rebuilding them in a hidden space. That joint training steers it toward traits that carry across objects, with less need for retraining. On a door-opening task it beat other semi-supervised methods while using only a fraction of the data that rival adaptive models used.

Catalog record

CREATOREmily Liu, Michael Noseworthy, Nicholas Roy
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-00145

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Semi-Supervised Neural Processes for Articulated Object Interactions Emily Liu, Michael Noseworthy, Nicholas Roy Abstract The scarcity of labeled action data poses a considerable challenge for developing machine learning algorithms for robotic object manipulation. It is expensive and often infeasible for a robot to interact with many objects. Conversely, visual data of objects, without interaction, is abundantly available and can be leveraged for pretraining and feature extraction. However, current methods that rely on image data for pretraining do not easily adapt to task-specific predictions, since the learned features are not guaranteed to be relevant. This paper introduces the Semi-Supervised Neural Process (SSNP): an adaptive reward-prediction model designed for scenarios in which only a small subset of objects have labeled interaction data. In addition to predicting reward labels, the latent-space of the SSNP is jointly trained with an autoencoding objective using passive data from a much larger set of objects. Jointly training with both types of data allows the model to focus more effectively on generalizable features and minimizes the need for extensive retraining, thereby reducing computational demands. The efficacy of SSNP is demonstrated through a door-opening task, leading to better performance than other semi-supervised methods, and only using a fraction of the data compared to other adaptive models. I Introduction In this work, we are interested in learning manipulation models that are adaptive : as a robot interacts and observes outcomes for a novel object, its performance should improve. Recently, a class of models called Neural Processes have been proposed that achieve this goal. However, they typically require labeled interactions for a large set of objects that is difficult to obtain [ 1 ] [ 2 ] . Interacting with many different objects is costly in terms of both time and money. For a fixed manipulator, the robot’s workspace can only fit a limited number of objects. Even for mobile manipulators, moving to new objects can take an infeasible amount of time. However, other types of data, such as images or video, are much more readily available for a diverse set of objects. Robots are commonly equipped with cameras which allow them to passively observe the interactions of other agents: for example, it can watch a human opening a door. There are also a wide range of video and image data on the web of either humans or other robots interacting with the world [ 3 ] . We are interested in models for manipulation that use labeled data generated from fewer objects by leveraging widely available passive data. Concretely, we assume the data are organized by objects, where all objects have multiple associated images, but only a fraction of the objects have action data labeled with outcomes (rewards). Manipulation models trained only on the objects that include labels (i.e., supervised learning) are unlikely to generalize to new objects due to the poor coverage of the dataset. In such scenarios, previous works have considered semi-supervised setups to leverage additional unlabeled data. A common approach is a pretraining-finetuning approach, where the model is first pretrained on unlabeled data (i.e., images) and then finetuned on labeled data (i.e., action-reward pairs) [ 4 ] [ 5 ] [ 6 ] . One issue with pretraining is domain shift, as the learned features may not be useful for the downstream manipulation task. Other techniques [ 7 ] [ 8 ] have been proposed to train both labeled and unlabeled data simultaneously without requiring pretraining, but do not account for the structured data common in manipulation tasks (i.e., datasets are hierarchical with many actions for each object). To develop adaptive models using labeled data from fewer objects, this work proposes the Semi-Supervised Neural Process (SSNP) model for object manipulation. More concretely, the model predicts the outcome of a manipulation action, given a set of object images and outcomes from any previous interactions. To leverage the larger set of objects with only unlabelled videos or images, the latent-space of the SSNP is jointly trained with an autoencoding objective for images and actions. A key ingredient to this approach is that instead of having separate pretraining and finetuning steps, we train using labeled and unlabeled data simultaneously. We argue that training on actions simultaneously helps the image autoencoder focus on features important to the manipulation task. Because the model does not require additional training epochs for finetuning, the computational cost of training is also greatly reduced. We demonstrate the method using a door opening task, showing that compared to baselines, the model is better able to leverage relevant features from images to robustly predict action outcomes and adapt to previous data in a few-shot manner. Fig. 1 : The Semi-Supervised Neural Process architecture consists of two autoencoder components. The context learner learns embeddings for unlabeled data (such as images) and the neural process learns an embedding of labeled action-reward pairs. Fig. 2 : Overview of the Semi-supervised Neural Process in deployment. The robot is presented with a new object with unknown kinematic properties. (1)The robot can passively observe context data without interacting with it. (2) When the robot starts interacting with the object, it can iteratively build an interaction dataset (exploration). The SSNP model can also be used to predict optimal actions based on the limited interaction data (task execution). II Problem Formulation and Background a_{C} r_{C} a_{T} r_{T} c_{a} n^{\prime} n (a) Neural Process z x c m (b) Neural Statistician z x c m a_{C} r_{C} a_{T} r_{T} c_{a} n^{\prime} n (c) Semi-supervised Neural Process Fig. 3 : Bayesian graphical models for NP, NS, and SSNP. (a) In the Neural Process, the observed variables are the pre-existing action-reward pairs ( a_{C} , r_{C} ) and the actions with unseen rewards ( a_{T} ). We learn the associated reward r_{T} with a_{T} by means of a latent variable c_{a} . (b) In the Neural Statistician, we observe hierarchical data x (e.g., images), from which we learn shared contextual latent variables c corresponding to the object, and unique instance-level latent variables z for each individual sample. (c) The SSNP integrates the NS and NP probabilistic generative models, where the unobserved r_{T} is conditioned upon both action-level latent variables c_{a} and object-level latent variables c . Our goal is to create an adaptive model for predicting action outcomes. We focus on a scenario where the dataset is comprised of objects annotated with multiple types of data. Each object has unlabeled data that is easy to obtain (e.g., image data), and a set of labeled data which is more costly to obtain (e.g., action-reward pairs). We assume that only a fraction of the objects includes the labeled data. II-A Notation SSNP solves a model-based bandit task and handles hierarchical multimodal datasets where each object O_{i} in the dataset \mathcal{D} has two associated sets of data, X_{i}=\{x_{i}^{1}...x_{i}^{m}\} and A_{i}=\{a_{i}^{1}...a_{i}^{n}\} with m and n individual datapoints respectively. Each element of A_{i} is an action (we assume all actions are performed from some nominal state), and each element of X_{i} is additional context data relevant to the object. A_{i} is also associated with a set of labels, R_{i}=\{r_{i}^{1},...r_{i}^{n^{\prime}}\} , that may be incomplete ( 0\leq n^{\prime}\leq n ) and corresponds to the reward associated with applying the respective action. In this work, we

Read the complete text